00010000:00010000:3.0F:1787096260.011326:0:6547:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1787096260.343824:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0F:1787096260.343900:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083342080 00000100:00100000:1.0:1787096260.343923:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083342080 00000100:00080000:0.0:1787096260.343980:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096260.344030:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:1.0:1787096260.344053:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4836bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+8:28454:x1873906083342080:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:1.0:1787096260.344074:0:5759:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096260.344148:0:5759:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c492ab1600/0xf4d1a9ae0b4f3071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6bbf6a0cc6be5ee8 expref: -99 pid: 5759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.344218:0:5759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c492ab0600/0xf4d1a9ae0b4f3078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.344235:0:5759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c492ab0600/0xf4d1a9ae0b4f3078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.344246:0:5759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c492ab0600/0xf4d1a9ae0b4f3078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096260.344299:0:5759:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787096260.344302:0:5759:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787096260.344321:0:5759:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91c492ab0600/0xf4d1a9ae0b4f3078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.344341:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c492ab1600/0xf4d1a9ae0b4f3071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5ee8 expref: 10 pid: 5759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.344366:0:5759:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91c492ab0600/0xf4d1a9ae0b4f3078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5ee8 expref: 9 pid: 5759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.344373:0:5759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91c4835eb900) 00010000:00010000:1.0:1787096260.344376:0:5759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096260.344378:0:5759:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91c492ab0600, rc 0) 00000100:00100000:1.0:1787096260.344448:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4836bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+9:28454:x1873906083342080:12345-192.168.204.35@tcp:101:rm.0 Request processed in 407us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096260.344454:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 134 00000100:00100000:0.0:1787096260.345515:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0F:1787096260.345560:0:5761:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083342208 00000100:00100000:2.0:1787096260.345574:0:5761:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083342208 00000100:00100000:2.0:1787096260.345642:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:2.0:1787096260.345656:0:5761:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+9:28454:x1873906083342208:12345-192.168.204.35@tcp:101:rm.0 00010000:00010000:2.0:1787096260.345666:0:5761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096260.345677:0:5761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9200/0xf4d1a9ae0b4f307f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6bbf6a0cc6be5eef expref: -99 pid: 5761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345713:0:5761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345725:0:5761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345735:0:5761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345752:0:5761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345762:0:5761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345773:0:5761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345861:0:5761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9000/0xf4d1a9ae0b4f3094 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345871:0:5761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9000/0xf4d1a9ae0b4f3094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345878:0:5761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9000/0xf4d1a9ae0b4f3094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096260.345905:0:5761:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x11:0x0]: returning size 0 00000004:00200000:2.0:1787096260.345908:0:5761:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787096260.345918:0:5761:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9000/0xf4d1a9ae0b4f3094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345929:0:5761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9000/0xf4d1a9ae0b4f3094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345938:0:5761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345945:0:5761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345954:0:5761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345961:0:5761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c489ef9c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1787096260.345966:0:5761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345975:0:5761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.345986:0:5761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91c4835eb900) 00010000:00010000:2.0:1787096260.345989:0:5761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096260.345994:0:5761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346001:0:5761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3086 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346025:0:5761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346033:0:5761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346041:0:5761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346048:0:5761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c489ef9a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1787096260.346052:0:5761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346059:0:5761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346071:0:5761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff91c482be2600) 00010000:00010000:2.0:1787096260.346074:0:5761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096260.346077:0:5761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346084:0:5761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f308d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346149:0:5761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9200/0xf4d1a9ae0b4f307f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5eef expref: 11 pid: 5761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346176:0:5761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9000/0xf4d1a9ae0b4f3094 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5eef expref: 10 pid: 5761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.346197:0:5761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff91c482be2000) 00010000:00010000:2.0:1787096260.346200:0:5761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096260.346202:0:5761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91c489ef9000, rc 0) 00000100:00100000:2.0:1787096260.346237:0:5761:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4b7dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+10:28454:x1873906083342208:12345-192.168.204.35@tcp:101:rm.0 Request processed in 587us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096260.346242:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 135 00000100:00100000:2.0:1787096260.347450:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1787096260.347478:0:5760:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083342464 00000100:00100000:0.0:1787096260.347487:0:5760:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083342464 00000100:00100000:0.0:1787096260.347529:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 136 00000100:00100000:0.0:1787096260.347539:0:5760:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4bfb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+10:28454:x1873906083342464:12345-192.168.204.35@tcp:36:rm.0 00010000:00010000:0.0:1787096260.347600:0:5760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787096260.347630:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9000/0xf4d1a9ae0b4f3094 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5eef expref: 10 pid: 5761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347654:0:5760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff91c482be2000) 00010000:00010000:0.0:1787096260.347676:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c492ab0600/0xf4d1a9ae0b4f3078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5ee8 expref: 9 pid: 5759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347696:0:5760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91c4835eb900) 00010000:00010000:0.0:1787096260.347709:0:5760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096260.347729:0:5760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347740:0:5760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347748:0:5760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347757:0:5760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347762:0:5760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347775:0:5760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347870:0:5760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347875:0:5760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.347881:0:5760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348478:0:5760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348486:0:5760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348493:0:5760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348501:0:5760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348509:0:5760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348516:0:5760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348540:0:5760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787096260.348559:0:5760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.348570:0:8266:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096260.348579:0:8266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348581:0:5760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.348621:0:8266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c4837a6400 already unused, calling callback (ffffffffc16c16f0) 00010000:00010000:0.0:1787096260.348621:0:5760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.348627:0:8266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348653:0:5760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c4837a7c00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:1.0:1787096260.348654:0:8266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348663:0:5760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.348670:0:8266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff91c483b73a00) 00010000:00010000:1.0:1787096260.348674:0:8266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787096260.348677:0:8266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.348683:0:8266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6400/0xf4d1a9ae0b4f30b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348683:0:5760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096260.348714:0:8266:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096260.348716:0:8266:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096260.348720:0:5760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff91c483b73a00) 00010000:00010000:1.0:1787096260.348722:0:8266:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096260.348728:0:5760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787096260.348733:0:5760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348741:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7c00/0xf4d1a9ae0b4f30a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348765:0:5760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348773:0:5760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348781:0:5760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348787:0:5760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c4837a7e00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1787096260.348797:0:5760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348803:0:5760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348810:0:5760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91c483b73700) 00010000:00010000:0.0:1787096260.348812:0:5760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096260.348815:0:5760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096260.348819:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7e00/0xf4d1a9ae0b4f309b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096260.348829:0:5760:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c09974c7 reply state 000000005d21fbb9 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096260.348835:0:5760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787096260.348915:0:5760:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4bfb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+10:28454:x1873906083342464:12345-192.168.204.35@tcp:36:rm.0 Request processed in 1376us (1463us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787096260.348925:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 136 00010000:00010000:2.0:1787096260.349551:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.349559:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.349563:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.349566:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c4837a6000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1787096260.349569:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.349573:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.349595:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff91c483b73600) 00010000:00010000:2.0:1787096260.349598:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096260.349602:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096260.349609:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6000/0xf4d1a9ae0b4f30a2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096261.035213:0:5746:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096261.227274:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787096261.227302:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4b415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088597248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096261.227391:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096261.227499:0:6534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088597248 00000100:00100000:1.0:1787096261.227507:0:6534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088597248 00000100:00100000:1.0:1787096261.227587:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787096261.227617:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787096261.227722:0:6534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4b415b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088597248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787096261.227757:0:6534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096261.227807:0:6534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4b415b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088597248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096261.227816:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787096261.228526:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4b415aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088597248:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787096261.235583:0:5781:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00010000:00010000:3.0:1787096262.059209:0:5747:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096262.212029:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096262.212079:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1787096262.212147:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083342720 00000100:00100000:0.0:1787096262.212147:0:5753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083342592 00000100:00100000:0.0:1787096262.212157:0:5753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083342592 00000100:00100000:1.0:1787096262.212158:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083342720 00000100:00100000:0.0:1787096262.212211:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 235 00000100:00080000:2.0:1787096262.212216:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096262.212221:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:0.0:1787096262.212224:0:5753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2360:x1873906083342592:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1787096262.212236:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4bfb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:2361:x1873906083342720:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1787096262.212296:0:5753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483700050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2360:x1873906083342592:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096262.212302:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4bfb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:2361:x1873906083342720:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 69us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096262.212312:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 87 00000100:00100000:0.0:1787096262.212323:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 235 00000100:00100000:0.0:1787096262.251221:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096262.251237:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4bfb29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3620d8f4-6286-4815-a66b-86d036d7af2b:3294:1873906088597504:0@lo:400:kworker.0 00000100:00100000:0.0:1787096262.251238:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4bfb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088597632:0@lo:400:kworker.0 00000100:00100000:2.0:1787096262.251282:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4bfb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088597760:0@lo:400:kworker.0 00000100:00100000:0.0:1787096262.251313:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096262.251315:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096262.251350:0:5754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088597504 00000100:00100000:2.0:1787096262.251356:0:5754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088597504 00000100:00100000:0.0:1787096262.251376:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4a4fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088597376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096262.251378:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c485b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088597888:0@lo:400:kworker.0 00000100:00100000:2.0:1787096262.251407:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787096262.251417:0:5754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3294:x1873906088597504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096262.251423:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096262.251430:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096262.251459:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088598016:0@lo:400:kworker.0 00000100:00100000:0.0:1787096262.251467:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088598144:0@lo:400:kworker.0 00000100:00100000:2.0:1787096262.251477:0:5754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483700850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3294:x1873906088597504:12345-0@lo:400:kworker.0 Request processed in 62us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096262.251484:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787096262.251496:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096262.251513:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096262.251529:0:6559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088597632 00000100:00100000:2.0:1787096262.251532:0:6559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088597632 00000100:00100000:1.0:1787096262.251536:0:6530:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088597888 00000100:00100000:1.0:1787096262.251542:0:6530:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088597888 00000100:00100000:0.0:1787096262.251589:0:5761:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088598016 00000100:00100000:1.0:1787096262.251594:0:6530:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088598144 00000100:00100000:0.0:1787096262.251594:0:5761:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088598016 00000100:00100000:2.0:1787096262.251598:0:6559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787096262.251600:0:6530:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088598144 00000100:00100000:2.0:1787096262.251611:0:6559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4a4fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088597632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096262.251635:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787096262.251646:0:6530:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4b415b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088597888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096262.251650:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787096262.251656:0:6559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4a4fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088597632:12345-0@lo:400:kworker.0 Request processed in 49us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096262.251663:0:6559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787096262.251668:0:5761:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4b415aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088598016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096262.251694:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096262.251694:0:6530:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4b415b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088597888:12345-0@lo:400:kworker.0 Request processed in 48us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096262.251711:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787096262.251724:0:5761:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4b415aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088598016:12345-0@lo:400:kworker.0 Request processed in 64us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096262.251731:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787096262.251735:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787096262.251739:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088597760 00000100:00100000:2.0:1787096262.251743:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088597760 00000100:00100000:1.0:1787096262.251744:0:6530:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4bbf46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088598144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096262.251759:0:12963:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088597376 00000100:00100000:0.0:1787096262.251763:0:12963:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088597376 00000100:00100000:2.0:1787096262.251786:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787096262.251790:0:6530:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4bbf46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1873906088598144:12345-0@lo:400:kworker.0 Request processed in 46us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096262.251801:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787096262.251802:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088597760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096262.251803:0:12963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787096262.251818:0:12963:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4a4fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088597376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787096262.251844:0:12963:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096262.251848:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088597760:12345-0@lo:400:kworker.0 Request processed in 50us (155us total) trans 0 rc 0/0 00000100:00080000:1.0:1787096262.251851:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787096262.251857:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096262.251869:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787096262.251892:0:12963:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4a4fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088597376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096262.251901:0:12963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787096262.251920:0:3293:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4bfb2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088597760:0@lo:400:kworker.0 00000100:00100000:1.0:1787096262.251925:0:3291:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088598016:0@lo:400:kworker.0 00000100:00100000:0.0:1787096262.251968:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c485b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088597888:0@lo:400:kworker.0 00010000:00080000:1.0:1787096262.251989:0:3292:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c483028380 x1873906088598144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096262.251990:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4bfb29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3620d8f4-6286-4815-a66b-86d036d7af2b:3294:1873906088597504:0@lo:400:kworker.0 00000100:00100000:1.0:1787096262.252000:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483028380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088598144:0@lo:400:kworker.0 00000100:00100000:1.0:1787096262.252017:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4bfb2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088597632:0@lo:400:kworker.0 00010000:00080000:1.0:1787096262.252026:0:3292:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c4a4fcdc00 x1873906088597376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096262.252036:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4a4fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088597376:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787096262.790618:0:23775:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 10: cannot create overly large ec mirrors ========================================================== 19:37:43 (1787096263) 00010000:00010000:3.0:1787096263.083214:0:6547:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096263.342332:0:23823:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_10 needs >= 5 OSTs 00000001:02000400:2.0:1787096263.909291:0:23871:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 11: can create --ec 2+2 ================ 19:37:44 (1787096264) 00010000:00010000:1.0:1787096264.107238:0:8266:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096264.466499:0:23919:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_11 needs >= 4 OSTs 00000001:02000400:2.0:1787096265.044767:0:23967:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12a skipping ALWAYS excluded test 12a 00010000:00010000:3.0:1787096265.131193:0:5746:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096265.571213:0:24015:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12b skipping ALWAYS excluded test 12b 00000001:02000400:0.0:1787096266.126026:0:24063:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12c: resync a file using both FLR and EC (without overstriping) ========================================================== 19:37:47 (1787096267) 00010000:00010000:3.0:1787096266.156179:0:5747:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096266.347271:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4a4fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1873906088598272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096266.347336:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096266.347384:0:6534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088598272 00000100:00100000:0.0:1787096266.347392:0:6534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088598272 00000100:00100000:0.0:1787096266.347457:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787096266.347479:0:6534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48302aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1873906088598272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096266.347515:0:6534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096266.347568:0:6534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48302aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1873906088598272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096266.347575:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787096266.347700:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096266.347751:0:3293:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4a4fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1873906088598272:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096266.634766:0:24111:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12c needs >= 8 OSTs 00010000:00010000:0.0:1787096267.180198:0:6547:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096267.187266:0:24159:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12d: resync a file using both FLR and EC (with overstriping) ========================================================== 19:37:48 (1787096268) 00000100:00100000:0.0:1787096267.332895:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1787096267.332949:0:5753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083342848 00000100:00100000:1.0:1787096267.332960:0:5753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083342848 00000100:00100000:0.0:1787096267.332989:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1787096267.333007:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 237 00000100:00100000:1.0:1787096267.333018:0:5753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2360:x1873906083342848:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1787096267.333051:0:5761:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083342976 00000100:00100000:2.0:1787096267.333057:0:5761:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083342976 00000100:00100000:1.0:1787096267.333090:0:5753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483703850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2360:x1873906083342848:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096267.333128:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 91 00000100:00080000:0.0:1787096267.333135:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096267.333140:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 237 00000100:00100000:2.0:1787096267.333154:0:5761:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4bbf45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:2360:x1873906083342976:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:2.0:1787096267.333198:0:5761:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4bbf45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:2360:x1873906083342976:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 53us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096267.333207:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 91 00000100:00100000:0.0:1787096267.371298:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c48302a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088598784:0@lo:400:kworker.0 00000100:00100000:3.0:1787096267.371309:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3620d8f4-6286-4815-a66b-86d036d7af2b:3294:1873906088598400:0@lo:400:kworker.0 00000100:00100000:1.0:1787096267.371309:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4bbf45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1873906088598528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096267.371330:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088598656:0@lo:400:kworker.0 00000100:00100000:0.0:1787096267.371391:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096267.371401:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096267.371406:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096267.371427:0:8906:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088598784 00000100:00100000:2.0:1787096267.371434:0:8906:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088598784 00000100:00100000:3.0:1787096267.371475:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088598912:0@lo:400:kworker.0 00000100:00100000:1.0:1787096267.371478:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088599040:0@lo:400:kworker.0 00000100:00100000:0.0:1787096267.371491:0:6535:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088598528 00000100:00100000:0.0:1787096267.371497:0:6535:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088598528 00000100:00100000:3.0:1787096267.371514:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096267.371521:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787096267.371529:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096267.371538:0:8906:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4bbf46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088598784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096267.371545:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787096267.371555:0:6535:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4a4fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873906088598528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096267.371559:0:6530:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088598912 00000100:00100000:3.0:1787096267.371564:0:6530:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088598912 00002000:00000024:0.0:1787096267.371586:0:6535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787096267.371592:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787096267.371600:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096267.371612:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787096267.371613:0:8906:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4bbf46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088598784:12345-0@lo:400:kworker.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096267.371626:0:6530:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088598912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096267.371627:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787096267.371640:0:6535:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4a4fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873906088598528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096267.371651:0:8906:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088599040 00000100:00100000:2.0:1787096267.371662:0:8906:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088599040 00000100:00100000:0.0:1787096267.371666:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787096267.371670:0:3293:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c48302a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088598784:0@lo:400:kworker.0 00000100:00100000:3.0:1787096267.371687:0:6530:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088598912:12345-0@lo:400:kworker.0 Request processed in 66us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096267.371695:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787096267.371709:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1787096267.371715:0:3291:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c4bbf45880 x1873906088598528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096267.371724:0:8906:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c485a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088599040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096267.371732:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088598912:0@lo:400:kworker.0 00000100:00100000:0.0:1787096267.371743:0:3291:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4bbf45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1873906088598528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096267.371752:0:5752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088598400 00000100:00100000:1.0:1787096267.371760:0:5752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088598400 00000100:00080000:3.0:1787096267.371763:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096267.371777:0:8906:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c485a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088599040:12345-0@lo:400:kworker.0 Request processed in 59us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096267.371784:0:3291:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088599040:0@lo:400:kworker.0 00000100:00100000:3.0:1787096267.371785:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096267.371790:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787096267.371805:0:5752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787096267.371814:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088599168:0@lo:400:kworker.0 00000100:00100000:2.0:1787096267.371815:0:8906:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088598656 00000100:00100000:1.0:1787096267.371820:0:5752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3294:x1873906088598400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096267.371822:0:8906:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088598656 00000100:00100000:3.0:1787096267.371843:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096267.371859:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787096267.371872:0:8906:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088598656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096267.371885:0:5752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483702450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3294:x1873906088598400:12345-0@lo:400:kworker.0 Request processed in 69us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096267.371893:0:6533:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088599168 00000100:00100000:3.0:1787096267.371894:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3620d8f4-6286-4815-a66b-86d036d7af2b:3294:1873906088598400:0@lo:400:kworker.0 00000100:00100000:1.0:1787096267.371898:0:5752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787096267.371899:0:6533:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088599168 00000100:00100000:2.0:1787096267.371921:0:8906:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088598656:12345-0@lo:400:kworker.0 Request processed in 55us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096267.371928:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787096267.371935:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787096267.371944:0:6533:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088599168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096267.371953:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088598656:0@lo:400:kworker.0 00000100:00100000:0.0:1787096267.371981:0:6533:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088599168:12345-0@lo:400:kworker.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096267.371986:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787096267.371995:0:3292:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c483029180 x1873906088599168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096267.372007:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088599168:0@lo:400:kworker.0 00000001:02000400:0.0:1787096267.667862:0:24207:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12d needs >= 8 OSTs 00000001:02000400:0.0:1787096268.184217:0:24256:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 13: parity of single stripe data is just a copy ========================================================== 19:37:49 (1787096269) 00010000:00010000:1.0:1787096268.203225:0:8266:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096268.653034:0:24304:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_13 needs >= 4 OSTs 00000001:02000400:1.0:1787096269.191089:0:24352:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 20: test that stripe size of parity mirror is set correctly ========================================================== 19:37:50 (1787096270) 00010000:00010000:2.0:1787096269.227195:0:5746:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096269.672676:0:24400:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_20 needs >= 4 OSTs 00000001:02000400:0.0:1787096270.194929:0:24448:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22: test that lfs mirror read from ec does not change eof ========================================================== 19:37:51 (1787096271) 00010000:00010000:3.0:1787096270.251191:0:5747:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096270.676626:0:24496:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22 needs >= 8 OSTs 00000001:02000400:0.0:1787096271.185574:0:24544:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28b: test that lfs mirror verify for ec does not change eof ========================================================== 19:37:52 (1787096272) 00010000:00010000:0.0:1787096271.275228:0:6547:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096271.467247:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c485a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1873906088599296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096271.467322:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096271.467421:0:12963:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088599296 00000100:00100000:1.0:1787096271.467430:0:12963:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088599296 00000100:00100000:1.0:1787096271.467493:0:12963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787096271.467504:0:12963:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4c0718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1873906088599296:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787096271.467612:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787096271.467631:0:12963:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096271.467743:0:12963:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4c0718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1873906088599296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 240us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096271.467751:0:12963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787096271.467776:0:3293:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c485a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1873906088599296:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096271.651671:0:24593:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28b needs >= 8 OSTs 00000001:02000400:2.0:1787096272.171347:0:24641:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28c: test that reading past parity data returns zeros ========================================================== 19:37:53 (1787096273) 00010000:00010000:1.0:1787096272.299254:0:8266:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096272.451843:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096272.451880:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:1.0:1787096272.451886:0:6559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083343232 00000100:00100000:1.0:1787096272.451895:0:6559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083343232 00000100:00100000:0.0:1787096272.451929:0:5753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083343104 00000100:00100000:0.0:1787096272.451937:0:5753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083343104 00000100:00080000:3.0:1787096272.451960:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096272.451969:0:6559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 95 00000100:00100000:0.0:1787096272.451982:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 239 00000100:00100000:1.0:1787096272.451987:0:6559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48302a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:2361:x1873906083343232:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1787096272.451998:0:5753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2360:x1873906083343104:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1787096272.452075:0:6559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48302a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:2361:x1873906083343232:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096272.452076:0:5753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483703050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2360:x1873906083343104:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096272.452087:0:6559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 95 00000100:00100000:0.0:1787096272.452091:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 239 00000100:00100000:3.0:1787096272.491290:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4bbf45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088599424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096272.491290:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088599808:0@lo:400:kworker.0 00000100:00100000:0.0:1787096272.491290:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c48302ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3620d8f4-6286-4815-a66b-86d036d7af2b:3291:1873906088599552:0@lo:400:kworker.0 00000100:00100000:2.0:1787096272.491332:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c48302b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088599680:0@lo:400:kworker.0 00000100:00100000:3.0:1787096272.491393:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096272.491393:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096272.491393:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096272.491436:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096272.491456:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c48302bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088599936:0@lo:400:kworker.0 00000100:00100000:2.0:1787096272.491468:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c48302b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088600192:0@lo:400:kworker.0 00000100:00100000:0.0:1787096272.491472:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c48302b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088600064:0@lo:400:kworker.0 00000100:00100000:1.0:1787096272.491481:0:5752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088599552 00000100:00100000:3.0:1787096272.491489:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096272.491489:0:5752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088599552 00000100:00100000:2.0:1787096272.491525:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096272.491525:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096272.491534:0:6535:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088599424 00000100:00100000:1.0:1787096272.491538:0:5752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787096272.491539:0:6535:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088599424 00000100:00100000:1.0:1787096272.491550:0:5752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3291:x1873906088599552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096272.491581:0:5761:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088599808 00000100:00100000:2.0:1787096272.491584:0:8906:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088599680 00000100:00100000:0.0:1787096272.491587:0:5761:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088599808 00000100:00100000:2.0:1787096272.491591:0:8906:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088599680 00000100:00100000:3.0:1787096272.491592:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787096272.491604:0:6535:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088599424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096272.491623:0:5752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483703450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3291:x1873906088599552:12345-0@lo:400:kworker.0 Request processed in 74us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096272.491631:0:5752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787096272.491631:0:5761:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088600064 00002000:00000024:3.0:1787096272.491636:0:6535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096272.491637:0:5761:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088600064 00000100:00100000:2.0:1787096272.491648:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787096272.491664:0:8906:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4c0718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088599808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096272.491670:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787096272.491680:0:5761:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088599680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096272.491685:0:6535:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088599424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096272.491685:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787096272.491695:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787096272.491696:0:5760:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4bbf45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088600064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096272.491720:0:6532:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088599936 00000100:00100000:3.0:1787096272.491725:0:6532:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088599936 00000100:00100000:2.0:1787096272.491727:0:8906:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4c0718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088599808:12345-0@lo:400:kworker.0 Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096272.491745:0:5761:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088599680:12345-0@lo:400:kworker.0 Request processed in 69us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096272.491754:0:6532:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088600192 00000100:00100000:1.0:1787096272.491754:0:5760:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4bbf45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088600064:12345-0@lo:400:kworker.0 Request processed in 58us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096272.491756:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787096272.491759:0:6532:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088600192 00000100:00100000:2.0:1787096272.491770:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787096272.491777:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787096272.491791:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787096272.491798:0:6532:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088599936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096272.491825:0:3291:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c48302b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088600064:0@lo:400:kworker.0 00000100:00100000:1.0:1787096272.491827:0:3293:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088599808:0@lo:400:kworker.0 00000100:00100000:2.0:1787096272.491835:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c48302b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088599680:0@lo:400:kworker.0 00000100:00100000:3.0:1787096272.491840:0:6532:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088599936:12345-0@lo:400:kworker.0 Request processed in 41us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096272.491843:0:3291:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c48302ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3620d8f4-6286-4815-a66b-86d036d7af2b:3291:1873906088599552:0@lo:400:kworker.0 00000100:00100000:3.0:1787096272.491864:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787096272.491883:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787096272.491890:0:6532:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088600192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787096272.491910:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787096272.491918:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096272.491937:0:6532:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483029180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088600192:12345-0@lo:400:kworker.0 Request processed in 47us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096272.491945:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1787096272.491958:0:3294:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c4bbf45880 x1873906088599424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096272.491978:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4bbf45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088599424:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787096272.491982:0:3292:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c48302b800 x1873906088600192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096272.491992:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c48302b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088600192:0@lo:400:kworker.0 00000100:00100000:2.0:1787096272.491999:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c48302bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088599936:0@lo:400:kworker.0 00000001:02000400:1.0:1787096272.654306:0:24689:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28c needs >= 8 OSTs 00000001:02000400:0.0:1787096273.187730:0:24737:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31b: test that size of parity mirror is 1*2*1M ========================================================== 19:37:54 (1787096274) 00010000:00010000:2.0:1787096273.323241:0:5746:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096273.693741:0:24785:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31b needs >= 8 OSTs 00000001:02000400:3.0:1787096274.275637:0:24833:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31c: test that size of parity mirror is 1*2*64k ========================================================== 19:37:55 (1787096275) 00010000:00010000:3.0:1787096274.347208:0:5747:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096274.751625:0:24881:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31c needs >= 8 OSTs 00000001:02000400:2.0:1787096275.295949:0:24930:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31d: test that size of parity mirror is 1*2*64k ========================================================== 19:37:56 (1787096276) 00010000:00010000:0.0:1787096275.371205:0:6547:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096275.793241:0:24978:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31d needs >= 8 OSTs 00000001:02000400:2.0:1787096276.318483:0:25026:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 30d: test that size of parity mirror is 22*64k ========================================================== 19:37:57 (1787096277) 00010000:00010000:1.0:1787096276.395239:0:8266:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096276.587468:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4c0719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1873906088600320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096276.587562:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096276.587894:0:12963:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088600320 00000100:00100000:2.0:1787096276.587906:0:12963:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088600320 00000100:00080000:3.0:1787096276.587976:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096276.588088:0:12963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787096276.588129:0:12963:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c485a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1873906088600320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096276.588175:0:12963:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096276.588263:0:12963:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c485a76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1873906088600320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096276.588289:0:12963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787096276.588565:0:3293:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4c0719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1873906088600320:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787096276.814286:0:25074:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_30d needs >= 8 OSTs 00000001:02000400:2.0:1787096277.349481:0:25122:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21a: migrate plain file to EC layout === 19:37:58 (1787096278) 00010000:00010000:2.0:1787096277.419246:0:5746:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096277.572474:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:3.0:1787096277.572519:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1787096277.572534:0:5753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083343360 00000100:00100000:0.0:1787096277.572544:0:5753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083343360 00000100:00100000:1.0:1787096277.572591:0:5761:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083343488 00000100:00100000:0.0:1787096277.572597:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 241 00000100:00100000:1.0:1787096277.572598:0:5761:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083343488 00000100:00100000:0.0:1787096277.572607:0:5753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2363:x1873906083343360:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:1.0:1787096277.572663:0:5761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 99 00000100:00080000:3.0:1787096277.572668:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096277.572677:0:5761:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:2363:x1873906083343488:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1787096277.572685:0:5753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483702c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2363:x1873906083343360:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096277.572695:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 241 00000100:00100000:1.0:1787096277.572729:0:5761:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:2363:x1873906083343488:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 54us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096277.572739:0:5761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 99 00000100:00100000:0.0:1787096277.611352:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c48302b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088600704:0@lo:400:kworker.0 00000100:00100000:3.0:1787096277.611356:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c48302bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3620d8f4-6286-4815-a66b-86d036d7af2b:3294:1873906088600448:0@lo:400:kworker.0 00000100:00100000:1.0:1787096277.611382:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4bbf44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1873906088600576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096277.611397:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088600832:0@lo:400:kworker.0 00000100:00100000:0.0:1787096277.611453:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096277.611454:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096277.611457:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096277.611499:0:5754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088600448 00000100:00100000:2.0:1787096277.611513:0:5754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088600448 00000100:00100000:3.0:1787096277.611514:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088600960:0@lo:400:kworker.0 00000100:00100000:1.0:1787096277.611516:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088601088:0@lo:400:kworker.0 00000100:00100000:0.0:1787096277.611525:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088601216:0@lo:400:kworker.0 00000100:00100000:3.0:1787096277.611573:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096277.611585:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096277.611587:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787096277.611602:0:5754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3294:x1873906088600448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096277.611603:0:6559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088600704 00000100:00100000:0.0:1787096277.611609:0:6559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088600704 00000100:00100000:3.0:1787096277.611630:0:6530:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088600960 00000100:00100000:3.0:1787096277.611646:0:6530:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088600960 00000100:00100000:1.0:1787096277.611650:0:5760:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088601088 00000100:00100000:1.0:1787096277.611657:0:5760:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088601088 00000100:00100000:0.0:1787096277.611670:0:6559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787096277.611672:0:5754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483703c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3294:x1873906088600448:12345-0@lo:400:kworker.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096277.611683:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787096277.611695:0:6559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4bbf45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088600704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096277.611696:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787096277.611709:0:6530:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088600960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096277.611718:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787096277.611730:0:5760:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4c1564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088601088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096277.611739:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096277.611755:0:6530:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088600960:12345-0@lo:400:kworker.0 Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096277.611761:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787096277.611784:0:6559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4bbf45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088600704:12345-0@lo:400:kworker.0 Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096277.611792:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096277.611799:0:5760:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4c1564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088601088:12345-0@lo:400:kworker.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096277.611800:0:6559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787096277.611814:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787096277.611820:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c48302bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3620d8f4-6286-4815-a66b-86d036d7af2b:3294:1873906088600448:0@lo:400:kworker.0 00000100:00100000:3.0:1787096277.611829:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c48302b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088600704:0@lo:400:kworker.0 00000100:00100000:0.0:1787096277.611836:0:6559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088600832 00000100:00100000:0.0:1787096277.611843:0:6559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088600832 00000100:00100000:2.0:1787096277.611846:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088600960:0@lo:400:kworker.0 00000100:00100000:1.0:1787096277.611859:0:6533:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088601216 00000100:00100000:1.0:1787096277.611865:0:6533:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088601216 00000100:00100000:0.0:1787096277.611891:0:6559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787096277.611904:0:6559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48302a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088600832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096277.611919:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787096277.611931:0:6533:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088601216:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787096277.611937:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787096277.611945:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096277.611951:0:6534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088600576 00000100:00100000:0.0:1787096277.611952:0:6559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48302a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088600832:12345-0@lo:400:kworker.0 Request processed in 50us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096277.611956:0:6534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088600576 00000100:00100000:0.0:1787096277.611973:0:6559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787096277.611977:0:3293:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483029880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088600832:0@lo:400:kworker.0 00000100:00100000:1.0:1787096277.611993:0:6533:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1873906088601216:12345-0@lo:400:kworker.0 Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096277.611997:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787096277.612011:0:6534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4c1567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1873906088600576:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096277.612011:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787096277.612033:0:3291:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088601088:0@lo:400:kworker.0 00010000:00080000:2.0:1787096277.612038:0:3292:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c483029500 x1873906088601216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1787096277.612052:0:6534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096277.612052:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483029500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088601216:0@lo:400:kworker.0 00000100:00100000:3.0:1787096277.612123:0:6534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4c1567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1873906088600576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096277.612129:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787096277.612143:0:3291:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c4bbf44000 x1873906088600576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096277.612158:0:3291:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4bbf44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1873906088600576:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787096277.867186:0:25170:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21a needs >= 3 OSTs 00010000:00010000:3.0:1787096278.443203:0:5747:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096278.474734:0:25218:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21b: migrate EC file to plain layout === 19:37:59 (1787096279) 00000001:02000400:3.0:1787096278.967918:0:25266:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21b needs >= 3 OSTs 00010000:00010000:0.0:1787096279.467226:0:6547:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096279.500386:0:25314:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21c: migrate between different EC configurations ========================================================== 19:38:00 (1787096280) 00000001:02000400:2.0:1787096279.977391:0:25362:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21c needs >= 4 OSTs 00010000:00010000:1.0:1787096280.491235:0:8266:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096280.521551:0:25410:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21d: migrate PFL file to EC layout ===== 19:38:01 (1787096281) 00000001:02000400:1.0:1787096280.996556:0:25458:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21d needs >= 3 OSTs 00010000:00010000:2.0:1787096281.515242:0:5746:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096281.567388:0:25506:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22a: mirror split removes plain mirror, keeps EC ========================================================== 19:38:02 (1787096282) 00000100:00100000:1.0:1787096281.707396:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4c1565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1873906088601344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096281.707497:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096281.707640:0:6535:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088601344 00000100:00100000:1.0:1787096281.707649:0:6535:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088601344 00000100:00100000:1.0:1787096281.707741:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787096281.707757:0:6535:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4c1565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1873906088601344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787096281.707807:0:6535:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096281.707896:0:6535:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4c1565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1873906088601344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096281.707907:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787096281.708072:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096281.708229:0:3293:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4c1565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1873906088601344:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096282.065697:0:25554:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22a needs >= 6 OSTs 00010000:00010000:3.0:1787096282.540222:0:5747:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096282.620771:0:25603:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 23a: truncate EC file to smaller size == 19:38:03 (1787096283) 00000100:00100000:1.0:1787096282.680993:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096282.681040:0:5760:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083343616 00000100:00100000:2.0:1787096282.681054:0:5760:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083343616 00000100:00080000:1.0:1787096282.681112:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096282.681162:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 137 00000100:00100000:2.0:1787096282.681175:0:5760:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4c1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+5:34209:x1873906083343616:12345-192.168.204.35@tcp:101:mkdir.0 00010000:00010000:2.0:1787096282.681191:0:5760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096282.681209:0:5760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9e00/0xf4d1a9ae0b4f30b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6bbf6a0cc6be5ef6 expref: -99 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.681261:0:5760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8e00/0xf4d1a9ae0b4f30be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.681272:0:5760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8e00/0xf4d1a9ae0b4f30be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.681281:0:5760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8e00/0xf4d1a9ae0b4f30be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096282.681438:0:5760:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787096282.681441:0:5760:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787096282.681505:0:5760:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8e00/0xf4d1a9ae0b4f30be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.681526:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9e00/0xf4d1a9ae0b4f30b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5ef6 expref: 7 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.681537:0:5760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8e00/0xf4d1a9ae0b4f30be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5ef6 expref: 6 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.681543:0:5760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91c482be2500) 00010000:00010000:2.0:1787096282.681546:0:5760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096282.681548:0:5760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91c489ef8e00, rc 0) 00000100:00100000:2.0:1787096282.681601:0:5760:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4c1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+6:34209:x1873906083343616:12345-192.168.204.35@tcp:101:mkdir.0 Request processed in 431us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096282.681606:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 137 00000100:00100000:3.0:1787096282.682810:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096282.682851:0:8906:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083343744 00000100:00100000:2.0:1787096282.682858:0:8906:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083343744 00000100:00100000:2.0:1787096282.682899:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:2.0:1787096282.682911:0:8906:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+6:2360:x1873906083343744:12345-192.168.204.35@tcp:41:mkdir.0 00000004:00000024:2.0:1787096282.682941:0:8906:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787096282.682987:0:8906:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+6:2360:x1873906083343744:12345-192.168.204.35@tcp:41:mkdir.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096282.682993:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 138 00000100:00100000:1.0:1787096282.683132:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1787096282.683200:0:6559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083344000 00000100:00100000:0.0:1787096282.683206:0:6559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083344000 00000100:00100000:0.0:1787096282.683233:0:6559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 139 00000100:00100000:0.0:1787096282.683240:0:6559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4b4192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+6:34209:x1873906083344000:12345-192.168.204.35@tcp:36:mkdir.0 00010000:00010000:0.0:1787096282.683268:0:6559:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096282.683280:0:6559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8e00/0xf4d1a9ae0b4f30be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5ef6 expref: 6 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.683289:0:6559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91c482be2500) 00010000:00010000:0.0:1787096282.683295:0:6559:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096282.683427:0:6559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.683435:0:6559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.683440:0:6559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.683453:0:6559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.683458:0:6559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.683462:0:6559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096282.684172:0:6559:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x12:0x0]: returning size 512 00010000:00010000:0.0:1787096282.684180:0:6559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684185:0:6559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684189:0:6559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684193:0:6559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c4837a7000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1787096282.684196:0:6559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684201:0:6559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684207:0:6559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91c483b73100) 00010000:00010000:0.0:1787096282.684209:0:6559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096282.684212:0:6559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684223:0:6559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f30c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096282.684233:0:6559:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000241c2a54 reply state 000000007b967d05 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096282.684239:0:6559:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787096282.684278:0:6559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4b4192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+7:34209:x1873906083344000:12345-192.168.204.35@tcp:36:mkdir.0 Request processed in 1039us (1148us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787096282.684283:0:6559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 139 00010000:00010000:0.0:1787096282.684951:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684958:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684963:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684966:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c4837a7400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1787096282.684968:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684973:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684979:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff91c483b73000) 00010000:00010000:0.0:1787096282.684981:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096282.684983:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.684996:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30cc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096282.691880:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1787096282.691949:0:5753:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083344128 00000100:00100000:0.0:1787096282.691955:0:5753:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083344128 00000100:00100000:0.0:1787096282.691988:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 243 00000100:00100000:0.0:1787096282.691995:0:5753:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4836e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2361:x1873906083344128:12345-192.168.204.35@tcp:400:kworker.0 00000100:00100000:0.0:1787096282.692032:0:5753:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4836e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:798d21dd-514b-4f09-968a-bf40d03220f0+9:2361:x1873906083344128:12345-192.168.204.35@tcp:400:kworker.0 Request processed in 39us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.692037:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 243 00000100:00100000:3.0:1787096282.697889:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096282.697968:0:5760:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083344256 00000100:00100000:2.0:1787096282.697974:0:5760:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083344256 00000100:00100000:2.0:1787096282.698014:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 140 00000100:00100000:2.0:1787096282.698021:0:5760:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+6:34215:x1873906083344256:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1787096282.698035:0:5760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096282.698048:0:5760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9e00/0xf4d1a9ae0b4f30d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6bbf6a0cc6be5efd expref: -99 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.698090:0:5760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8200/0xf4d1a9ae0b4f30da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.698129:0:5760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8200/0xf4d1a9ae0b4f30da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.698142:0:5760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8200/0xf4d1a9ae0b4f30da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096282.698201:0:5760:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787096282.698214:0:5760:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787096282.698235:0:5760:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8200/0xf4d1a9ae0b4f30da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.698253:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9e00/0xf4d1a9ae0b4f30d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5efd expref: 8 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.698264:0:5760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8200/0xf4d1a9ae0b4f30da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5efd expref: 7 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.698270:0:5760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91c482be2000) 00010000:00010000:2.0:1787096282.698272:0:5760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096282.698274:0:5760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91c489ef8200, rc 0) 00000100:00100000:2.0:1787096282.698305:0:5760:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+7:34215:x1873906083344256:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 286us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096282.698310:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 140 00000100:00100000:3.0:1787096282.699681:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096282.699749:0:8906:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083344384 00000100:00100000:2.0:1787096282.699754:0:8906:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083344384 00000100:00100000:2.0:1787096282.699787:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:2.0:1787096282.699795:0:8906:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+7:34215:x1873906083344384:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1787096282.699802:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096282.699809:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8e00/0xf4d1a9ae0b4f30e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6bbf6a0cc6be5f04 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.699836:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.699844:0:8906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.699859:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.699868:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.699873:0:8906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.699877:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.699979:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8600/0xf4d1a9ae0b4f30f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.699985:0:8906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8600/0xf4d1a9ae0b4f30f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.699990:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8600/0xf4d1a9ae0b4f30f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096282.700006:0:8906:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x12:0x0]: returning size 512 00000004:00200000:2.0:1787096282.700008:0:8906:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787096282.700017:0:8906:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8600/0xf4d1a9ae0b4f30f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700024:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700029:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700041:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700045:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c489ef8400 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1787096282.700048:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700052:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700059:0:8906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91c482be2000) 00010000:00010000:2.0:1787096282.700061:0:8906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096282.700064:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700068:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8400/0xf4d1a9ae0b4f30e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700075:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700079:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700083:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700086:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c489ef9800 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1787096282.700088:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700129:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700140:0:8906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff91c482be2700) 00010000:00010000:2.0:1787096282.700143:0:8906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096282.700161:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700170:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9800/0xf4d1a9ae0b4f30ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700208:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8e00/0xf4d1a9ae0b4f30e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f04 expref: 9 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700218:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8600/0xf4d1a9ae0b4f30f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f04 expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.700223:0:8906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff91c482be2c00) 00010000:00010000:2.0:1787096282.700225:0:8906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787096282.700226:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91c489ef8600, rc 0) 00000100:00100000:2.0:1787096282.700254:0:8906:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+8:34215:x1873906083344384:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 461us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096282.700259:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 141 00000100:00100000:1.0:1787096282.700960:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:0.0:1787096282.701026:0:6559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083344512 00000100:00100000:0.0:1787096282.701031:0:6559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083344512 00000100:00100000:0.0:1787096282.701060:0:6559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:0.0:1787096282.701066:0:6559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4b4191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+8:34215:x1873906083344512:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:0.0:1787096282.701074:0:6559:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096282.701082:0:6559:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6bbf6a0cc6be5f0b expref: -99 pid: 6559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701132:0:6559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701141:0:6559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701161:0:6559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701187:0:6559:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701199:0:6559:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701204:0:6559:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701231:0:6559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701236:0:6559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701240:0:6559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701243:0:6559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c4837a7000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1787096282.701245:0:6559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701249:0:6559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701254:0:6559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff91c482be2c00) 00010000:00010000:0.0:1787096282.701256:0:6559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096282.701258:0:6559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701262:0:6559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7000/0xf4d1a9ae0b4f3104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701269:0:6559:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701277:0:6559:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701281:0:6559:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701284:0:6559:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c4837a6600 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:0.0:1787096282.701286:0:6559:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701289:0:6559:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701294:0:6559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x7b711ae6 (ffff91c483b73000) 00010000:00010000:0.0:1787096282.701295:0:6559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096282.701297:0:6559:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701300:0:6559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a6600/0xf4d1a9ae0b4f310b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6559 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701318:0:6559:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30fd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f0b expref: 9 pid: 6559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701324:0:6559:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff91c482be2c00) 00010000:00010000:0.0:1787096282.701325:0:6559:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096282.701327:0:6559:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c4837a7400/0xf4d1a9ae0b4f30fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f0b expref: 9 pid: 6559 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096282.701340:0:6559:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91c4837a7400, rc 0) 00000100:00100000:0.0:1787096282.701366:0:6559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4b4191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+8:34215:x1873906083344512:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 301us (408us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096282.701372:0:6559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 142 00000100:00100000:3.0:1787096282.702213:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096282.702248:0:5760:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083344768 00000100:00100000:2.0:1787096282.702255:0:5760:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083344768 00000100:00100000:2.0:1787096282.702293:0:5760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 143 00000100:00100000:2.0:1787096282.702305:0:5760:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+8:34215:x1873906083344768:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1787096282.702313:0:5760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096282.702325:0:5760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9600/0xf4d1a9ae0b4f3112 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6bbf6a0cc6be5f12 expref: -99 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702376:0:5760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702384:0:5760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702389:0:5760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702397:0:5760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702402:0:5760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702406:0:5760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702802:0:5760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702809:0:5760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702814:0:5760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096282.702819:0:5760:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 0 00010000:00010000:2.0:1787096282.702834:0:5760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702847:0:5760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702851:0:5760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702854:0:5760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c489ef8000 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1787096282.702856:0:5760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702860:0:5760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702866:0:5760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff91c482be2c00) 00010000:00010000:2.0:1787096282.702868:0:5760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096282.702870:0:5760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702874:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8000/0xf4d1a9ae0b4f3119 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096282.702881:0:5760:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000059f57abc reply state 00000000ac76d894 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096282.702886:0:5760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787096282.702904:0:5760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9600/0xf4d1a9ae0b4f3112 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f12 expref: 11 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702912:0:5760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f12 expref: 10 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.702925:0:5760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff91c482be2a00) 00010000:00010000:2.0:1787096282.702926:0:5760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096282.702928:0:5760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91c489ef9c00, rc 0) 00000100:00100000:2.0:1787096282.702959:0:5760:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+11:34215:x1873906083344768:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 659us (747us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787096282.702964:0:5760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 143 00010000:00010000:2.0:1787096282.703715:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.703723:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.703728:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.703731:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c489ef9a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:2.0:1787096282.703733:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.703738:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.703745:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x7b711ae6 (ffff91c482be2b00) 00010000:00010000:2.0:1787096282.703747:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096282.703749:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.703753:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9a00/0xf4d1a9ae0b4f3120 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096282.704222:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096282.704253:0:8906:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083345024 00000100:00100000:2.0:1787096282.704258:0:8906:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083345024 00000100:00100000:2.0:1787096282.704296:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 144 00000100:00100000:2.0:1787096282.704308:0:8906:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+10:34215:x1873906083345024:12345-192.168.204.35@tcp:101:lfs.0 00010000:00010000:2.0:1787096282.704322:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096282.704331:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9e00/0xf4d1a9ae0b4f3135 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6bbf6a0cc6be5f19 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.704371:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.704380:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f12 expref: 11 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.704386:0:8906:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.704408:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f12 expref: 11 pid: 5760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.704418:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f12 expref: 11 pid: 5760 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096282.704429:0:8906:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c483029500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8906:1873906088601472:192.168.204.35@tcp:104: 00000100:00100000:2.0:1787096282.704496:0:8906:0:(client.c:2692:ptlrpc_set_wait()) set ffff91c4836b9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787096282.705211:0:8906:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c483029500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8906:1873906088601472:192.168.204.35@tcp:104: 00010000:00010000:2.0:1787096282.705230:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096282.705426:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096282.705454:0:6548:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083345152 00000100:00100000:2.0:1787096282.705458:0:6548:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083345152 00010000:00010000:2.0:1787096282.705477:0:6548:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f12 expref: 12 pid: 5760 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096282.705500:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 43 00000100:00100000:2.0:1787096282.705508:0:6548:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+12:2360:x1873906083345152:12345-192.168.204.35@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096282.705515:0:6548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096282.705520:0:6548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f12 expref: 12 pid: 5760 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.705528:0:6548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f12 expref: 12 pid: 5760 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.705537:0:6548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9c00/0xf4d1a9ae0b4f3127 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f12 expref: 12 pid: 5760 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.705545:0:6548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff91c482be2a00) 00010000:00010000:2.0:1787096282.705548:0:6548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.705553:0:6548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.705557:0:6548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096282.705573:0:6548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096282.705589:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705597:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096282.705604:0:6548:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+11:2360:x1873906083345152:12345-192.168.204.35@tcp:103:ldlm_bl.0 Request processed in 96us (177us total) trans 0 rc 0/0 00000004:00200000:3.0:1787096282.705610:0:8906:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 0 00000100:00100000:2.0:1787096282.705614:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 43 00010000:00010000:3.0:1787096282.705780:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705787:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705797:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705801:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91c489ef8a00 already unused, calling callback (ffffffffc21074f0) 00010000:00010000:3.0:1787096282.705803:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705807:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705814:0:8906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff91c482be2a00) 00010000:00010000:3.0:1787096282.705816:0:8906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787096282.705818:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705823:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef8a00/0xf4d1a9ae0b4f313c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8906 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705844:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9e00/0xf4d1a9ae0b4f3135 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f19 expref: 10 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705850:0:8906:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff91c482be2c00) 00010000:00010000:3.0:1787096282.705852:0:8906:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096282.705854:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91c489ef9e00/0xf4d1a9ae0b4f3135 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.35@tcp remote: 0x6bbf6a0cc6be5f19 expref: 10 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096282.705861:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91c489ef9e00, rc 0) 00000100:00100000:3.0:1787096282.705890:0:8906:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+9:34215:x1873906083345024:12345-192.168.204.35@tcp:101:lfs.0 Request processed in 1587us (1670us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096282.705904:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 144 00000100:00100000:3.0:1787096282.706794:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.35@tcp (source: 12345-192.168.204.35@tcp) 00000100:00100000:2.0:1787096282.706863:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906083345408 00000100:00100000:2.0:1787096282.706868:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906083345408 00000100:00100000:2.0:1787096282.706900:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1787096282.706908:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c48695e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+9:34215:x1873906083345408:12345-192.168.204.35@tcp:35:lfs.0 00000100:00100000:2.0:1787096282.707023:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c48695e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cadda869-f2bb-4d4a-b8ce-3a0ea9a44916+10:34215:x1873906083345408:12345-192.168.204.35@tcp:35:lfs.0 Request processed in 116us (230us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1787096282.707029:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.35@tcp, seq: 21 00000100:00100000:2.0:1787096282.731239:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4bbf44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088601600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096282.731243:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4b4193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088601856:0@lo:400:kworker.0 00000100:00100000:3.0:1787096282.731270:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4b4191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3620d8f4-6286-4815-a66b-86d036d7af2b:3291:1873906088601728:0@lo:400:kworker.0 00000100:00100000:1.0:1787096282.731318:0:3293:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4b4191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088601984:0@lo:400:kworker.0 00000100:00100000:2.0:1787096282.731321:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096282.731321:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096282.731328:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096282.731399:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096282.731401:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4b4192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088602112:0@lo:400:kworker.0 00000100:00100000:3.0:1787096282.731402:0:3291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4b4191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088602240:0@lo:400:kworker.0 00000100:00100000:0.0:1787096282.731406:0:3292:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91c4c0a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088602368:0@lo:400:kworker.0 00000100:00100000:1.0:1787096282.731459:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088601856 00000100:00100000:3.0:1787096282.731462:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096282.731462:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096282.731467:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088601856 00000100:00100000:0.0:1787096282.731467:0:6559:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088601984 00000100:00100000:0.0:1787096282.731474:0:6559:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088601984 00000100:00100000:3.0:1787096282.731519:0:5752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088601728 00000100:00100000:2.0:1787096282.731520:0:6530:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088602112 00000100:00100000:1.0:1787096282.731522:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088602240 00000100:00100000:3.0:1787096282.731524:0:5752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088601728 00000100:00100000:2.0:1787096282.731526:0:6530:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088602112 00000100:00100000:1.0:1787096282.731528:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088602240 00000100:00100000:0.0:1787096282.731532:0:6559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787096282.731545:0:6559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4bbf46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088601856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096282.731565:0:5752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787096282.731573:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787096282.731587:0:5752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4836e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3291:x1873906088601728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096282.731592:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787096282.731593:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4c0a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088601984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096282.731595:0:6559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4bbf46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1873906088601856:12345-0@lo:400:kworker.0 Request processed in 53us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096282.731609:0:6530:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088602112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096282.731610:0:6559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787096282.731634:0:6559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787096282.731642:0:6559:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4c0608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088602240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096282.731648:0:5752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4836e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3620d8f4-6286-4815-a66b-86d036d7af2b+18:3291:x1873906088601728:12345-0@lo:400:kworker.0 Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096282.731654:0:5752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787096282.731668:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4c0a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1873906088601984:12345-0@lo:400:kworker.0 Request processed in 84us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096282.731678:0:6530:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483029880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088602112:12345-0@lo:400:kworker.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096282.731685:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787096282.731686:0:6559:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4c0608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1873906088602240:12345-0@lo:400:kworker.0 Request processed in 45us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096282.731689:0:6534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088601600 00000100:00100000:2.0:1787096282.731691:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787096282.731694:0:6534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088601600 00000100:00100000:0.0:1787096282.731702:0:6559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1787096282.731722:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787096282.731729:0:5755:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096282.731733:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787096282.731736:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096282.731745:0:6534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c483029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906088601600:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096282.731760:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4b4192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088602112:0@lo:400:kworker.0 00000100:00100000:0.0:1787096282.731770:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4b4193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1873906088601856:0@lo:400:kworker.0 00002000:00000024:3.0:1787096282.731771:0:6534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096282.731780:0:3293:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4b4191f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1873906088601984:0@lo:400:kworker.0 00000100:00100000:0.0:1787096282.731805:0:6532:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906088602368 00000100:00100000:0.0:1787096282.731808:0:6532:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906088602368 00000100:00100000:3.0:1787096282.731817:0:6534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c483029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1873906088601600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096282.731823:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787096282.731832:0:3294:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c4bbf44000 x1873906088601600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096282.731849:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4bbf44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1873906088601600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096282.731856:0:3291:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4b4191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1873906088602240:0@lo:400:kworker.0 00000100:00100000:0.0:1787096282.731856:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787096282.731876:0:6532:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff91c4bbf46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088602368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096282.731880:0:3291:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4b4191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3620d8f4-6286-4815-a66b-86d036d7af2b:3291:1873906088601728:0@lo:400:kworker.0 00000100:00100000:0.0:1787096282.731924:0:6532:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff91c4bbf46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1873906088602368:12345-0@lo:400:kworker.0 Request processed in 53us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096282.731929:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1787096282.731951:0:3292:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91c4c0a44000 x1873906088602368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096282.731959:0:3292:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff91c4c0a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1873906088602368:0@lo:400:kworker.0 00000001:02000400:3.0:1787096283.181645:0:25651:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_23a: @@@@@@ FAIL: setstripe failed 00010000:00010000:1.0:1787096283.563245:0:6547:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 952 lines, 952 kept, 0 dropped, 0 bad.