00010000:00010000:1.0F:1787096529.458105:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1787096529.713707:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353890560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096529.713788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1787096529.713835:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353890560 00000100:00100000:2.0:1787096529.713851:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353890560 00000100:00080000:3.0:1787096529.713895:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096529.713922:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787096529.713932:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2b44ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353890560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096529.714003:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096529.714076:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2b44ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353890560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096529.714086:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787096529.714105:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353890560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096529.952013:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096529.952063:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345487104 00000100:00100000:3.0:1787096529.952072:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345487104 00000100:00100000:3.0:1787096529.952130:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 134 00000100:00100000:3.0:1787096529.952141:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+5:28456:x1873906345487104:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:3.0:1787096529.952164:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096529.952186:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebe00/0xdf123ee4d6337d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8441 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.952247:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eba00/0xdf123ee4d6337d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.952260:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eba00/0xdf123ee4d6337d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.952274:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eba00/0xdf123ee4d6337d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096529.952454:0:5765:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787096529.952458:0:5765:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787096529.952582:0:5765:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eba00/0xdf123ee4d6337d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.952623:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebe00/0xdf123ee4d6337d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8441 expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.952640:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eba00/0xdf123ee4d6337d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8441 expref: 6 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.952658:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25200) 00010000:00010000:3.0:1787096529.952662:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096529.952666:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2a23eba00, rc 0) 00000100:00100000:3.0:1787096529.952725:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:28456:x1873906345487104:12345-192.168.203.45@tcp:101:rm.0 Request processed in 585us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096529.952732:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 134 00000100:00100000:2.0:1787096529.953815:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096529.953854:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345487232 00000100:00100000:1.0:1787096529.953860:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345487232 00000100:00100000:1.0:1787096529.953902:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:1.0:1787096529.953920:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+6:28456:x1873906345487232:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:1.0:1787096529.953932:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096529.953943:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d6337de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8448 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.953982:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.953992:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954002:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954017:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954024:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954032:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954356:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6337f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954369:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6337f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954374:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6337f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096529.954409:0:5764:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x11:0x0]: returning size 0 00000004:00200000:1.0:1787096529.954413:0:5764:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787096529.954427:0:5764:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6337f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954437:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6337f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954446:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954453:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954459:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954465:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372b200 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096529.954469:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954476:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954486:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25200) 00010000:00010000:1.0:1787096529.954489:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096529.954528:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954536:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b200/0xdf123ee4d6337e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954548:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954555:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954561:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954565:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372a600 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096529.954567:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954571:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954576:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff9db2a2946a00) 00010000:00010000:1.0:1787096529.954577:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096529.954579:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954582:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6337ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954604:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d6337de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8448 expref: 8 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954650:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6337f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8448 expref: 7 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.954662:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff9db2a2946300) 00010000:00010000:1.0:1787096529.954665:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096529.954667:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db28372bc00, rc 0) 00000100:00100000:1.0:1787096529.954717:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+7:28456:x1873906345487232:12345-192.168.203.45@tcp:101:rm.0 Request processed in 807us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096529.954725:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 135 00000100:00100000:3.0:1787096529.956902:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096529.956937:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345487488 00000100:00100000:1.0:1787096529.956945:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345487488 00000100:00100000:1.0:1787096529.956990:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 136 00000100:00100000:1.0:1787096529.957001:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2b44ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+7:28456:x1873906345487488:12345-192.168.203.45@tcp:36:rm.0 00010000:00010000:1.0:1787096529.957043:0:7424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787096529.957066:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6337f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8448 expref: 7 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957082:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff9db2a2946300) 00010000:00010000:1.0:1787096529.957098:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eba00/0xdf123ee4d6337d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8441 expref: 6 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957108:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25200) 00010000:00010000:1.0:1787096529.957114:0:7424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096529.957145:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957168:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957178:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957191:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957198:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957205:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957552:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957559:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.957563:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958247:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958255:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958260:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958272:0:7424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958276:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958279:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958299:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787096529.958317:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.958319:0:5753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096529.958326:0:5753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958327:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.958343:0:5753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372b000 already unused, calling callback (ffffffffc16156f0) 00010000:00010000:1.0:1787096529.958343:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.958348:0:5753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958354:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372ac00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096529.958358:0:5753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958359:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958364:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958376:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff9db2a2946200) 00010000:00010000:1.0:1787096529.958379:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096529.958382:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.958387:0:5753:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff9db2a2946200) 00010000:00010000:3.0:1787096529.958394:0:5753:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787096529.958400:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633808 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.958401:0:5753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.958413:0:5753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b000/0xdf123ee4d63380f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958419:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958424:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958428:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958431:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372a200 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096529.958432:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096529.958433:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.958435:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096529.958440:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096529.958440:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958447:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946100) 00010000:00010000:1.0:1787096529.958449:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096529.958451:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.958459:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6337fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096529.958473:0:7424:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003503fd1d reply state 0000000038e85f81 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096529.958481:0:7424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787096529.958638:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2b44ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+7:28456:x1873906345487488:12345-192.168.203.45@tcp:36:rm.0 Request processed in 1637us (1736us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787096529.958647:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 136 00010000:00010000:1.0:1787096529.960493:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.960532:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.960540:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.960547:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372a800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096529.960552:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.960560:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.960576:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff9db2a2946b00) 00010000:00010000:1.0:1787096529.960580:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096529.960584:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096529.960599:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d633801 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0F:1787096530.482595:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096530.737672:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353890688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096530.737753:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096530.737796:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353890688 00000100:00100000:1.0:1787096530.737805:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353890688 00000100:00080000:0.0:1787096530.737843:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787096530.737865:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787096530.737875:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353890688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096530.737911:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353890944:0@lo:400:kworker.0 00002000:00000024:1.0:1787096530.737919:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096530.737955:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096530.737971:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353890688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096530.737979:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787096530.737983:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787096530.737991:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1873906353891072:0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.738019:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353890944 00000100:00100000:0.0:1787096530.738020:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096530.738024:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353890944 00000100:00100000:0.0:1787096530.738068:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353891072 00000100:00100000:0.0:1787096530.738074:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353891072 00000100:00100000:1.0:1787096530.738075:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787096530.738096:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353890944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.738120:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787096530.738134:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1873906353891072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.738146:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353890944:12345-0@lo:400:kworker.0 Request processed in 62us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096530.738154:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787096530.738178:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353890816:0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.738181:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353891200:0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.738182:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1873906353891072:12345-0@lo:400:kworker.0 Request processed in 52us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096530.738195:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787096530.738202:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1873906353891072:0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.738221:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353890944:0@lo:400:kworker.0 00000100:00080000:0.0:1787096530.738222:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096530.738233:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096530.738237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096530.738281:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353891328:0@lo:400:kworker.0 00010000:00080000:2.0:1787096530.738295:0:3294:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bfd29f80 x1873906353890688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096530.738308:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096530.738312:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353890688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096530.738350:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353890816 00000100:00100000:3.0:1787096530.738355:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353890816 00000100:00100000:1.0:1787096530.738357:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353891328 00000100:00100000:1.0:1787096530.738363:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353891328 00000100:00100000:2.0:1787096530.738366:0:6539:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353891200 00000100:00100000:2.0:1787096530.738372:0:6539:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353891200 00000100:00100000:3.0:1787096530.738387:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787096530.738397:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353890816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.738410:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787096530.738420:0:6539:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353891200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.738432:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787096530.738440:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0660850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353890816:12345-0@lo:400:kworker.0 Request processed in 46us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096530.738444:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2b44ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353891328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096530.738453:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787096530.738491:0:6539:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353891200:12345-0@lo:400:kworker.0 Request processed in 72us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096530.738522:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787096530.738534:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353890816:0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.738543:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2b44ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353891328:12345-0@lo:400:kworker.0 Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096530.738553:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353891328:0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.738553:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787096530.738565:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc43bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353891200:0@lo:400:kworker.0 00000100:00080000:1.0:1787096530.738579:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787096531.505629:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096532.529664:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096533.170797:0:23780:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 10: cannot create overly large ec mirrors ========================================================== 19:42:12 (1787096532) 00010000:00010000:3.0:1787096533.553666:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096533.558120:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096533.558176:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096533.558451:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345487744 00000100:00100000:1.0:1787096533.558467:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345487744 00000100:00100000:1.0:1787096533.558612:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 108 00000100:00100000:1.0:1787096533.558626:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:2356:x1873906345487744:12345-192.168.203.45@tcp:400:kworker.0 00000100:00080000:3.0:1787096533.558636:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096533.558916:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:2356:x1873906345487744:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 293us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096533.558926:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 108 00000100:00100000:0.0:1787096533.559041:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345487616 00000100:00100000:0.0:1787096533.559047:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345487616 00000100:00100000:0.0:1787096533.559092:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 242 00000100:00100000:0.0:1787096533.559102:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345487616:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787096533.559176:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0662c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345487616:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 76us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096533.559182:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 242 00000001:02000400:2.0:1787096533.753251:0:23828:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_10 needs >= 5 OSTs 00000001:00080000:3.0:1787096533.825800:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000001:02000400:1.0:1787096534.386789:0:23879:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 11: can create --ec 2+2 ================ 19:42:13 (1787096533) 00010000:00010000:0.0:1787096534.577750:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096534.833682:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353891456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096534.833751:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096534.833800:0:6540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353891456 00000100:00100000:2.0:1787096534.833808:0:6540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353891456 00000100:00080000:1.0:1787096534.833842:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096534.833882:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787096534.833893:0:6540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353891456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096534.833928:0:6540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096534.833980:0:6540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353891456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096534.833990:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787096534.834031:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353891456:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787096534.942354:0:23927:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_11 needs >= 4 OSTs 00000001:02000400:1.0:1787096535.543396:0:23975:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12a skipping ALWAYS excluded test 12a 00010000:00010000:3.0:1787096535.601851:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096535.857989:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db282fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353891584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096535.858049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096535.858116:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353891584 00000100:00100000:0.0:1787096535.858125:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353891584 00000100:00100000:0.0:1787096535.858181:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787096535.858192:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353891584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096535.858216:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3294:1873906353891712:0@lo:400:kworker.0 00002000:00000024:0.0:1787096535.858225:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787096535.858246:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096535.858257:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096535.858273:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353891584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096535.858283:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787096535.858291:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1873906353891840:0@lo:400:kworker.0 00000100:00100000:3.0:1787096535.858295:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1873906353892224:0@lo:400:kworker.0 00000100:00100000:0.0:1787096535.858320:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1873906353891968:0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.858336:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096535.858343:0:5758:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353891712 00000100:00100000:3.0:1787096535.858349:0:5758:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353891712 00000100:00100000:2.0:1787096535.858423:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353892096:0@lo:400:kworker.0 00000100:00100000:0.0:1787096535.858786:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096535.858799:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787096535.858808:0:5758:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3294:x1873906353891712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.858835:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353891968 00000100:00100000:1.0:1787096535.858840:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353891968 00000100:00100000:0.0:1787096535.858845:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353891840 00000100:00100000:3.0:1787096535.858851:0:5758:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0663450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3294:x1873906353891712:12345-0@lo:400:kworker.0 Request processed in 43us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096535.858852:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353891840 00000100:00100000:3.0:1787096535.858866:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787096535.858883:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787096535.858892:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787096535.858894:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1873906353891968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096535.858904:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1873906353891840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.858947:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1873906353891968:12345-0@lo:400:kworker.0 Request processed in 57us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096535.858958:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787096535.858958:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1873906353891840:12345-0@lo:400:kworker.0 Request processed in 55us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096535.858968:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1787096535.858990:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096535.859006:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096535.859021:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1873906353891968:0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.859047:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353892224 00000100:00100000:1.0:1787096535.859049:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353892224 00000100:00100000:0.0:1787096535.859056:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3294:1873906353891712:0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.859074:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787096535.859080:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1873906353892224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.859108:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1873906353892224:12345-0@lo:400:kworker.0 Request processed in 29us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096535.859112:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1787096535.859123:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096535.859151:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3294:1873906353892224:0@lo:400:kworker.0 00000100:00100000:0.0:1787096535.859178:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1873906353891840:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.861649:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787096535.861697:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db282fe5880 x1873906353891584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096535.861715:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db282fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353891584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096535.861786:0:6536:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353892096 00000100:00100000:0.0:1787096535.861791:0:6536:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353892096 00000100:00100000:0.0:1787096535.861833:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787096535.861840:0:6536:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353892096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096535.861890:0:6536:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353892096:12345-0@lo:400:kworker.0 Request processed in 47us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096535.861896:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787096535.861923:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353892096:0@lo:400:kworker.0 00000001:02000400:2.0:1787096536.144480:0:24023:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12b skipping ALWAYS excluded test 12b 00010000:00010000:2.0:1787096536.625664:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096536.755035:0:24071:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12c: resync a file using both FLR and EC (without overstriping) ========================================================== 19:42:15 (1787096535) 00000001:02000400:1.0:1787096537.289588:0:24119:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12c needs >= 8 OSTs 00010000:00010000:3.0:1787096537.649598:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096537.889087:0:24167:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12d: resync a file using both FLR and EC (with overstriping) ========================================================== 19:42:16 (1787096536) 00000001:02000400:0.0:1787096538.406808:0:24215:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12d needs >= 8 OSTs 00010000:00010000:0.0:1787096538.673654:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096538.676815:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096538.676869:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096538.676873:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345487872 00000100:00100000:3.0:1787096538.676882:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345487872 00000100:00100000:2.0:1787096538.676913:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345488000 00000100:00100000:2.0:1787096538.676919:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345488000 00000100:00100000:3.0:1787096538.676934:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 244 00000100:00100000:3.0:1787096538.676945:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db285782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345487872:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787096538.676968:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 112 00000100:00100000:2.0:1787096538.676978:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345488000:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096538.677009:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db285782850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345487872:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096538.677017:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 244 00000100:00080000:0.0:1787096538.677018:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096538.677043:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345488000:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096538.677051:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 112 00000001:02000400:3.0:1787096539.025993:0:24264:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 13: parity of single stripe data is just a copy ========================================================== 19:42:18 (1787096538) 00000001:02000400:2.0:1787096539.506279:0:24312:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_13 needs >= 4 OSTs 00010000:00010000:3.0:1787096539.697638:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096539.953715:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787096539.953733:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353892352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096539.953782:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096539.953832:0:6540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353892352 00000100:00100000:0.0:1787096539.953839:0:6540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353892352 00000100:00080000:1.0:1787096539.953874:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096539.953899:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787096539.953908:0:6540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353892352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096539.953945:0:6540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096539.953997:0:6540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353892352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096539.954005:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787096539.954040:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc43a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353892352:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787096540.063935:0:24360:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 20: test that stripe size of parity mirror is set correctly ========================================================== 19:42:19 (1787096539) 00000001:02000400:2.0:1787096540.571090:0:24408:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_20 needs >= 4 OSTs 00010000:00010000:2.0:1787096540.722251:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096540.977642:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873906353892608:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.977665:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353892736:0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.977709:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096540.977711:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353892864:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.977748:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096540.977773:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353893120:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.977796:0:6539:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353892864 00000100:00100000:0.0:1787096540.977801:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096540.977803:0:6539:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353892864 00000100:00100000:0.0:1787096540.977834:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787096540.977842:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3297:1873906353892480:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.977849:0:6539:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353893120 00000100:00100000:3.0:1787096540.977852:0:6539:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353893120 00000100:00100000:0.0:1787096540.977872:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096540.977887:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787096540.977898:0:6539:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353892864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.977902:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353892992:0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.977925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096540.977967:0:6539:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353892864:12345-0@lo:400:kworker.0 Request processed in 63us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096540.977969:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787096540.977979:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353893120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.977999:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787096540.978018:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353893120:12345-0@lo:400:kworker.0 Request processed in 42us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096540.978025:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787096540.978039:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096540.978058:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353892480 00000100:00100000:3.0:1787096540.978062:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353892480 00010000:00080000:0.0:1787096540.978067:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bf89d880 x1873906353893120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096540.978080:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353893120:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.978089:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787096540.978099:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db285783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3297:x1873906353892480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.978145:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db285783850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3297:x1873906353892480:12345-0@lo:400:kworker.0 Request processed in 48us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096540.978169:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3297:1873906353892480:0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.978223:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353892608 00000100:00100000:1.0:1787096540.978225:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353892992 00000100:00100000:0.0:1787096540.978227:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353892608 00000100:00100000:1.0:1787096540.978231:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353892992 00000100:00100000:0.0:1787096540.978260:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787096540.978269:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873906353892608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.978274:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787096540.978284:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353892992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.978326:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873906353892608:12345-0@lo:400:kworker.0 Request processed in 58us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096540.978333:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353892992:12345-0@lo:400:kworker.0 Request processed in 52us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096540.978334:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787096540.978345:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787096540.978368:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353892992:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.978381:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787096540.978383:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873906353892608:0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.978448:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787096540.978449:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096540.978490:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353892864:0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.978553:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353892736 00000100:00100000:1.0:1787096540.978560:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353892736 00000100:00100000:1.0:1787096540.978608:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787096540.978617:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353892736:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787096540.978628:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096540.978648:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353893248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096540.978663:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353892736:12345-0@lo:400:kworker.0 Request processed in 46us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096540.978673:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787096540.978702:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096540.978742:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353893248 00000100:00100000:3.0:1787096540.978749:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353892736:0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.978749:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353893248 00000100:00100000:1.0:1787096540.978791:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787096540.978798:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353893248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787096540.978827:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096540.978871:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353893248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096540.978877:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787096540.978893:0:3294:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bf89ca80 x1873906353893248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096540.979036:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353893248:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787096541.130877:0:24457:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22: test that lfs mirror read from ec does not change eof ========================================================== 19:42:20 (1787096540) 00000001:02000400:3.0:1787096541.643225:0:24505:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22 needs >= 8 OSTs 00010000:00010000:3.0:1787096541.745665:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096542.236660:0:24553:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28b: test that lfs mirror verify for ec does not change eof ========================================================== 19:42:21 (1787096541) 00000001:02000400:3.0:1787096542.735380:0:24601:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28b needs >= 8 OSTs 00010000:00010000:0.0:1787096542.770691:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096543.343225:0:24649:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28c: test that reading past parity data returns zeros ========================================================== 19:42:22 (1787096542) 00010000:00010000:3.0:1787096543.793595:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096543.796325:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096543.796368:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096543.796387:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345488256 00000100:00100000:2.0:1787096543.796396:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345488256 00000100:00100000:3.0:1787096543.796411:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345488128 00000100:00100000:3.0:1787096543.796427:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345488128 00000100:00100000:2.0:1787096543.796456:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 116 00000100:00080000:0.0:1787096543.796462:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096543.796468:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345488256:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096543.796474:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 246 00000100:00100000:3.0:1787096543.796483:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db285783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345488128:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096543.796576:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db285783c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345488128:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096543.796577:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345488256:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 109us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096543.796591:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 246 00000100:00100000:2.0:1787096543.796602:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 116 00000001:02000400:3.0:1787096543.856539:0:24697:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28c needs >= 8 OSTs 00000001:02000400:0.0:1787096544.417054:0:24745:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31b: test that size of parity mirror is 1*2*1M ========================================================== 19:42:23 (1787096543) 00010000:00010000:2.0:1787096544.818389:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096544.936963:0:24793:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31b needs >= 8 OSTs 00000100:00100000:3.0:1787096545.073829:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353893376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096545.073894:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096545.073959:0:6540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353893376 00000100:00100000:0.0:1787096545.073981:0:6540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353893376 00000100:00100000:0.0:1787096545.074050:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787096545.074061:0:6540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353893376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096545.074094:0:6540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096545.074157:0:6540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353893376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096545.074164:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787096545.074209:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353893376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787096545.074241:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787096545.499038:0:24841:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31c: test that size of parity mirror is 1*2*64k ========================================================== 19:42:24 (1787096544) 00010000:00010000:3.0:1787096545.841636:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096546.013367:0:24889:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31c needs >= 8 OSTs 00000100:00100000:0.0:1787096546.098704:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353893504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096546.098705:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2acb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3297:1873906353893632:0@lo:400:kworker.0 00000100:00100000:3.0:1787096546.098719:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2acb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1873906353893760:0@lo:400:kworker.0 00000100:00100000:1.0:1787096546.098786:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2acb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1873906353893888:0@lo:400:kworker.0 00000100:00100000:2.0:1787096546.098836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096546.098852:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096546.098854:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096546.098903:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353893760 00000100:00100000:2.0:1787096546.098907:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2acb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353894144:0@lo:400:kworker.0 00000100:00100000:1.0:1787096546.098915:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353893760 00000100:00100000:3.0:1787096546.098916:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2acb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353894272:0@lo:400:kworker.0 00000100:00100000:0.0:1787096546.098931:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2acb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353894016:0@lo:400:kworker.0 00000100:00100000:2.0:1787096546.098941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096546.098976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096546.098988:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353894144 00000100:00100000:1.0:1787096546.098994:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353894144 00000100:00100000:0.0:1787096546.099001:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353893504 00000100:00100000:0.0:1787096546.099008:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353893504 00000100:00100000:2.0:1787096546.099014:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353893632 00000100:00100000:2.0:1787096546.099025:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353893632 00000100:00100000:1.0:1787096546.099054:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787096546.099063:0:6539:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353894272 00000100:00100000:3.0:1787096546.099069:0:6539:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353894272 00000100:00100000:1.0:1787096546.099071:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1873906353893760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096546.099074:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787096546.099083:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787096546.099092:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1873906353893504:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096546.099097:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db285781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3297:x1873906353893632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096546.099112:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787096546.099125:0:6539:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1873906353894272:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1787096546.099146:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096546.099192:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1873906353893760:12345-0@lo:400:kworker.0 Request processed in 124us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096546.099206:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db285781850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3297:x1873906353893632:12345-0@lo:400:kworker.0 Request processed in 109us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096546.099211:0:6539:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1873906353894272:12345-0@lo:400:kworker.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096546.099216:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787096546.099226:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1873906353893504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096546.099254:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787096546.099254:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787096546.099255:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787096546.099264:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787096546.099276:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353894144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096546.099340:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353894144:12345-0@lo:400:kworker.0 Request processed in 66us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096546.099340:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096546.099353:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1787096546.099383:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787096546.099383:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2acb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353894144:0@lo:400:kworker.0 00000100:00080000:3.0:1787096546.099394:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787096546.099414:0:3296:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bf89f100 x1873906353893504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096546.099419:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2acb85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3297:1873906353893632:0@lo:400:kworker.0 00010000:00080000:1.0:1787096546.099432:0:3294:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2acb85180 x1873906353894272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096546.099448:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096546.099468:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2acb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353894272:0@lo:400:kworker.0 00000100:00100000:0.0:1787096546.099477:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353893504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096546.099485:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353893888 00000100:00100000:2.0:1787096546.099492:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353893888 00000100:00100000:3.0:1787096546.099580:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353894016 00000100:00100000:3.0:1787096546.099586:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353894016 00000100:00100000:1.0:1787096546.099590:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2acb86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1873906353893760:0@lo:400:kworker.0 00000100:00100000:2.0:1787096546.099614:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787096546.099636:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1873906353893888:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787096546.099636:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096546.099660:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787096546.099673:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353894016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096546.099703:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1873906353893888:12345-0@lo:400:kworker.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096546.099714:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787096546.099735:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2acb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1873906353893888:0@lo:400:kworker.0 00000100:00100000:3.0:1787096546.099737:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353894016:12345-0@lo:400:kworker.0 Request processed in 66us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096546.099754:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787096546.099825:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2acb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353894016:0@lo:400:kworker.0 00000001:02000400:3.0:1787096546.579192:0:24937:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31d: test that size of parity mirror is 1*2*64k ========================================================== 19:42:25 (1787096545) 00010000:00010000:0.0:1787096546.865651:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096547.104774:0:24985:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31d needs >= 8 OSTs 00000001:02000400:1.0:1787096547.632417:0:25033:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 30d: test that size of parity mirror is 22*64k ========================================================== 19:42:26 (1787096546) 00010000:00010000:2.0:1787096547.890579:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096548.110543:0:25081:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_30d needs >= 8 OSTs 00000001:02000400:0.0:1787096548.631295:0:25130:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21a: migrate plain file to EC layout === 19:42:27 (1787096547) 00010000:00010000:2.0:1787096548.913630:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096548.917585:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096548.917623:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096548.917639:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345488384 00000100:00100000:3.0:1787096548.917648:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345488384 00000100:00100000:1.0:1787096548.917672:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345488512 00000100:00100000:1.0:1787096548.917679:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345488512 00000100:00100000:3.0:1787096548.917698:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 248 00000100:00100000:3.0:1787096548.917709:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db285781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345488384:12345-192.168.203.45@tcp:400:kworker.0 00000100:00080000:0.0:1787096548.917741:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096548.917742:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 120 00000100:00100000:1.0:1787096548.917755:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345488512:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096548.917777:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db285781050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345488384:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096548.917786:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 248 00000100:00100000:1.0:1787096548.917796:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345488512:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096548.917805:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 120 00000001:02000400:1.0:1787096549.115890:0:25178:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21a needs >= 3 OSTs 00000001:02000400:1.0:1787096549.659907:0:25226:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21b: migrate EC file to plain layout === 19:42:28 (1787096548) 00010000:00010000:1.0:1787096549.937669:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096550.193724:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353894400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096550.193787:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096550.193832:0:6540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353894400 00000100:00100000:2.0:1787096550.193840:0:6540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353894400 00000100:00080000:0.0:1787096550.193870:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096550.193894:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787096550.193912:0:6540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db282fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353894400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096550.193949:0:6540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096550.194009:0:6540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db282fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353894400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096550.194017:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787096550.194050:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353894400:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096550.197954:0:25274:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21b needs >= 3 OSTs 00000001:02000400:1.0:1787096550.776285:0:25322:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21c: migrate between different EC configurations ========================================================== 19:42:29 (1787096549) 00010000:00010000:0.0:1787096550.961668:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096551.217661:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2acb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353894528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096551.217729:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096551.217788:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787096551.217799:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353895040:0@lo:400:kworker.0 00000100:00100000:3.0:1787096551.217819:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1873906353894912:0@lo:400:kworker.0 00000100:00100000:1.0:1787096551.217836:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096551.217864:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353895168:0@lo:400:kworker.0 00000100:00100000:1.0:1787096551.217865:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353894656:0@lo:400:kworker.0 00000100:00100000:3.0:1787096551.217876:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096551.217916:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096551.217916:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096551.217926:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf89f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1873906353894784:0@lo:400:kworker.0 00000100:00100000:2.0:1787096551.217930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096551.217959:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096551.217988:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353894912 00000100:00100000:3.0:1787096551.217995:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353894912 00000100:00100000:3.0:1787096551.218037:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353895168 00000100:00100000:3.0:1787096551.218040:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353895168 00000100:00100000:3.0:1787096551.218058:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353894784 00000100:00100000:3.0:1787096551.218061:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353894784 00000100:00100000:2.0:1787096551.218073:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787096551.218084:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1873906353894912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096551.218145:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1873906353894912:12345-0@lo:400:kworker.0 Request processed in 64us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096551.218296:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353894528 00000100:00100000:1.0:1787096551.218302:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353894528 00000100:00100000:1.0:1787096551.218366:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787096551.218380:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353894528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787096551.218408:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096551.218449:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353894528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096551.218457:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787096551.218534:0:6539:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353895040 00000100:00100000:2.0:1787096551.218539:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787096551.218539:0:6539:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353895040 00000100:00100000:3.0:1787096551.218548:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787096551.218559:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353895168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096551.218569:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787096551.218579:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1873906353894784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096551.218583:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787096551.218595:0:6539:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353895040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096551.218610:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353895168:12345-0@lo:400:kworker.0 Request processed in 55us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096551.218619:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787096551.218624:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1873906353894784:12345-0@lo:400:kworker.0 Request processed in 47us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096551.218632:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787096551.218656:0:6539:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353895040:12345-0@lo:400:kworker.0 Request processed in 63us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096551.218663:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787096551.218685:0:5758:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353894656 00000100:00100000:1.0:1787096551.218688:0:5758:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353894656 00000100:00100000:1.0:1787096551.218717:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787096551.218725:0:5758:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db285781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353894656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096551.218754:0:5758:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db285781450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353894656:12345-0@lo:400:kworker.0 Request processed in 31us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096551.218760:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787096551.218816:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353895040:0@lo:400:kworker.0 00000100:00100000:1.0:1787096551.218827:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353894656:0@lo:400:kworker.0 00010000:00080000:1.0:1787096551.218838:0:3296:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2acb85c00 x1873906353894528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096551.218851:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2acb85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353894528:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787096551.219150:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787096551.219156:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096551.219166:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353895168:0@lo:400:kworker.0 00000100:00100000:3.0:1787096551.219196:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3295:1873906353894784:0@lo:400:kworker.0 00000100:00100000:3.0:1787096551.219205:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf89c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1873906353894912:0@lo:400:kworker.0 00000001:02000400:3.0:1787096551.263255:0:25370:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21c needs >= 4 OSTs 00000001:02000400:0.0:1787096551.822028:0:25418:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21d: migrate PFL file to EC layout ===== 19:42:30 (1787096550) 00010000:00010000:2.0:1787096551.985697:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096552.315730:0:25466:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21d needs >= 3 OSTs 00000001:02000400:2.0:1787096552.859776:0:25514:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22a: mirror split removes plain mirror, keeps EC ========================================================== 19:42:31 (1787096551) 00010000:00010000:2.0:1787096553.009693:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096553.359760:0:25562:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22a needs >= 6 OSTs 00000001:02000400:1.0:1787096553.956845:0:25610:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 23a: truncate EC file to smaller size == 19:42:33 (1787096553) 00000100:00100000:1.0:1787096554.007525:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096554.007570:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345488640 00000100:00100000:1.0:1787096554.007577:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345488640 00000100:00080000:0.0:1787096554.007622:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096554.007668:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00100000:1.0:1787096554.007681:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+5:34218:x1873906345488640:12345-192.168.203.45@tcp:101:mkdir.0 00010000:00010000:1.0:1787096554.007713:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096554.007734:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f400/0xdf123ee4d633816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d844f expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.007791:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e200/0xdf123ee4d63381d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.007803:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e200/0xdf123ee4d63381d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.007816:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e200/0xdf123ee4d63381d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096554.008003:0:5765:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787096554.008006:0:5765:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787096554.008078:0:5765:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e200/0xdf123ee4d63381d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.008098:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f400/0xdf123ee4d633816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d844f expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.008117:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e200/0xdf123ee4d63381d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d844f expref: 6 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.008123:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946b00) 00010000:00010000:1.0:1787096554.008125:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096554.008128:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db28364e200, rc 0) 00000100:00100000:1.0:1787096554.008181:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:34218:x1873906345488640:12345-192.168.203.45@tcp:101:mkdir.0 Request processed in 504us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096554.008189:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 137 00000100:00100000:1.0:1787096554.009769:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096554.009790:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345488768 00000100:00100000:2.0:1787096554.009795:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345488768 00000100:00100000:1.0:1787096554.009796:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096554.009827:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345489024 00000100:00100000:2.0:1787096554.009829:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345489024 00000100:00100000:1.0:1787096554.009837:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 138 00000100:00100000:1.0:1787096554.009849:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+7:2356:x1873906345488768:12345-192.168.203.45@tcp:41:mkdir.0 00000100:00100000:2.0:1787096554.009856:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 139 00000100:00100000:2.0:1787096554.009867:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+7:34218:x1873906345489024:12345-192.168.203.45@tcp:36:mkdir.0 00000004:00000024:1.0:1787096554.009882:0:7424:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00010000:00010000:2.0:1787096554.009901:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096554.009922:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e200/0xdf123ee4d63381d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d844f expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096554.009927:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+7:2356:x1873906345488768:12345-192.168.203.45@tcp:41:mkdir.0 Request processed in 80us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096554.009940:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 138 00010000:00010000:2.0:1787096554.009942:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946b00) 00010000:00010000:2.0:1787096554.009952:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096554.010171:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.010180:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.010191:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.010229:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.010237:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.010243:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096554.011602:0:5795:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x12:0x0]: returning size 512 00010000:00010000:2.0:1787096554.011611:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.011617:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.011624:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.011631:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0b800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096554.011635:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.011643:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.011657:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db282c28000) 00010000:00010000:2.0:1787096554.011660:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096554.011671:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.011676:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b800/0xdf123ee4d633824 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096554.011688:0:5795:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000471a66d0 reply state 0000000040f6aff6 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096554.011699:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096554.011757:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+7:34218:x1873906345489024:12345-192.168.203.45@tcp:36:mkdir.0 Request processed in 1892us (1959us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787096554.011763:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 139 00010000:00010000:1.0:1787096554.012474:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.012482:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.012486:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.012497:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0b600 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096554.012553:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.012558:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.012568:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff9db282c28800) 00010000:00010000:1.0:1787096554.012570:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096554.012573:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.012577:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b600/0xdf123ee4d63382b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096554.022752:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096554.022796:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345489152 00000100:00100000:0.0:1787096554.022804:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345489152 00000100:00100000:0.0:1787096554.022853:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 140 00000100:00100000:0.0:1787096554.022863:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:34221:x1873906345489152:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787096554.022884:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096554.022905:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d633832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8456 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.022965:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633839 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.022979:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.022989:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096554.023045:0:5765:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787096554.023049:0:5765:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787096554.023067:0:5765:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.023085:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d633832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8456 expref: 8 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.023094:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8456 expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.023100:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3a700) 00010000:00010000:0.0:1787096554.023102:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096554.023104:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda4e00, rc 0) 00000100:00100000:0.0:1787096554.023146:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+7:34221:x1873906345489152:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 286us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096554.023151:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 140 00000100:00100000:1.0:1787096554.024203:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096554.024255:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345489280 00000100:00100000:2.0:1787096554.024260:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345489280 00000100:00100000:2.0:1787096554.024292:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 141 00000100:00100000:2.0:1787096554.024300:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2acb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+7:34221:x1873906345489280:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787096554.024309:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096554.024316:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b200/0xdf123ee4d633840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d845d expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024344:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024351:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024356:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024365:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024379:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024386:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024556:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d633855 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024565:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d633855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024573:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d633855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096554.024596:0:5763:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x12:0x0]: returning size 512 00000004:00200000:2.0:1787096554.024599:0:5763:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787096554.024615:0:5763:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d633855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024626:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024633:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024639:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024644:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0a400 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096554.024647:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024656:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024664:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3a700) 00010000:00010000:2.0:1787096554.024667:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096554.024669:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024673:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a400/0xdf123ee4d633847 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024683:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024694:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024699:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024704:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0be00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096554.024707:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024713:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024727:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff9db282c28000) 00010000:00010000:2.0:1787096554.024729:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096554.024732:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024744:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0be00/0xdf123ee4d63384e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024763:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b200/0xdf123ee4d633840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d845d expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024770:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d633855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d845d expref: 8 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.024775:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff9db282c28600) 00010000:00010000:2.0:1787096554.024776:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787096554.024777:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2b7a0ae00, rc 0) 00000100:00100000:2.0:1787096554.024806:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2acb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+8:34221:x1873906345489280:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 508us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096554.024810:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 141 00000100:00100000:2.0:1787096554.025762:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096554.025814:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345489408 00000100:00100000:1.0:1787096554.025819:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345489408 00000100:00100000:1.0:1787096554.025854:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 142 00000100:00100000:1.0:1787096554.025863:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+8:34221:x1873906345489408:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787096554.025873:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096554.025884:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f400/0xdf123ee4d63385c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8464 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.025919:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.025929:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.025950:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.025984:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.025992:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.025998:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026037:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026044:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026049:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026054:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28364e000 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096554.026057:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026063:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026082:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff9db282c28600) 00010000:00010000:1.0:1787096554.026084:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096554.026088:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026100:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e000/0xdf123ee4d633863 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026111:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026116:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026121:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026126:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28364ee00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096554.026136:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026146:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026154:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x7b711ae6 (ffff9db2a2946400) 00010000:00010000:1.0:1787096554.026156:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096554.026159:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026164:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63386a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026188:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f400/0xdf123ee4d63385c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8464 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026208:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff9db282c28600) 00010000:00010000:1.0:1787096554.026210:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096554.026213:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f400/0xdf123ee4d63385c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8464 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.026219:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db28364f400, rc 0) 00000100:00100000:1.0:1787096554.026247:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+8:34221:x1873906345489408:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 387us (488us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096554.026251:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 142 00000100:00100000:3.0:1787096554.027299:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096554.027328:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345489664 00000100:00100000:0.0:1787096554.027333:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345489664 00000100:00100000:0.0:1787096554.027360:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 143 00000100:00100000:0.0:1787096554.027365:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+8:34221:x1873906345489664:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787096554.027373:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096554.027381:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4600/0xdf123ee4d633871 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d846b expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.027436:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.027463:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.027470:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.027479:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.027483:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.027487:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.027971:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.027977:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.027981:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096554.027995:0:5765:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 0 00010000:00010000:0.0:1787096554.028009:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.028013:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.028016:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.028024:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda5000 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096554.028026:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.028030:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.028036:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff9db282c28600) 00010000:00010000:0.0:1787096554.028038:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096554.028040:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.028044:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d633878 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096554.028050:0:5765:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000aeba43a2 reply state 000000009d687ded transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096554.028055:0:5765:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096554.028071:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4600/0xdf123ee4d633871 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d846b expref: 11 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.028084:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d846b expref: 10 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096554.028090:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9db2bca3a600) 00010000:00010000:0.0:1787096554.028092:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096554.028094:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda5c00, rc 0) 00000100:00100000:0.0:1787096554.028136:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+11:34221:x1873906345489664:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 766us (836us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787096554.028148:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 143 00010000:00010000:1.0:1787096554.028823:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.028833:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.028840:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.028846:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda5600 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096554.028850:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.028857:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.028867:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x7b711ae6 (ffff9db2bca3a400) 00010000:00010000:1.0:1787096554.028870:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096554.028873:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.028886:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d63387f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096554.029310:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096554.029359:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345489920 00000100:00100000:2.0:1787096554.029366:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345489920 00000100:00100000:2.0:1787096554.029403:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 144 00000100:00100000:2.0:1787096554.029411:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+10:34221:x1873906345489920:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:2.0:1787096554.029422:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096554.029430:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d633894 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8472 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.029496:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.029543:0:5763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d846b expref: 11 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.029552:0:5763:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.029582:0:5763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d846b expref: 11 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.029595:0:5763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d846b expref: 11 pid: 5765 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096554.029608:0:5763:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc43a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5763:1873906353895296:192.168.203.45@tcp:104: 00000100:00100000:2.0:1787096554.029675:0:5763:0:(client.c:2692:ptlrpc_set_wait()) set ffff9db2bc6c6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787096554.030793:0:5763:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc43a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5763:1873906353895296:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787096554.030811:0:5763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096554.030985:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096554.031032:0:10980:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345490048 00000100:00100000:1.0:1787096554.031038:0:10980:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345490048 00010000:00010000:1.0:1787096554.031062:0:10980:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d846b expref: 12 pid: 5765 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096554.031101:0:10980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 43 00000100:00100000:1.0:1787096554.031109:0:10980:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7354022b-ee92-4e63-a611-5f745ec24594+12:2357:x1873906345490048:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096554.031119:0:10980:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096554.031125:0:10980:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d846b expref: 12 pid: 5765 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.031137:0:10980:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d846b expref: 12 pid: 5765 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.031153:0:10980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d846b expref: 12 pid: 5765 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.031164:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9db2bca3a600) 00010000:00010000:1.0:1787096554.031169:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.031176:0:10980:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.031183:0:10980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096554.031217:0:10980:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096554.031241:0:5763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031248:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096554.031255:0:10980:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7354022b-ee92-4e63-a611-5f745ec24594+11:2357:x1873906345490048:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 146us (269us total) trans 0 rc 0/0 00000004:00200000:2.0:1787096554.031259:0:5763:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 0 00000100:00100000:1.0:1787096554.031264:0:10980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 43 00010000:00010000:2.0:1787096554.031418:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031430:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031435:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031439:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0a800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096554.031441:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031445:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031462:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff9db2bca3a600) 00010000:00010000:2.0:1787096554.031465:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787096554.031467:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031471:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0a800/0xdf123ee4d63389b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031513:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d633894 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8472 expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031522:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff9db282c28600) 00010000:00010000:2.0:1787096554.031525:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096554.031529:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d633894 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8472 expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096554.031540:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2b7a0b400, rc 0) 00000100:00100000:2.0:1787096554.031578:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+9:34221:x1873906345489920:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 2169us (2269us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096554.031584:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 144 00000100:00100000:3.0:1787096554.032685:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096554.032734:0:12749:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345490304 00000100:00100000:1.0:1787096554.032741:0:12749:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345490304 00000100:00100000:1.0:1787096554.032782:0:12749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 21 00000100:00100000:1.0:1787096554.032791:0:12749:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7354022b-ee92-4e63-a611-5f745ec24594+9:34221:x1873906345490304:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:1.0:1787096554.032957:0:12749:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf89f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7354022b-ee92-4e63-a611-5f745ec24594+10:34221:x1873906345490304:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 167us (279us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1787096554.032964:0:12749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 21 00010000:00010000:0.0:1787096554.033690:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096554.036404:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096554.036468:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345490432 00000100:00100000:3.0:1787096554.036476:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345490432 00000100:00100000:3.0:1787096554.036546:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 250 00000100:00100000:3.0:1787096554.036557:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db285783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2357:x1873906345490432:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096554.036633:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db285783050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2357:x1873906345490432:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096554.036642:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 250 00000001:00080000:3.0:1787096554.299661:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000001:00080000:3.0:1787096554.299677:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000001:02000400:3.0:1787096554.496423:0:25660:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_23a: @@@@@@ FAIL: setstripe failed Debug log: 930 lines, 930 kept, 0 dropped, 0 bad.