00010000:00010000:3.0F:1787096529.614580:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1787096529.614587:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360229632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787096529.614669:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096529.614710:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360229632 00000100:00100000:3.0:1787096529.614718:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360229632 00000100:00100000:3.0:1787096529.614782:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787096529.614792:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360229632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787096529.614866:0:6485:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787096529.614910:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360229632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096529.614918:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787096529.615189:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360229632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787096529.910266:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0F:1787096529.910313:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352829312 00000100:00100000:0.0:1787096529.910328:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352829312 00000100:00080000:2.0:1787096529.910381:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096529.910481:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 140 00000100:00100000:0.0:1787096529.910495:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:27984:x1873906352829312:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:0.0:1787096529.910522:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096529.910544:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b43b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6bbb expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096529.910611:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43b7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096529.910626:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096529.910642:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096529.910686:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096529.910691:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096529.910712:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096529.910738:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b43b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bbb expref: 7 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096529.910754:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bbb expref: 6 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096529.910763:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35ca00) 00010000:00010000:0.0:1787096529.910766:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096529.910770:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ccea200, rc 0) 00000100:00100000:0.0:1787096529.910839:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:27984:x1873906352829312:12345-192.168.203.27@tcp:101:rm.0 Request processed in 348us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096529.910847:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 140 00000100:00100000:0.0:1787096529.913293:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096529.913559:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352829440 00000100:00100000:2.0:1787096529.913569:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352829440 00000100:00100000:2.0:1787096529.913620:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 141 00000100:00100000:2.0:1787096529.913629:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:27984:x1873906352829440:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1787096529.913647:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096529.913664:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43b82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6bc2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.913718:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.913731:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.913742:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.913757:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.913998:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914007:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914078:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b43b97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914087:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b43b97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914094:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b43b97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096529.914128:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 0 00000004:00200000:2.0:1787096529.914131:0:9995:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096529.914147:0:9995:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b43b97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914157:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b43b97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914166:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914172:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914179:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914185:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096529.914189:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914195:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914214:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35ca00) 00010000:00010000:2.0:1787096529.914217:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096529.914222:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914228:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914239:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914245:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914250:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914255:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4aa00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096529.914258:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914264:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914270:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff9c9c41b55900) 00010000:00010000:2.0:1787096529.914273:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096529.914276:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914281:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43b90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914319:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43b82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc2 expref: 8 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914330:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b43b97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc2 expref: 7 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.914337:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9c9c41b55300) 00010000:00010000:2.0:1787096529.914339:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096529.914341:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4be00, rc 0) 00000100:00100000:2.0:1787096529.914468:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:27984:x1873906352829440:12345-192.168.203.27@tcp:101:rm.0 Request processed in 839us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096529.914476:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 141 00000100:00100000:0.0:1787096529.917672:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096529.917768:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352829696 00000100:00100000:3.0:1787096529.917777:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352829696 00000100:00100000:3.0:1787096529.917834:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 142 00000100:00100000:3.0:1787096529.917845:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d512d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:27984:x1873906352829696:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:3.0:1787096529.917900:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787096529.917929:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b43b97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc2 expref: 7 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.917946:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9c9c41b55300) 00010000:00010000:3.0:1787096529.917967:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea200/0x1b9fb40e15b43b7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bbb expref: 6 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.917977:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b35ca00) 00010000:00010000:3.0:1787096529.917995:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096529.918023:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918035:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918045:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918071:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918078:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918085:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918166:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918175:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918183:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918382:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918528:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918536:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918544:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918551:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918568:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918595:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787096529.918613:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918620:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918625:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918630:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2c00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096529.918634:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918642:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918651:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9c9d6b3f0d00) 00010000:00010000:3.0:1787096529.918655:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096529.918658:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918664:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918682:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.918684:0:8377:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096529.918690:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.918698:0:8377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918725:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918734:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096529.918737:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918743:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918752:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9d6b3f0b00) 00010000:00010000:3.0:1787096529.918755:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096529.918758:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918763:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b43b9e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.918765:0:8377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3600 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:2.0:1787096529.918774:0:8377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096529.918787:0:6479:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000053ccad4b reply state 000000001aa5ff1c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.918788:0:8377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096529.918822:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.918827:0:8377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff9c9d6b3f0d00) 00010000:00010000:3.0:1787096529.918831:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff9c9d6b3f0500) 00010000:00010000:2.0:1787096529.918835:0:8377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096529.918838:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096529.918843:0:6479:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787096529.918843:0:8377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096529.918884:0:8377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b43bb3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096529.918924:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d512d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:27984:x1873906352829696:12345-192.168.203.27@tcp:36:rm.0 Request processed in 1077us (1256us total) trans 4294967355 rc 0/0 00010000:00010000:2.0:1787096529.918924:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096529.918929:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096529.918934:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096529.918942:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 142 00000100:00100000:2.0:1787096530.126608:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1873906360230144:0@lo:400:kworker.0 00000100:00100000:3.0:1787096530.126665:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1873906360230272:0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.126681:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096530.126711:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1787096530.126729:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360230144 00000100:00100000:1.0:1787096530.126744:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360230144 00000100:00100000:3.0:1787096530.126753:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360230784:0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.126755:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1873906360230656:0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.126783:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360229888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096530.126789:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096530.126797:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096530.126801:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360230272 00000100:00100000:1.0:1787096530.126805:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360230272 00000100:00100000:2.0:1787096530.126812:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c41e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1873906360231168:0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.126814:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096530.126836:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360230016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096530.126837:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360230656 00000100:00100000:1.0:1787096530.126842:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360230656 00000100:00100000:2.0:1787096530.126843:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096530.126850:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906360230528:0@lo:400:kworker.0 00000100:00100000:3.0:1787096530.126877:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096530.126881:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360231168 00000100:00100000:1.0:1787096530.126886:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360231168 00000100:00100000:0.0:1787096530.126886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096530.126891:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787096530.126903:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1873906360230144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.126908:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1873906360231040:0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.126914:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360230528 00000100:00100000:1.0:1787096530.126918:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360230528 00000100:00100000:3.0:1787096530.126926:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360230784 00000100:00100000:3.0:1787096530.126931:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360230784 00000100:00100000:0.0:1787096530.126932:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096530.126941:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360231040 00000100:00100000:1.0:1787096530.126946:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360231040 00000100:00100000:0.0:1787096530.126949:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5129d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360231424:0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.126954:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1873906360230144:12345-0@lo:400:kworker.0 Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096530.126962:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787096530.126976:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096530.126980:0:9444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787096530.126996:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787096530.127006:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787096530.127011:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1873906360230272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.127013:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787096530.127017:0:9444:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360230784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.127019:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1873906360230656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.127022:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3628:1873906360229760:0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.127070:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096530.127071:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1873906360230656:12345-0@lo:400:kworker.0 Request processed in 55us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096530.127078:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787096530.127085:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1873906360230272:12345-0@lo:400:kworker.0 Request processed in 78us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096530.127086:0:9444:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360230784:12345-0@lo:400:kworker.0 Request processed in 83us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096530.127103:0:9444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787096530.127103:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787096530.127110:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360230400:0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.127112:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787096530.127121:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1873906360231168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096530.127129:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360231424 00000100:00100000:3.0:1787096530.127134:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360231424 00000100:00100000:1.0:1787096530.127135:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787096530.127140:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096530.127150:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906360230528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.127155:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1873906360231168:12345-0@lo:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096530.127161:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360230912:0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.127163:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787096530.127169:0:9444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787096530.127181:0:9444:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360231424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.127193:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787096530.127195:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096530.127202:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906360230528:12345-0@lo:400:kworker.0 Request processed in 56us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096530.127205:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1873906360231040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.127216:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5129c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360231296:0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.127219:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787096530.127226:0:9444:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360231424:12345-0@lo:400:kworker.0 Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096530.127234:0:9444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787096530.127239:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096530.127247:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1873906360231040:12345-0@lo:400:kworker.0 Request processed in 47us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096530.127253:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360230912 00000100:00100000:2.0:1787096530.127255:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1787096530.127256:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096530.127258:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360230912 00000100:00080000:1.0:1787096530.127263:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096530.127268:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e995500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906360230528:0@lo:400:kworker.0 00000100:00080000:1.0:1787096530.127270:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787096530.127275:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787096530.127286:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1873906360231040:0@lo:400:kworker.0 00000100:00100000:3.0:1787096530.127287:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360231296 00010000:00080000:2.0:1787096530.127291:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d6e995f80 x1873906360230656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096530.127292:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360231296 00000100:00100000:2.0:1787096530.127304:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e995f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1873906360230656:0@lo:400:kworker.0 00010000:00080000:0.0:1787096530.127310:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d5129d880 x1873906360231424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096530.127313:0:8580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1787096530.127317:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9c41e6d180 x1873906360231168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096530.127324:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5129d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360231424:0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.127327:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c41e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1873906360231168:0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.127330:0:8580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6ea1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360230912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096530.127334:0:9444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787096530.127341:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1873906360230144:0@lo:400:kworker.0 00000100:00100000:3.0:1787096530.127348:0:9444:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6ea1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360231296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.127358:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360229760 00000100:00100000:0.0:1787096530.127363:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360229760 00000100:00100000:1.0:1787096530.127383:0:8580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6ea1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360230912:12345-0@lo:400:kworker.0 Request processed in 57us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096530.127385:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360229888 00000100:00100000:2.0:1787096530.127408:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360229888 00000100:00100000:3.0:1787096530.127416:0:9444:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6ea1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360231296:12345-0@lo:400:kworker.0 Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096530.127420:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787096530.127429:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3628:x1873906360229760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096530.127432:0:9444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787096530.127433:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360230016 00000100:00100000:2.0:1787096530.127438:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360230016 00000100:00100000:1.0:1787096530.127447:0:8580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1787096530.127463:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787096530.127466:0:16634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787096530.127469:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3628:x1873906360229760:12345-0@lo:400:kworker.0 Request processed in 42us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096530.127475:0:16634:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360229888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096530.127477:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1787096530.127483:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787096530.127494:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360230016:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787096530.127495:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1873906360230272:0@lo:400:kworker.0 00002000:00000024:2.0:1787096530.127496:0:16634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096530.127510:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360230400 00002000:00000024:1.0:1787096530.127514:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096530.127514:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360230400 00000100:00100000:3.0:1787096530.127519:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e995c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360230784:0@lo:400:kworker.0 00000100:00100000:2.0:1787096530.127540:0:16634:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360229888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096530.127547:0:16634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787096530.127548:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787096530.127554:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6ea18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360230400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096530.127566:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360230016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096530.127573:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787096530.127591:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6ea18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360230400:12345-0@lo:400:kworker.0 Request processed in 36us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096530.127598:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:2.0:1787096530.127601:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d74859f80 x1873906360230016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096530.127615:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360230016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096530.127628:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3628:1873906360229760:0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.127637:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360230400:0@lo:400:kworker.0 00000100:00100000:0.0:1787096530.127648:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360230912:0@lo:400:kworker.0 00010000:00080000:0.0:1787096530.127656:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d5129c000 x1873906360231296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096530.127664:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5129c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360231296:0@lo:400:kworker.0 00010000:00080000:0.0:1787096530.127682:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d4800e680 x1873906360229888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096530.127692:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360229888:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787096530.629954:0:19897:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 10: cannot create overly large ec mirrors ========================================================== 19:42:10 (1787096530) 00010000:00010000:3.0:1787096530.638618:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096531.150686:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787096531.150720:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360231552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096531.150824:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096531.150865:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360231552 00000100:00100000:2.0:1787096531.150876:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360231552 00000100:00100000:2.0:1787096531.151161:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787096531.151171:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360231552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787096531.151207:0:6484:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787096531.151287:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360231552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096531.151296:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787096531.151358:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e994380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360231552:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787096531.252668:0:19945:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_10 needs >= 5 OSTs 00010000:00010000:3.0:1787096531.662699:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096531.930791:0:19994:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 11: can create --ec 2+2 ================ 19:42:12 (1787096532) 00000001:02000400:2.0:1787096532.555355:0:20043:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_11 needs >= 4 OSTs 00010000:00010000:0.0:1787096532.686607:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096532.686618:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787096532.686642:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360231680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096532.686666:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7485b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360231808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096532.686709:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096532.686735:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360231680 00000100:00100000:2.0:1787096532.686753:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360231680 00000100:00100000:3.0:1787096532.686762:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787096532.686798:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096532.686817:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360231808 00000100:00100000:2.0:1787096532.686822:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360231808 00000100:00100000:0.0:1787096532.686829:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787096532.686842:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1873906360231680:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096532.686866:0:16634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00002000:00000024:0.0:1787096532.686874:0:8362:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096532.686879:0:16634:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360231808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787096532.686894:0:16634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096532.686933:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1873906360231680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096532.686942:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1787096532.686948:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096532.686952:0:16634:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360231808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096532.686962:0:16634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787096532.686997:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7485b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360231808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096532.687125:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360231680:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787096533.177643:0:20091:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12a skipping ALWAYS excluded test 12a 00000100:00100000:0.0:1787096533.634494:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096533.634532:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096533.634537:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352829824 00000100:00100000:2.0:1787096533.634547:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352829824 00000100:00100000:3.0:1787096533.634579:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352829952 00000100:00100000:3.0:1787096533.634585:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352829952 00000100:00100000:2.0:1787096533.634605:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 319 00000100:00100000:2.0:1787096533.634616:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2399:x1873906352829824:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096533.634647:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00100000:3.0:1787096533.634659:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:2399:x1873906352829952:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1787096533.634692:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2399:x1873906352829824:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.634701:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 319 00000100:00100000:3.0:1787096533.634706:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e995c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:2399:x1873906352829952:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096533.634715:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 194 00000100:00080000:3.0:1787096533.634739:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096533.634977:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096533.635014:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352830080 00000100:00100000:2.0:1787096533.635019:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352830080 00000100:00100000:2.0:1787096533.635062:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 195 00000100:00080000:3.0:1787096533.635063:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787096533.635074:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2400:x1873906352830080:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1787096533.635112:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e995f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2400:x1873906352830080:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 40us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096533.635120:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 195 00010000:00010000:3.0:1787096533.710569:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096533.778737:0:20139:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12b skipping ALWAYS excluded test 12b 00000001:02000400:2.0:1787096534.442624:0:20187:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12c: resync a file using both FLR and EC (without overstriping) ========================================================== 19:42:14 (1787096534) 00000100:00100000:2.0:1787096534.734589:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360231936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787096534.734651:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096534.734697:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360231936 00000100:00100000:3.0:1787096534.734704:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360231936 00000100:00100000:3.0:1787096534.734752:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787096534.734763:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360231936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787096534.734798:0:7409:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787096534.734857:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360231936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096534.734866:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787096534.734904:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360231936:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787096534.735027:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096534.989914:0:20235:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12c needs >= 8 OSTs 00000100:00100000:0.0:1787096535.246695:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360232192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096535.246734:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360232064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096535.246774:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096535.246815:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360232192 00000100:00100000:2.0:1787096535.246823:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360232192 00000100:00100000:0.0:1787096535.246865:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096535.246901:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360232064 00000100:00100000:2.0:1787096535.246906:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360232064 00000100:00100000:0.0:1787096535.246909:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787096535.246920:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360232192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096535.246948:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00002000:00000024:0.0:1787096535.246948:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096535.246971:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360232064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787096535.246985:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096535.247006:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e995500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360232192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096535.247011:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1787096535.247068:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d6e996d80 x1873906360232192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096535.247104:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e996d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360232192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096535.247136:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360232704:0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.247153:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7485b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3627:1873906360232320:0@lo:400:kworker.0 00000100:00100000:0.0:1787096535.247170:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096535.247196:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360233216:0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.247261:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096535.247263:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096535.247339:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7485aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906360232448:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.247360:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e994380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360232064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 388us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096535.247379:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787096535.247458:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906360232832:0@lo:400:kworker.0 00000100:00100000:0.0:1787096535.247462:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787096535.247467:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096535.247468:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360233216 00000100:00100000:2.0:1787096535.247475:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360233216 00000100:00100000:0.0:1787096535.247480:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1873906360232576:0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.247498:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096535.247505:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1873906360232960:0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.247528:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906360233344:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.247537:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787096535.247546:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096535.247553:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360233216:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787096535.247567:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787096535.247578:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096535.247582:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360232320 00000100:00100000:3.0:1787096535.247589:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360232320 00000100:00100000:1.0:1787096535.247608:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360232448 00000100:00100000:1.0:1787096535.247613:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360232448 00000100:00100000:0.0:1787096535.247619:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7485a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360233088:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.247640:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360233216:12345-0@lo:400:kworker.0 Request processed in 91us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096535.247655:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787096535.247661:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787096535.247673:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096535.247674:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360232832 00000100:00100000:3.0:1787096535.247681:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3627:x1873906360232320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.247682:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360232832 00000100:00100000:2.0:1787096535.247731:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360233088 00000100:00100000:1.0:1787096535.247735:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360232576 00000100:00100000:0.0:1787096535.247737:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360233216:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.247738:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360233088 00000100:00100000:1.0:1787096535.247742:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360232576 00000100:00100000:3.0:1787096535.247766:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3627:x1873906360232320:12345-0@lo:400:kworker.0 Request processed in 90us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096535.247775:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787096535.247795:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360232704 00000100:00100000:0.0:1787096535.247802:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360232704 00000100:00100000:1.0:1787096535.247808:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787096535.247815:0:9444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787096535.247821:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906360232448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096535.247842:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787096535.247843:0:9444:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360233088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096535.247862:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906360232832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096535.247881:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787096535.247883:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906360232448:12345-0@lo:400:kworker.0 Request processed in 63us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096535.247892:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787096535.247901:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360232704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096535.247921:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906360232832:12345-0@lo:400:kworker.0 Request processed in 62us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096535.247922:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787096535.247931:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787096535.247940:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1873906360232576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.247941:0:9444:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360233088:12345-0@lo:400:kworker.0 Request processed in 104us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096535.247973:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e996d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360232704:12345-0@lo:400:kworker.0 Request processed in 80us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096535.247974:0:9444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787096535.247987:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787096535.248024:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1873906360232576:12345-0@lo:400:kworker.0 Request processed in 92us (484us total) trans 0 rc 0/0 00010000:00080000:3.0:1787096535.248031:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d4800ce00 x1873906360232064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096535.248031:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787096535.248050:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787096535.248066:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787096535.248073:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096535.248084:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360232064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096535.248087:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360232960 00000100:00100000:2.0:1787096535.248093:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360232960 00000100:00100000:1.0:1787096535.248105:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096535.248105:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1873906360233472:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.248146:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360233344 00000100:00100000:2.0:1787096535.248151:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360233344 00000100:00100000:0.0:1787096535.248160:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096535.248168:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7485b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3627:1873906360232320:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.248186:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360233472 00000100:00100000:2.0:1787096535.248191:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360233472 00000100:00100000:1.0:1787096535.248198:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906360232832:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.248225:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787096535.248230:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7485aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906360232448:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.248243:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1873906360232960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787096535.248250:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787096535.248258:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787096535.248286:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787096535.248308:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906360233344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.248311:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1873906360232960:12345-0@lo:400:kworker.0 Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096535.248322:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787096535.248322:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1873906360232576:0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.248360:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7485a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360233088:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.248363:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787096535.248375:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906360233344:12345-0@lo:400:kworker.0 Request processed in 66us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096535.248383:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1873906360233472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096535.248384:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787096535.248450:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360232704:0@lo:400:kworker.0 00010000:00080000:0.0:1787096535.248467:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d74859500 x1873906360232960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096535.248486:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1873906360232960:0@lo:400:kworker.0 00000100:00100000:2.0:1787096535.248500:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1873906360233472:12345-0@lo:400:kworker.0 Request processed in 120us (343us total) trans 0 rc 0/0 00010000:00080000:0.0:1787096535.248507:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d74859f80 x1873906360233472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096535.248516:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787096535.248522:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1873906360233472:0@lo:400:kworker.0 00000100:00100000:1.0:1787096535.248536:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906360233344:0@lo:400:kworker.0 00000001:00080000:2.0:1787096535.249298:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00010000:00010000:0.0:1787096535.249350:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096535.249359:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096535.249364:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096535.249368:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096535.249371:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096535.249377:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096535.249389:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff9c9d6b3f0500) 00010000:00010000:0.0:1787096535.249403:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096535.249413:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096535.249417:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b43ba5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1787096535.643737:0:20283:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 12d: resync a file using both FLR and EC (with overstriping) ========================================================== 19:42:15 (1787096535) 00010000:00010000:3.0:1787096535.758584:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096536.192370:0:20331:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12d needs >= 8 OSTs 00000100:00100000:1.0:1787096536.272115:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096536.272139:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360233600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787096536.272204:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096536.273010:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360233600 00000100:00100000:2.0:1787096536.273033:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360233600 00000100:00100000:2.0:1787096536.273105:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787096536.273117:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360233600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787096536.273164:0:7723:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787096536.273248:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360233600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096536.273259:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787096536.273300:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360233600:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787096536.782572:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096536.871863:0:20379:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 13: parity of single stripe data is just a copy ========================================================== 19:42:17 (1787096537) 00000001:02000400:2.0:1787096537.447060:0:20427:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_13 needs >= 4 OSTs 00000100:00100000:3.0:1787096537.806482:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787096537.806500:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096537.806504:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360233728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096537.806508:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360233856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096537.806572:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096537.806622:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096537.806651:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360233728 00000100:00100000:3.0:1787096537.806658:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360233728 00000100:00100000:0.0:1787096537.806676:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360233856 00000100:00100000:0.0:1787096537.806682:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360233856 00000100:00080000:2.0:1787096537.806697:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096537.806717:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787096537.806725:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787096537.806730:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360233728:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096537.806736:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360233856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787096537.806761:0:8362:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787096537.806761:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096537.806815:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360233856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096537.806820:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360233728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096537.806828:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787096537.806834:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787096537.806861:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360233728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096537.806892:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360233856:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096538.035999:0:20475:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 20: test that stripe size of parity mirror is set correctly ========================================================== 19:42:18 (1787096538) 00000001:02000400:0.0:1787096538.571839:0:20523:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_20 needs >= 4 OSTs 00000100:00100000:0.0:1787096538.755240:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096538.755285:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096538.755306:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352830336 00000100:00100000:1.0:1787096538.755316:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352830336 00000100:00100000:0.0:1787096538.755320:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096538.755341:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352830208 00000100:00100000:2.0:1787096538.755358:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352830208 00000100:00080000:0.0:1787096538.755371:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096538.755383:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352830464 00000100:00100000:1.0:1787096538.755387:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352830464 00000100:00100000:2.0:1787096538.755423:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 321 00000100:00100000:2.0:1787096538.755435:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2401:x1873906352830208:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096538.755486:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:3.0:1787096538.755503:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2402:x1873906352830336:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1787096538.755503:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2401:x1873906352830208:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 67us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096538.755518:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 321 00000100:00100000:3.0:1787096538.755555:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2402:x1873906352830336:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 60us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096538.755562:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 202 00000100:00100000:0.0:1787096538.755586:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 203 00000100:00100000:0.0:1787096538.755595:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352830464:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1787096538.755624:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352830464:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096538.755632:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 203 00000100:00080000:0.0:1787096538.755649:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787096538.830570:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096539.134577:0:20571:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22: test that lfs mirror read from ec does not change eof ========================================================== 19:42:19 (1787096539) 00000001:02000400:3.0:1787096539.650075:0:20620:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22 needs >= 8 OSTs 00000100:00100000:0.0:1787096539.854578:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360233984:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787096539.854590:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096539.854647:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096539.854686:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360233984 00000100:00100000:2.0:1787096539.854693:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360233984 00000100:00100000:2.0:1787096539.854738:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787096539.854748:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360233984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787096539.854781:0:6485:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787096539.854821:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360233984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096539.854826:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787096539.854870:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360233984:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787096540.224759:0:20668:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28b: test that lfs mirror verify for ec does not change eof ========================================================== 19:42:20 (1787096540) 00000100:00100000:0.0:1787096540.366596:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7485a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360234240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096540.366610:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360234112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096540.366683:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096540.366688:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906360234496:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.366722:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3627:1873906360234368:0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.366731:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096540.366754:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360234112 00000100:00100000:1.0:1787096540.366760:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360234112 00000100:00100000:0.0:1787096540.366767:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906360235008:0@lo:400:kworker.0 00000100:00100000:2.0:1787096540.366769:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360234624:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.366778:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096540.366810:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096540.366812:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787096540.366817:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360234880:0@lo:400:kworker.0 00000100:00100000:2.0:1787096540.366822:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096540.366823:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360234112:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096540.366838:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1873906360235520:0@lo:400:kworker.0 00002000:00000024:1.0:1787096540.366851:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096540.366856:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1873906360235136:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.366857:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096540.366872:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096540.366882:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360235392:0@lo:400:kworker.0 00000100:00100000:2.0:1787096540.366905:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096540.366911:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360234112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096540.366916:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096540.366934:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787096540.366936:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360234496 00000100:00100000:0.0:1787096540.366940:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360234496 00000100:00100000:2.0:1787096540.366945:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1873906360235648:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.366960:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360235904:0@lo:400:kworker.0 00000100:00080000:1.0:1787096540.366976:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096540.366976:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360235008 00000100:00100000:2.0:1787096540.366981:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096540.366982:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360235008 00000100:00100000:3.0:1787096540.367002:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096540.367008:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096540.367014:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360235520 00000100:00100000:0.0:1787096540.367018:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360235520 00010000:00080000:2.0:1787096540.367031:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d4800ce00 x1873906360234112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096540.367034:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360235136 00000100:00100000:0.0:1787096540.367038:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360235136 00000100:00100000:1.0:1787096540.367051:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1873906360234752:0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.367052:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360235648 00000100:00100000:0.0:1787096540.367056:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360235648 00000100:00100000:3.0:1787096540.367061:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360234368 00000100:00100000:3.0:1787096540.367068:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360234368 00000100:00100000:0.0:1787096540.367076:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787096540.367081:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360234112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787096540.367086:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906360234496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.367093:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096540.367110:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787096540.367114:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360235264:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.367119:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3627:x1873906360234368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.367130:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1873906360234496:12345-0@lo:400:kworker.0 Request processed in 46us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096540.367131:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360234752 00000100:00100000:2.0:1787096540.367136:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360234752 00000100:00100000:0.0:1787096540.367140:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1787096540.367158:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096540.367161:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787096540.367165:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3627:x1873906360234368:12345-0@lo:400:kworker.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096540.367173:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787096540.367174:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906360235008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096540.367179:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787096540.367194:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1873906360235520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.367212:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360235392 00000100:00100000:3.0:1787096540.367217:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360235392 00000100:00100000:0.0:1787096540.367227:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1873906360235008:12345-0@lo:400:kworker.0 Request processed in 58us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096540.367234:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787096540.367250:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1873906360235520:12345-0@lo:400:kworker.0 Request processed in 58us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096540.367253:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360235904 00000100:00100000:0.0:1787096540.367254:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787096540.367258:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360235904 00000100:00100000:2.0:1787096540.367267:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787096540.367271:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1873906360235136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096540.367287:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787096540.367290:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360235264 00000100:00100000:3.0:1787096540.367292:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360235264 00000100:00100000:1.0:1787096540.367295:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360235776:0@lo:400:kworker.0 00000100:00100000:2.0:1787096540.367298:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1873906360235648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.367314:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1873906360235136:12345-0@lo:400:kworker.0 Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096540.367317:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787096540.367324:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787096540.367329:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360235392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.367344:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096540.367346:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787096540.367349:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1873906360235648:12345-0@lo:400:kworker.0 Request processed in 55us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096540.367355:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787096540.367359:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1873906360234752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.367377:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360234240 00000100:00100000:3.0:1787096540.367378:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360235392:12345-0@lo:400:kworker.0 Request processed in 52us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096540.367381:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360234240 00000100:00100000:2.0:1787096540.367383:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360234624 00000100:00100000:2.0:1787096540.367387:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360234624 00000100:00100000:3.0:1787096540.367416:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787096540.367434:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360235776 00000100:00100000:0.0:1787096540.367436:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1873906360234752:12345-0@lo:400:kworker.0 Request processed in 80us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096540.367437:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787096540.367438:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360235776 00000100:00100000:2.0:1787096540.367445:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360234880 00000100:00100000:1.0:1787096540.367451:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1873906360234240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096540.367451:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787096540.367452:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360234880 00000100:00100000:3.0:1787096540.367458:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00002000:00000024:1.0:1787096540.367465:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096540.367471:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1873906360235904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096540.367489:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787096540.367500:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360234624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.367505:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1873906360234240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096540.367508:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787096540.367520:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1873906360235904:12345-0@lo:400:kworker.0 Request processed in 52us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096540.367520:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360234880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.367522:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787096540.367534:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787096540.367550:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360234624:12345-0@lo:400:kworker.0 Request processed in 52us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096540.367557:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787096540.367561:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787096540.367565:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360234880:12345-0@lo:400:kworker.0 Request processed in 48us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096540.367566:0:9444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787096540.367572:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360235264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.367576:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787096540.367580:0:9444:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75a68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360235776:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787096540.367600:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787096540.367604:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787096540.367606:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787096540.367609:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096540.367631:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360235264:12345-0@lo:400:kworker.0 Request processed in 64us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096540.367635:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1873906360234496:0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.367638:0:9444:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75a68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360235776:12345-0@lo:400:kworker.0 Request processed in 59us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096540.367643:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3627:1873906360234368:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.367644:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787096540.367652:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1873906360235008:0@lo:400:kworker.0 00000100:00100000:1.0:1787096540.367657:0:9444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787096540.367672:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360234880:0@lo:400:kworker.0 00000100:00100000:0.0:1787096540.367672:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1873906360235520:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.367714:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1873906360234752:0@lo:400:kworker.0 00000100:00100000:2.0:1787096540.367718:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360235392:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.367737:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360235264:0@lo:400:kworker.0 00010000:00080000:2.0:1787096540.367743:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d506fd180 x1873906360235904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096540.367749:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360234624:0@lo:400:kworker.0 00010000:00080000:3.0:1787096540.367759:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d506ffb80 x1873906360235776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096540.367762:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360235904:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.367777:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360235776:0@lo:400:kworker.0 00010000:00080000:0.0:1787096540.367777:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d506fce00 x1873906360235136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787096540.367801:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d7485a680 x1873906360234240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096540.367805:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1873906360235136:0@lo:400:kworker.0 00000100:00100000:3.0:1787096540.367825:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7485a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360234240:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787096540.367836:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d506fdc00 x1873906360235648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096540.367847:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1873906360235648:0@lo:400:kworker.0 00000001:02000400:0.0:1787096540.764064:0:20716:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28b needs >= 8 OSTs 00010000:00010000:3.0:1787096540.878601:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096541.322037:0:20764:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28c: test that reading past parity data returns zeros ========================================================== 19:42:21 (1787096541) 00000100:00100000:2.0:1787096541.391547:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7485b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360236032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787096541.391609:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096541.391654:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360236032 00000100:00100000:0.0:1787096541.391663:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360236032 00000100:00100000:0.0:1787096541.391710:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787096541.391720:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360236032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787096541.391752:0:7723:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787096541.391798:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1873906360236032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096541.391806:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787096541.391824:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7485b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360236032:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1787096541.834828:0:20812:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28c needs >= 8 OSTs 00010000:00010000:3.0:1787096541.903506:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096542.400518:0:20860:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31b: test that size of parity mirror is 1*2*1M ========================================================== 19:42:22 (1787096542) 00000001:02000400:3.0:1787096542.913780:0:20908:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31b needs >= 8 OSTs 00000100:00100000:1.0:1787096542.926546:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096542.926566:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5129d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360236160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787096542.926631:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787096542.926686:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096542.926709:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360236160 00000100:00100000:0.0:1787096542.926717:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360236160 00000100:00100000:0.0:1787096542.926777:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787096542.926787:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360236160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787096542.926817:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096542.926861:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360236160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096542.926868:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787096542.926925:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5129d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360236160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096542.927020:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360236288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096542.927055:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096542.927090:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360236288 00000100:00100000:0.0:1787096542.927094:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360236288 00000100:00100000:0.0:1787096542.927125:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787096542.927133:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360236288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096542.927144:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787096542.927175:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096542.927231:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360236288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096542.927237:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787096542.927289:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360236288:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787096543.506025:0:20956:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31c: test that size of parity mirror is 1*2*64k ========================================================== 19:42:23 (1787096543) 00000100:00100000:0.0:1787096543.874162:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096543.874189:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096543.874211:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096543.874213:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352830720 00000100:00100000:2.0:1787096543.874224:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352830720 00000100:00100000:3.0:1787096543.874230:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352830592 00000100:00100000:3.0:1787096543.874234:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352830592 00000100:00100000:1.0:1787096543.874260:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352830848 00000100:00100000:1.0:1787096543.874265:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352830848 00000100:00080000:0.0:1787096543.874279:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787096543.874284:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096543.874289:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 323 00000100:00100000:2.0:1787096543.874289:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00100000:3.0:1787096543.874302:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2402:x1873906352830592:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1787096543.874302:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352830720:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:1.0:1787096543.874302:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 211 00000100:00100000:1.0:1787096543.874312:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2402:x1873906352830848:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096543.874365:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2402:x1873906352830592:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096543.874365:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352830720:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 67us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096543.874370:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2402:x1873906352830848:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096543.874379:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 323 00000100:00100000:2.0:1787096543.874380:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 210 00000100:00100000:1.0:1787096543.874385:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 211 00010000:00010000:3.0:1787096543.951534:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096544.054339:0:21004:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31c needs >= 8 OSTs 00000001:02000400:3.0:1787096544.607989:0:21052:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31d: test that size of parity mirror is 1*2*64k ========================================================== 19:42:24 (1787096544) 00010000:00010000:3.0:1787096544.975529:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096544.975557:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787096544.975590:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360236416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787096544.975658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096544.975705:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360236416 00000100:00100000:0.0:1787096544.975720:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360236416 00000100:00100000:0.0:1787096544.975802:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787096544.975815:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360236416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787096544.975859:0:6485:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787096544.975983:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360236416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096544.975996:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787096544.976067:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360236416:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787096545.102645:0:21100:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31d needs >= 8 OSTs 00000100:00100000:1.0:1787096545.486584:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787096545.486607:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7485a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360236544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096545.486656:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d75983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360236672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096545.486665:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096545.486672:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3626:1873906360236800:0@lo:400:kworker.0 00000100:00100000:3.0:1787096545.486704:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096545.486719:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906360236928:0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.486724:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096545.486754:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1873906360237184:0@lo:400:kworker.0 00000100:00100000:1.0:1787096545.486759:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096545.486793:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c41e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906360237440:0@lo:400:kworker.0 00000100:00100000:3.0:1787096545.486794:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096545.486794:0:6472:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360236800 00000100:00100000:0.0:1787096545.486796:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360237312:0@lo:400:kworker.0 00000100:00100000:2.0:1787096545.486804:0:6472:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360236800 00000100:00100000:3.0:1787096545.486821:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c41e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360237696:0@lo:400:kworker.0 00000100:00100000:1.0:1787096545.486838:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096545.486844:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096545.486855:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787096545.486857:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096545.486871:0:6472:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3626:x1873906360236800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096545.486872:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5131dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906360237952:0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.486874:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7beda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360237824:0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.486926:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096545.486927:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096545.486946:0:6472:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3626:x1873906360236800:12345-0@lo:400:kworker.0 Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096545.486956:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787096545.486961:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787096545.486970:0:8359:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360237696 00000100:00100000:1.0:1787096545.486971:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360237056:0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.486975:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3626:1873906360236800:0@lo:400:kworker.0 00000100:00100000:3.0:1787096545.486977:0:8359:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360237696 00000100:00100000:2.0:1787096545.486997:0:8360:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360237824 00000100:00100000:2.0:1787096545.487009:0:8360:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360237824 00000100:00100000:0.0:1787096545.487016:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360236544 00000100:00100000:1.0:1787096545.487018:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096545.487021:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360236544 00000100:00100000:3.0:1787096545.487029:0:8359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787096545.487041:0:8359:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360237696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096545.487047:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c41e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1873906360237568:0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.487060:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360236672 00000100:00100000:2.0:1787096545.487063:0:8360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787096545.487065:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360236672 00000100:00100000:2.0:1787096545.487076:0:8360:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360237824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096545.487083:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096545.487090:0:8359:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360237696:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096545.487096:0:8359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787096545.487103:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787096545.487110:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5131fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906360238080:0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.487115:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360236544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096545.487129:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c41e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360237696:0@lo:400:kworker.0 00000100:00100000:2.0:1787096545.487135:0:8360:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360237824:12345-0@lo:400:kworker.0 Request processed in 63us (209us total) trans 0 rc 0/0 00002000:00000024:0.0:1787096545.487139:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096545.487142:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096545.487151:0:8360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787096545.487168:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360236928 00000100:00100000:3.0:1787096545.487172:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360236928 00000100:00100000:2.0:1787096545.487187:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360237184 00000100:00100000:2.0:1787096545.487192:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360237184 00000100:00100000:0.0:1787096545.487194:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360236544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096545.487198:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360237440 00000100:00100000:1.0:1787096545.487200:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360237312 00000100:00100000:3.0:1787096545.487202:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360237440 00000100:00100000:1.0:1787096545.487204:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360237312 00000100:00100000:0.0:1787096545.487205:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787096545.487220:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360237952 00000100:00100000:2.0:1787096545.487224:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360237952 00000100:00100000:3.0:1787096545.487228:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360237568 00000100:00100000:0.0:1787096545.487231:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787096545.487233:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360237568 00000100:00100000:0.0:1787096545.487241:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360236672:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096545.487243:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360237056 00000100:00100000:1.0:1787096545.487248:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360237056 00000100:00100000:2.0:1787096545.487253:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360238080 00002000:00000024:0.0:1787096545.487253:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096545.487257:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360238080 00000100:00100000:3.0:1787096545.487261:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787096545.487272:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906360236928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096545.487284:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787096545.487289:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360236672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096545.487290:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787096545.487298:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360237312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.487298:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787096545.487304:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1873906360237184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096545.487318:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906360236928:12345-0@lo:400:kworker.0 Request processed in 48us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096545.487322:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787096545.487331:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787096545.487332:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906360237440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096545.487357:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787096545.487358:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1873906360237184:12345-0@lo:400:kworker.0 Request processed in 54us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096545.487358:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360237312:12345-0@lo:400:kworker.0 Request processed in 62us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096545.487366:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906360237952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096545.487370:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787096545.487371:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906360237440:12345-0@lo:400:kworker.0 Request processed in 40us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096545.487385:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787096545.487385:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787096545.487425:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906360237952:12345-0@lo:400:kworker.0 Request processed in 61us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096545.487428:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787096545.487439:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787096545.487439:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787096545.487440:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1873906360237568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.487449:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787096545.487454:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360237056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.487460:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906360238080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096545.487493:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1873906360237568:12345-0@lo:400:kworker.0 Request processed in 56us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096545.487500:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787096545.487505:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360237056:12345-0@lo:400:kworker.0 Request processed in 55us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096545.487506:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1873906360238080:12345-0@lo:400:kworker.0 Request processed in 50us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096545.487516:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787096545.487520:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:0.0:1787096545.487547:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787096545.487550:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787096545.487552:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787096545.487553:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787096545.487582:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360237056:0@lo:400:kworker.0 00000100:00100000:0.0:1787096545.487597:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1873906360237184:0@lo:400:kworker.0 00010000:00080000:1.0:1787096545.487601:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9c41e6ed80 x1873906360237568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096545.487611:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c41e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1873906360237568:0@lo:400:kworker.0 00000100:00100000:2.0:1787096545.487616:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360237312:0@lo:400:kworker.0 00010000:00080000:0.0:1787096545.487617:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d75983480 x1873906360236672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096545.487635:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d75983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360236672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787096545.487641:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7beda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360237824:0@lo:400:kworker.0 00010000:00080000:1.0:1787096545.487646:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d5131fb80 x1873906360238080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096545.487656:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5131fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1873906360238080:0@lo:400:kworker.0 00000100:00100000:1.0:1787096545.487668:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c41e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906360237440:0@lo:400:kworker.0 00000100:00100000:1.0:1787096545.487676:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5131dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906360237952:0@lo:400:kworker.0 00000100:00100000:1.0:1787096545.487684:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906360236928:0@lo:400:kworker.0 00010000:00080000:1.0:1787096545.487691:0:3627:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d7485a300 x1873906360236544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096545.487702:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7485a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360236544:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787096545.704646:0:21148:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 30d: test that size of parity mirror is 22*64k ========================================================== 19:42:26 (1787096546) 00010000:00010000:0.0:1787096545.999693:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096546.240523:0:21196:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_30d needs >= 8 OSTs 00000100:00100000:1.0:1787096546.510565:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096546.510599:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360238208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787096546.510664:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096546.510703:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360238208 00000100:00100000:3.0:1787096546.510712:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360238208 00000100:00100000:3.0:1787096546.510849:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787096546.510862:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360238208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787096546.511068:0:6484:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787096546.511122:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360238208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 264us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096546.511130:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787096546.511169:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7483a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360238208:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787096546.822435:0:21245:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21a: migrate plain file to EC layout === 19:42:27 (1787096547) 00010000:00010000:3.0:1787096547.022619:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096547.334141:0:21293:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21a needs >= 3 OSTs 00000001:02000400:1.0:1787096547.883082:0:21341:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21b: migrate EC file to plain layout === 19:42:28 (1787096548) 00000100:00100000:1.0:1787096548.046535:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787096548.046556:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5129d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360238336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096548.046560:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5131c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360238464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096548.046621:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096548.046668:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096548.046669:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096548.046680:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360238464 00000100:00100000:0.0:1787096548.046689:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360238464 00000100:00100000:1.0:1787096548.046690:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360238336 00000100:00100000:1.0:1787096548.046695:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360238336 00000100:00080000:2.0:1787096548.046747:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096548.046753:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787096548.046761:0:16634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787096548.046766:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5131dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360238464:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096548.046775:0:16634:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360238336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787096548.046795:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787096548.046798:0:16634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787096548.046855:0:16634:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360238336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096548.046858:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5131dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360238464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096548.046882:0:16634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787096548.046891:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787096548.046899:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5129d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360238336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787096548.046899:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5131c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360238464:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787096548.367216:0:21389:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21b needs >= 3 OSTs 00000001:02000400:0.0:1787096548.917674:0:21437:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21c: migrate between different EC configurations ========================================================== 19:42:29 (1787096549) 00000100:00100000:1.0:1787096548.994214:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096548.994246:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096548.994267:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352830976 00000100:00100000:3.0:1787096548.994281:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352830976 00000100:00100000:1.0:1787096548.994281:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096548.994312:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352831232 00000100:00100000:2.0:1787096548.994330:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352831232 00000100:00100000:0.0:1787096548.994333:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352831104 00000100:00100000:0.0:1787096548.994340:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352831104 00000100:00100000:3.0:1787096548.994363:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 325 00000100:00100000:3.0:1787096548.994377:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2401:x1873906352830976:12345-192.168.203.27@tcp:400:kworker.0 00000100:00080000:1.0:1787096548.994387:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787096548.994434:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787096548.994446:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 218 00000100:00100000:0.0:1787096548.994457:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 219 00000100:00100000:2.0:1787096548.994464:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352831232:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:0.0:1787096548.994472:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352831104:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096548.994542:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2401:x1873906352830976:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 162us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096548.994543:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352831104:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096548.994548:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352831232:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 80us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096548.994585:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 325 00000100:00100000:0.0:1787096548.994585:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 219 00000100:00100000:2.0:1787096548.994601:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 218 00010000:00010000:3.0:1787096549.070605:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096549.415206:0:21485:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21c needs >= 4 OSTs 00000001:02000400:0.0:1787096549.965881:0:21533:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21d: migrate PFL file to EC layout ===== 19:42:30 (1787096550) 00010000:00010000:0.0:1787096550.094543:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096550.094559:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787096550.094580:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5131c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360238592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787096550.094640:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096550.094799:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360238592 00000100:00100000:2.0:1787096550.094808:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360238592 00000100:00100000:2.0:1787096550.094866:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787096550.094877:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360238592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787096550.094919:0:6485:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787096550.094976:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1873906360238592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096550.094984:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787096550.095311:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5131c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360238592:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1787096550.490243:0:21581:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21d needs >= 3 OSTs 00000100:00100000:3.0:1787096550.606588:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360238720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096550.606592:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5131c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3626:1873906360238976:0@lo:400:kworker.0 00000100:00100000:0.0:1787096550.606610:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7beda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906360239104:0@lo:400:kworker.0 00000100:00100000:1.0:1787096550.606673:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096550.606676:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096550.606676:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096550.606679:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d57c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360239232:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.606723:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096550.606731:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d5131fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360238848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096550.606738:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7bf42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360239488:0@lo:400:kworker.0 00000100:00100000:0.0:1787096550.606740:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7bf40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906360239616:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.606752:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1873906360239744:0@lo:400:kworker.0 00000100:00100000:3.0:1787096550.606766:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096550.606778:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096550.606784:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096550.606803:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7bf42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1873906360239360:0@lo:400:kworker.0 00000100:00100000:1.0:1787096550.606803:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360240000:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.606804:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360239232 00000100:00100000:2.0:1787096550.606811:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360239232 00000100:00100000:0.0:1787096550.606816:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906360240128:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.606848:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360239488 00000100:00100000:2.0:1787096550.606862:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360239488 00000100:00100000:1.0:1787096550.606865:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096550.606873:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096550.606874:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360239104 00000100:00100000:0.0:1787096550.606879:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360239104 00000100:00100000:1.0:1787096550.606889:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360240512:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.606899:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787096550.606914:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096550.606920:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360239872:0@lo:400:kworker.0 00000100:00100000:0.0:1787096550.606921:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360239616 00000100:00100000:2.0:1787096550.606927:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360239232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096550.606927:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360239616 00000100:00100000:1.0:1787096550.606943:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360238976 00000100:00100000:1.0:1787096550.606947:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360238976 00000100:00100000:3.0:1787096550.606970:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096550.606981:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360239360 00000100:00100000:1.0:1787096550.606985:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787096550.606986:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360239360 00000100:00100000:2.0:1787096550.606997:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360239232:12345-0@lo:400:kworker.0 Request processed in 74us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096550.606997:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3626:x1873906360238976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096550.607002:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360240384:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.607011:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787096550.607018:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787096550.607029:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906360239104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.607035:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787096550.607043:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9+23:3626:x1873906360238976:12345-0@lo:400:kworker.0 Request processed in 50us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096550.607048:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096550.607048:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5129d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360239488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096550.607055:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1787096550.607083:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1873906360239104:12345-0@lo:400:kworker.0 Request processed in 56us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096550.607093:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360240000 00000100:00100000:1.0:1787096550.607097:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360240000 00000100:00100000:0.0:1787096550.607098:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787096550.607116:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5129d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360239488:12345-0@lo:400:kworker.0 Request processed in 71us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096550.607120:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360238720 00000100:00100000:3.0:1787096550.607126:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360238720 00000100:00100000:2.0:1787096550.607126:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787096550.607126:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787096550.607134:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360240512 00000100:00100000:1.0:1787096550.607138:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360240512 00000100:00100000:0.0:1787096550.607142:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7483b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906360239616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096550.607157:0:9444:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360239872 00000100:00100000:2.0:1787096550.607160:0:8580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360240384 00000100:00100000:1.0:1787096550.607160:0:9444:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360239872 00000100:00100000:2.0:1787096550.607165:0:8580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360240384 00000100:00100000:3.0:1787096550.607184:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360238848 00000100:00100000:0.0:1787096550.607186:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7483b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1873906360239616:12345-0@lo:400:kworker.0 Request processed in 48us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096550.607189:0:9444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787096550.607190:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360238848 00000100:00100000:2.0:1787096550.607197:0:8580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787096550.607200:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787096550.607202:0:9444:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360240000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.607208:0:8580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3626:x1873906360240512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096550.607222:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787096550.607227:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787096550.607233:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1873906360239360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096550.607240:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1873906360238720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096550.607244:0:9444:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360240000:12345-0@lo:400:kworker.0 Request processed in 45us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096550.607249:0:8580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42ebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3626:x1873906360240512:12345-0@lo:400:kworker.0 Request processed in 44us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096550.607253:0:8580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787096550.607264:0:9444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00002000:00000024:3.0:1787096550.607271:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096550.607273:0:8580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787096550.607282:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1873906360239360:12345-0@lo:400:kworker.0 Request processed in 51us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096550.607283:0:9444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787096550.607285:0:8580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360239872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096550.607295:0:9444:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3625:x1873906360240384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096550.607300:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787096550.607328:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1873906360238720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (659us total) trans 0 rc 0/0 00000100:00080000:0.0:1787096550.607334:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787096550.607338:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787096550.607341:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096550.607343:0:8580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360239872:12345-0@lo:400:kworker.0 Request processed in 60us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096550.607347:0:9444:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3625:x1873906360240384:12345-0@lo:400:kworker.0 Request processed in 53us (301us total) trans 0 rc 0/0 00000100:00080000:0.0:1787096550.607347:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096550.607352:0:8580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787096550.607360:0:9444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787096550.607365:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787096550.607372:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096550.607376:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360238848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787096550.607386:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096550.607415:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360239744 00000100:00100000:2.0:1787096550.607418:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360239744 00000100:00100000:0.0:1787096550.607423:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1873906360240256:0@lo:400:kworker.0 00000100:00100000:1.0:1787096550.607437:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7bf42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360239488:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.607450:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787096550.607460:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360240000:0@lo:400:kworker.0 00000100:00100000:3.0:1787096550.607461:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1873906360238848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096550.607461:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1873906360239744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096550.607467:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096550.607479:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1787096550.607486:0:3626:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d6e98f800 x1873906360240512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096550.607498:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360240512:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.607509:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1873906360239744:12345-0@lo:400:kworker.0 Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096550.607517:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d57c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360239232:0@lo:400:kworker.0 00000100:00100000:1.0:1787096550.607523:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5131c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c5d2cd96-65e0-4b21-8db1-aba8f8fcbae9:3626:1873906360238976:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.607529:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787096550.607538:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7bf42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1873906360239360:0@lo:400:kworker.0 00010000:00080000:0.0:1787096550.607541:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9c42f9a680 x1873906360239744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096550.607549:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360240256 00000100:00100000:2.0:1787096550.607553:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360240256 00000100:00100000:0.0:1787096550.607554:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1873906360239744:0@lo:400:kworker.0 00000100:00100000:3.0:1787096550.607561:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360239872:0@lo:400:kworker.0 00010000:00080000:3.0:1787096550.607580:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9c42f9aa00 x1873906360240384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096550.607593:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360240384:0@lo:400:kworker.0 00000100:00100000:1.0:1787096550.607593:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787096550.607604:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1873906360240256:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787096550.607610:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d7483ad80 x1873906360238720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787096550.607627:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787096550.607633:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7483ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360238720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096550.607640:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1873906360240256:12345-0@lo:400:kworker.0 Request processed in 38us (177us total) trans 0 rc 0/0 00010000:00080000:3.0:1787096550.607652:0:3625:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9d5131fb80 x1873906360238848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096550.607653:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787096550.607658:0:3628:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c9c42f9ad80 x1873906360240256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787096566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096550.607662:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787096550.607682:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1873906360240256:0@lo:400:kworker.0 00000100:00100000:2.0:1787096550.607684:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7beda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1873906360239104:0@lo:400:kworker.0 00000100:00100000:3.0:1787096550.607685:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d5131fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360238848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787096550.607686:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360240128 00000100:00100000:1.0:1787096550.607691:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360240128 00000100:00100000:2.0:1787096550.607707:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7bf40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1873906360239616:0@lo:400:kworker.0 00000100:00100000:0.0:1787096550.607732:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787096550.607743:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906360240128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787096550.607756:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096550.607786:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1873906360240128:12345-0@lo:400:kworker.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096550.607793:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787096550.607818:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1873906360240128:0@lo:400:kworker.0 00000001:02000400:2.0:1787096551.082122:0:21629:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22a: mirror split removes plain mirror, keeps EC ========================================================== 19:42:31 (1787096551) 00010000:00010000:3.0:1787096551.118526:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096551.570207:0:21677:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22a needs >= 6 OSTs 00000100:00100000:2.0:1787096551.630541:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360240640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787096551.630605:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096551.630650:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360240640 00000100:00100000:1.0:1787096551.630659:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360240640 00000100:00100000:1.0:1787096551.630706:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787096551.630715:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7beda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360240640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787096551.630750:0:7409:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787096551.630801:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7beda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360240640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096551.630808:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787096551.630829:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360240640:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787096552.137520:0:21725:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 23a: truncate EC file to smaller size == 19:42:32 (1787096552) 00010000:00010000:2.0:1787096552.143506:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096552.189658:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096552.189701:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352831360 00000100:00100000:2.0:1787096552.189711:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352831360 00000100:00080000:1.0:1787096552.189764:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096552.189790:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:2.0:1787096552.189801:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:33691:x1873906352831360:12345-192.168.203.27@tcp:41:stat.0 00000004:00000024:2.0:1787096552.189866:0:6481:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787096552.189948:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:33691:x1873906352831360:12345-192.168.203.27@tcp:41:stat.0 Request processed in 150us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096552.189956:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 143 00000100:00100000:3.0:1787096552.205936:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096552.205990:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352831488 00000100:00100000:2.0:1787096552.206000:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352831488 00000100:00100000:2.0:1787096552.206063:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00100000:2.0:1787096552.206085:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:33696:x1873906352831488:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096552.206106:0:18819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096552.206129:0:18819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43bba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6bc9 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.206190:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.206205:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.206219:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096552.206256:0:18819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096552.206258:0:18819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096552.206273:0:18819:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.206291:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43bba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc9 expref: 7 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.206302:0:18819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc9 expref: 6 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.206308:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55f00) 00010000:00010000:2.0:1787096552.206310:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096552.206312:0:18819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4aa00, rc 0) 00000100:00100000:2.0:1787096552.206354:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:33696:x1873906352831488:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 273us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096552.206366:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 144 00000100:00100000:0.0:1787096552.208103:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096552.208154:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352831616 00000100:00100000:1.0:1787096552.208162:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352831616 00000100:00100000:1.0:1787096552.208203:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00100000:1.0:1787096552.208214:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:33696:x1873906352831616:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096552.208229:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096552.208242:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43bc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6bd0 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208283:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208294:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208316:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208372:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208381:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208387:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208437:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208445:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208452:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208459:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cee00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096552.208462:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208469:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208480:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55f00) 00010000:00010000:1.0:1787096552.208483:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096552.208487:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208498:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208510:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208516:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208521:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208526:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cfc00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096552.208530:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208536:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208543:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff9c9c41286b00) 00010000:00010000:1.0:1787096552.208546:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096552.208548:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208554:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfc00/0x1b9fb40e15b43bd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208580:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43bc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bd0 expref: 7 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208606:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55f00) 00010000:00010000:1.0:1787096552.208608:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096552.208612:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43bc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bd0 expref: 7 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.208620:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cea00, rc 0) 00000100:00100000:1.0:1787096552.208672:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7483bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:33696:x1873906352831616:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 458us (571us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096552.208680:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 145 00000100:00100000:0.0:1787096552.210679:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096552.210718:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352831744 00000100:00100000:2.0:1787096552.210726:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352831744 00000100:00080000:1.0:1787096552.210768:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787096552.210789:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:2.0:1787096552.210798:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7483a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:33696:x1873906352831744:12345-192.168.203.27@tcp:700:lfs.0 00000100:00100000:2.0:1787096552.210872:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7483a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:33696:x1873906352831744:12345-192.168.203.27@tcp:700:lfs.0 Request processed in 76us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096552.210879:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 3 00000100:00100000:3.0:1787096552.211669:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096552.211767:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352832000 00000100:00100000:0.0:1787096552.211777:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352832000 00000100:00100000:0.0:1787096552.211833:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 146 00000100:00100000:0.0:1787096552.211855:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:33696:x1873906352832000:12345-192.168.203.27@tcp:36:lfs.0 00000004:00080000:2.0:1787096552.212650:0:9995:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 737us 00000100:00100000:3.0:1787096552.218688:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:9995:1873906360240768:0@lo:900:mdt00_004.0 00000100:00100000:3.0:1787096552.218761:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096552.218802:0:6491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360240768 00000100:00100000:3.0:1787096552.218809:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41dad780 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.218812:0:6491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360240768 00000100:00100000:1.0:1787096552.218887:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787096552.218913:0:6491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9995:x1873906360240768:12345-0@lo:900:mdt00_004.0 00000100:00100000:1.0:1787096552.218971:0:6491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9995:x1873906360240768:12345-0@lo:900:mdt00_004.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096552.218978:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787096552.219004:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID:9995:1873906360240768:0@lo:900:mdt00_004.0 00000100:00100000:3.0:1787096552.219071:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360240896:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096552.219105:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096552.219127:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41dad000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.219138:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360240896 00000100:00100000:1.0:1787096552.219143:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360240896 00000100:00100000:1.0:1787096552.219184:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787096552.219191:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:9995:x1873906360240896:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096552.219244:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:9995:x1873906360240896:12345-0@lo:1000:mdt00_004.0 Request processed in 55us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096552.219250:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787096552.219267:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360240896:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096552.219312:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241024:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096552.219337:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096552.219359:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41dad000 going to sleep for 11 seconds 00000100:00100000:2.0:1787096552.219373:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360241024 00000100:00100000:2.0:1787096552.219378:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360241024 00000100:00100000:2.0:1787096552.219446:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787096552.219453:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c41e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:9995:x1873906360241024:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.219514:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c41e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:9995:x1873906360241024:12345-0@lo:1000:mdt00_004.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096552.219521:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787096552.219543:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d506ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241024:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096552.219575:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c41e6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241152:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096552.219596:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096552.219614:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41dad000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.219617:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360241152 00000100:00100000:1.0:1787096552.219628:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360241152 00000100:00100000:1.0:1787096552.219652:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787096552.219657:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c41e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:9995:x1873906360241152:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096552.219725:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c41e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+5:9995:x1873906360241152:12345-0@lo:1000:mdt00_004.0 Request processed in 66us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787096552.219733:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787096552.219742:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c41e6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241152:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787096552.219793:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.219804:0:9995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.219814:0:9995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096552.219824:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c41e6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241280:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787096552.219856:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096552.219869:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41dad780 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.219875:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360241280 00000100:00100000:1.0:1787096552.219878:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360241280 00000100:00100000:1.0:1787096552.219900:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787096552.219904:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d506ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:9995:x1873906360241280:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787096552.219911:0:7409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096552.219925:0:7409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43be4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b43bdd expref: -99 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.219948:0:7409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc9 expref: 5 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.219956:0:7409:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43be4 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b43bdd expref: 6 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.219973:0:7409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc9 expref: 5 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.219982:0:7409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc9 expref: 5 pid: 18819 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096552.219990:0:7409:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ebd180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7409:1873906360241408:192.168.203.27@tcp:104: 00000100:00100000:1.0:1787096552.220058:0:7409:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.221118:0:7409:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ebd180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7409:1873906360241408:192.168.203.27@tcp:104: 00010000:00010000:1.0:1787096552.221135:0:7409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43be4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b43bdd expref: 6 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.221145:0:7409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55f00) 00010000:00010000:1.0:1787096552.221149:0:7409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096552.221152:0:7409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43be4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b43bdd expref: 6 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.221161:0:7409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cea00, rc 0) 00000100:00100000:1.0:1787096552.221197:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:9995:x1873906360241280:12345-0@lo:101:mdt00_004.0 Request processed in 1292us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096552.221205:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787096552.221282:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c41e6ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241280:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787096552.221300:0:9995:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.221307:0:9995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096552.221345:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096552.221430:0:6466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352832128 00000100:00100000:2.0:1787096552.221436:0:6466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352832128 00010000:00010000:2.0:1787096552.221460:0:6466:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc9 expref: 6 pid: 18819 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096552.221490:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:2.0:1787096552.221498:0:6466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d62799050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2402:x1873906352832128:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096552.221510:0:6466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096552.221519:0:6466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc9 expref: 6 pid: 18819 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.221534:0:6466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc9 expref: 6 pid: 18819 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.221550:0:6466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43bc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bc9 expref: 6 pid: 18819 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.221560:0:6466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55f00) 00010000:00010000:2.0:1787096552.221563:0:6466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43be4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b43bdd expref: 5 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.221569:0:6466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43be4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b43bdd expref: 5 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.221575:0:6466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43be4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b43bdd expref: 5 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.221603:0:6466:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43be4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b43bdd expref: 5 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096552.221614:0:6466:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6466:1873906360241536:0@lo:105: 00000100:00100000:2.0:1787096552.221645:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.221670:0:6466:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42a4ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787096552.221677:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360241536 00000100:00100000:3.0:1787096552.221681:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360241536 00000100:00100000:3.0:1787096552.221709:0:8375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787096552.221714:0:8375:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6466:x1873906360241536:12345-0@lo:105: 00010000:00010000:3.0:1787096552.221722:0:8375:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.221735:0:8375:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.221750:0:8375:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.221761:0:8375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.221768:0:8375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.221782:0:8375:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.221801:0:8375:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c9d6eac2400) 00010000:00010000:2.0:1787096552.221822:0:9995:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.221831:0:9995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096552.221835:0:8375:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6466:x1873906360241536:12345-0@lo:105: Request processed in 119us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096552.221857:0:8375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787096552.221865:0:6466:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6466:1873906360241536:0@lo:105: 00000004:00080000:2.0:1787096552.221871:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787096552.221883:0:6466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096552.221896:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.221903:0:9995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.221908:0:9995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096552.221913:0:6466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d62799050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2402:x1873906352832128:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 417us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096552.221921:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 59 00000100:00100000:2.0:1787096552.221923:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241664:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787096552.221962:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.221985:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42a4ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096552.221991:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360241664 00000100:00100000:3.0:1787096552.221996:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360241664 00000100:00100000:3.0:1787096552.222022:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787096552.222027:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:9995:x1873906360241664:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787096552.222067:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096552.222078:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bf2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b43beb expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.222090:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b43beb expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.222105:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b43beb expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.222110:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff9c9d6b3f0e00) 00010000:00010000:3.0:1787096552.222112:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096552.222113:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2c00, rc 0) 00000100:00100000:3.0:1787096552.222136:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360241664:12345-0@lo:101:mdt00_004.0 Request processed in 109us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096552.222139:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787096552.222158:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241664:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787096552.222166:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.222173:0:9995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096552.222182:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787096552.222201:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241792:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.222220:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.222236:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42a4a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787096552.222253:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360241792 00000100:00100000:0.0:1787096552.222257:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360241792 00000100:00100000:0.0:1787096552.222279:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787096552.222283:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360241792:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787096552.222342:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360241792:12345-0@lo:1000:mdt00_004.0 Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096552.222350:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787096552.222372:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241792:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.222442:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241920:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.222478:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.222502:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42a4a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.222521:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360241920 00000100:00100000:1.0:1787096552.222527:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360241920 00000100:00100000:1.0:1787096552.222567:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787096552.222577:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360241920:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096552.222647:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360241920:12345-0@lo:1000:mdt00_004.0 Request processed in 73us (168us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787096552.222656:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787096552.222673:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360241920:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.222736:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360242048:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.222756:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.222774:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42a4a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.222789:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360242048 00000100:00100000:1.0:1787096552.222792:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360242048 00000100:00100000:1.0:1787096552.222815:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787096552.222820:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360242048:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096552.222876:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360242048:12345-0@lo:1000:mdt00_004.0 Request processed in 55us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787096552.222889:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787096552.222893:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360242048:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.222938:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360242176:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.222961:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.222978:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42a4a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787096552.223006:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360242176 00000100:00100000:3.0:1787096552.223012:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360242176 00000100:00100000:3.0:1787096552.223054:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787096552.223062:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360242176:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787096552.223120:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c41e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360242176:12345-0@lo:1000:mdt00_004.0 Request processed in 59us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096552.223128:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787096552.223137:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360242176:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.223175:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360242304:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.223194:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.223212:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42a4a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787096552.223234:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360242304 00000100:00100000:0.0:1787096552.223238:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360242304 00000100:00100000:0.0:1787096552.223264:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787096552.223271:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360242304:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787096552.223328:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360242304:12345-0@lo:1000:mdt00_004.0 Request processed in 57us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096552.223335:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787096552.223347:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360242304:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.223379:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42fa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360242432:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787096552.223426:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.223442:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42a4a180 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.223448:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360242432 00000100:00100000:1.0:1787096552.223453:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360242432 00000100:00100000:1.0:1787096552.223484:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787096552.223491:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360242432:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787096552.223542:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:9995:x1873906360242432:12345-0@lo:1000:mdt00_004.0 Request processed in 52us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096552.223550:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787096552.223558:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42fa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360242432:0@lo:1000:mdt00_004.0 00000040:00080000:2.0:1787096552.223762:0:9995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787096552.223815:0:9995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].1, 64 off32832 00000004:00080000:2.0:1787096552.223823:0:9995:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42a4a540 with version 2 00000004:00080000:0.0:1787096552.223859:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 2 rpc_version 2 00000020:00100000:0.0:1787096552.223883:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096552.223889:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d74839180 x1873906360242688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:2.0:1787096552.223898:0:9995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787096552.223901:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74839180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360242688:0@lo:1000:osp_up0-1.0 00000040:00080000:2.0:1787096552.223916:0:9995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x1:0x0].2, 64 off32896 00000004:00080000:2.0:1787096552.223921:0:9995:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42a4a900 with version 3 00000100:00100000:0.0:1787096552.223935:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096552.223953:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d32840 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.223968:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360242688 00000100:00100000:1.0:1787096552.223974:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360242688 00000100:00100000:1.0:1787096552.224004:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787096552.224013:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360242688:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:2.0:1787096552.224862:0:9995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787096552.225066:0:9995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x1:0x0].1, 64 off32832 00000040:00080000:2.0:1787096552.225225:0:9995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].1, 2152 off34920 00000040:00080000:2.0:1787096552.225322:0:9995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].1, 2352 off35120 00000004:00080000:2.0:1787096552.225328:0:9995:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42a4ac00 with version 4 00000001:00080000:2.0:1787096552.228250:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000100:00100000:1.0:1787096552.228473:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360242688:12345-0@lo:1000:osp_up0-1.0 Request processed in 4456us (4531us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1787096552.228485:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000004:00080000:0.0:1787096552.228495:0:7407:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967356 committed transno 4294967356 00000100:00100000:0.0:1787096552.228500:0:7407:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967356 gen 2 00000100:00100000:0.0:1787096552.228521:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74839180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360242688:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787096552.228571:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 3 rpc_version 3 00000020:00100000:0.0:1787096552.228598:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096552.228605:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d74839180 x1873906360242944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096552.228636:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74839180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360242944:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096552.228674:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096552.228699:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d32000 going to sleep for 11 seconds 00000100:00100000:3.0:1787096552.228726:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360242944 00000100:00100000:3.0:1787096552.228735:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360242944 00000100:00100000:3.0:1787096552.228793:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787096552.228805:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360242944:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1787096552.232049:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000100:00100000:3.0:1787096552.232191:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360242944:12345-0@lo:1000:osp_up0-1.0 Request processed in 3385us (3511us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1787096552.232203:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000004:00080000:0.0:1787096552.232212:0:7407:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967357 committed transno 4294967357 00000100:00100000:0.0:1787096552.232218:0:7407:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967357 gen 2 00000100:00100000:0.0:1787096552.232239:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74839180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360242944:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787096552.232269:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 4 rpc_version 4 00000020:00100000:0.0:1787096552.232297:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096552.232303:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d74839180 x1873906360243200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096552.232325:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d74839180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360243200:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096552.232378:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.232431:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360243200 00000100:00100000:2.0:1787096552.232438:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360243200 00000100:00100000:0.0:1787096552.232457:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d32840 going to sleep for 11 seconds 00000100:00100000:2.0:1787096552.232477:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787096552.232484:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7407:x1873906360243200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096552.233450:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7407:x1873906360243200:12345-0@lo:1000:osp_up0-1.0 Request processed in 960us (1065us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1787096552.233466:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787096552.233507:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d74839180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360243200:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787096552.233744:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.233771:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.233787:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.233811:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.233818:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.233825:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.233872:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.233880:0:9995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.233890:0:9995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096552.233912:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7dad5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360243328:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787096552.233949:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096552.233993:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41dad780 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.234005:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360243328 00000100:00100000:1.0:1787096552.234012:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360243328 00000100:00100000:1.0:1787096552.234067:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787096552.234077:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7dad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:9995:x1873906360243328:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787096552.234093:0:7723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096552.234120:0:7723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43c0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b43c07 expref: -99 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.234145:0:7723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b43c07 expref: 9 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.234158:0:7723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b43c07 expref: 9 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.234173:0:7723:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9c41286b00) 00010000:00010000:1.0:1787096552.234176:0:7723:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096552.234180:0:7723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cee00, rc 0) 00000100:00100000:1.0:1787096552.234226:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7dad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:9995:x1873906360243328:12345-0@lo:101:mdt00_004.0 Request processed in 151us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096552.234234:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787096552.234272:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7dad5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:9995:1873906360243328:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787096552.234287:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234309:0:9995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096552.234327:0:9995:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002a1226d0 reply state 000000004adaece9 transno 4294967299 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234338:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b43c00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234346:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9c9d6b3f0800) 00010000:00010000:3.0:1787096552.234349:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096552.234353:0:9995:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096552.234360:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234367:0:9995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096552.234376:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x2:0x0] 00000004:00010000:3.0:1787096552.234380:0:9995:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002a1226d0 reply state 000000004adaece9 transno 4294967299 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234388:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b43bf9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234419:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9c9d6b3f0700) 00010000:00010000:3.0:1787096552.234421:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096552.234424:0:9995:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787096552.234430:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00080000:3.0:1787096552.234438:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787096552.234456:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234464:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234470:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234491:0:9995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787096552.234496:0:9995:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787096552.234500:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234508:0:9995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.234523:0:6469:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096552.234532:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.234542:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2400 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:1.0:1787096552.234549:0:6469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096552.234559:0:6469:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.234592:0:6469:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096552.234601:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d506fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:33696:x1873906352832000:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 22755us (22936us total) trans 4294967299 rc 0/0 00010000:00010000:1.0:1787096552.234614:0:6469:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787096552.234624:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 146 00010000:00010000:1.0:1787096552.234647:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.234654:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac2400/0x1b9fb40e15b43bdd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b43be4 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096552.234670:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360243456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096552.234682:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096552.234685:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096552.234688:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096552.234706:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096552.234762:0:9435:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360243456 00000100:00100000:3.0:1787096552.234769:0:9435:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360243456 00000100:00100000:3.0:1787096552.234886:0:9435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787096552.234895:0:9435:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3628:x1873906360243456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096552.234908:0:9435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096552.234925:0:9435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b43be4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b43bdd expref: 9 pid: 7409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.234937:0:9435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41b55f00) 00010000:00010000:3.0:1787096552.234951:0:9435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096552.234982:0:9435:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3628:x1873906360243456:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096552.234990:0:9435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787096552.235013:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360243456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096552.246502:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096552.246556:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352832256 00000100:00100000:1.0:1787096552.246568:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352832256 00000100:00100000:1.0:1787096552.246623:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00100000:1.0:1787096552.246632:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:33699:x1873906352832256:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096552.246658:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096552.246679:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b43c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6bd7 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.246745:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b43c1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.246762:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b43c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.246776:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b43c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096552.246830:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787096552.246836:0:6480:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787096552.246869:0:6480:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b43c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.246890:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b43c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bd7 expref: 7 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.246904:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b43c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bd7 expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.246924:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096552.246926:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096552.246929:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cfe00, rc 0) 00000100:00100000:1.0:1787096552.246995:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:33699:x1873906352832256:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 363us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096552.247002:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 147 00000100:00100000:0.0:1787096552.248036:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096552.248099:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352832384 00000100:00100000:2.0:1787096552.248112:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352832384 00000100:00100000:2.0:1787096552.248163:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:2.0:1787096552.248173:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:33699:x1873906352832384:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096552.248189:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096552.248203:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43c23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6bde expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.248246:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.248269:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.248277:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.248285:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.248291:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b43beb expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.248296:0:6479:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.248321:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b9fb40e15b43beb expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096552.248332:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6479:1873906360243584:0@lo:104: 00000100:00100000:2.0:1787096552.248377:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096552.248430:0:6463:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787096552.248445:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360243584 00000100:00100000:0.0:1787096552.248449:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360243584 00000100:00100000:0.0:1787096552.248488:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787096552.248489:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d4568d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787096552.248499:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6479:x1873906360243584:12345-0@lo:104: 00010000:00010000:0.0:1787096552.248512:0:6463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.248576:0:6463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787096552.248583:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6479:x1873906360243584:12345-0@lo:104: Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096552.248590:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787096552.248602:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6479:1873906360243584:0@lo:104: 00010000:00010000:3.0:1787096552.248607:0:8376:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096552.248616:0:8376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.248626:0:8376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ae00 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:2.0:1787096552.248627:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.248632:0:8376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096552.248644:0:8376:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.248677:0:8376:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.248683:0:8376:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096552.248711:0:8376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.248720:0:8376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4ae00/0x1b9fb40e15b43beb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b43bf2 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096552.248738:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360243712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096552.248740:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096552.248743:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096552.248746:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096552.248777:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096552.248823:0:6467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360243712 00000100:00100000:2.0:1787096552.248828:0:6467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360243712 00010000:00010000:2.0:1787096552.248856:0:6467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b9fb40e15b43beb expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096552.248892:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787096552.248898:0:6467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3625:x1873906360243712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096552.248906:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787096552.250022:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967358 is committed 00010000:00010000:2.0:1787096552.250086:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b43bf2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b9fb40e15b43beb expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.250098:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff9c9d6b3f0e00) 00010000:00010000:2.0:1787096552.250101:0:6467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.250105:0:6467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.250109:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.250126:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096552.250168:0:6467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1873906360243712:12345-0@lo:103:ldlm_bl.0 Request processed in 1270us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096552.250175:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1787096552.250182:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250204:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096552.250213:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1873906360243712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096552.250301:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e2f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6479:1873906360243840:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787096552.250329:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096552.250346:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d32540 going to sleep for 11 seconds 00000100:00100000:1.0:1787096552.250361:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360243840 00000100:00100000:1.0:1787096552.250366:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360243840 00000100:00100000:1.0:1787096552.250428:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787096552.250437:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6479:x1873906360243840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787096552.250511:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6479:x1873906360243840:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096552.250519:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787096552.250527:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e2f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6479:1873906360243840:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787096552.250560:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43c38 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250567:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43c38 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250573:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43c38 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096552.250587:0:6479:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43c38 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250595:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250600:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250604:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250608:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096552.250610:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250620:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250626:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:0.0:1787096552.250628:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096552.250631:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250635:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b43c2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250642:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250645:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250648:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250652:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4bc00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096552.250653:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250656:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250660:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff9c9d6b3f0e00) 00010000:00010000:0.0:1787096552.250661:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096552.250663:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250672:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b43c31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250704:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b43c23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bde expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250712:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b43c38 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bde expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.250717:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9c9d6b35cc00) 00010000:00010000:0.0:1787096552.250719:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787096552.250720:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceaa00, rc 0) 00000100:00100000:0.0:1787096552.250756:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:33699:x1873906352832384:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2584us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096552.250770:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 148 00000100:00100000:0.0:1787096552.251600:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096552.251632:0:8582:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352832512 00000100:00100000:1.0:1787096552.251635:0:8582:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352832512 00000100:00100000:1.0:1787096552.251663:0:8582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:1.0:1787096552.251670:0:8582:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:33699:x1873906352832512:12345-192.168.203.27@tcp:900:lfs.0 00000100:00100000:1.0:1787096552.251714:0:8582:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:33699:x1873906352832512:12345-192.168.203.27@tcp:900:lfs.0 Request processed in 44us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096552.251721:0:8582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 7 00000100:00100000:3.0:1787096552.252339:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096552.252373:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352832640 00000100:00100000:2.0:1787096552.252378:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352832640 00000100:00100000:2.0:1787096552.252429:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 149 00000100:00100000:2.0:1787096552.252441:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7dad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:33699:x1873906352832640:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096552.252454:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096552.252465:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c3f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6be5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.252507:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b43c46 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.252515:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b43c46 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.252521:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b43c46 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096552.252587:0:6481:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096552.252590:0:6481:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096552.252613:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c3f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6be5 expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.252624:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b43c46 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6be5 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.252629:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff9c9d6b3f0700) 00010000:00010000:2.0:1787096552.252631:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787096552.252633:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4b600, rc 0) 00000100:00100000:2.0:1787096552.252669:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7dad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:33699:x1873906352832640:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 233us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096552.252673:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 149 00000100:00100000:0.0:1787096552.253485:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096552.253516:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352832768 00000100:00100000:2.0:1787096552.253519:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352832768 00000100:00100000:2.0:1787096552.253543:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 150 00000100:00100000:2.0:1787096552.253549:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7485bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:33699:x1873906352832768:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096552.253562:0:18819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096552.253571:0:18819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b43c4d lrc: 2/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6bec expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.253591:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b43c54 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.253596:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b43c54 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.253601:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b43c54 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096552.253616:0:18819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1787096552.253618:0:18819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096552.253628:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b43c4d lrc: 0/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bec expref: 10 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.253637:0:18819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b43c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bec expref: 9 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.253642:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9c9d6b3f0800) 00010000:00010000:2.0:1787096552.253644:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096552.253645:0:18819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4b800, rc 0) 00000100:00100000:2.0:1787096552.253671:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7485bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:33699:x1873906352832768:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 123us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096552.253675:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 150 00000100:00100000:0.0:1787096552.254376:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096552.254433:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352832896 00000100:00100000:1.0:1787096552.254439:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352832896 00000100:00100000:1.0:1787096552.254466:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 151 00000100:00100000:1.0:1787096552.254472:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:33699:x1873906352832896:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096552.254489:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096552.254501:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b43c5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6bf3 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.254543:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b43c62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.254554:0:7414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43c0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b43c07 expref: 5 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.254562:0:7414:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b43c62 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.254589:0:7414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b9fb40e15b43c07 expref: 5 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096552.254603:0:7414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7414:1873906360243968:0@lo:104: 00000100:00100000:1.0:1787096552.254639:0:7414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096552.254669:0:7414:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787096552.254686:0:7402:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360243968 00000100:00100000:0.0:1787096552.254691:0:7402:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360243968 00000100:00100000:0.0:1787096552.254716:0:7402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787096552.254721:0:7402:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5131fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7414:x1873906360243968:12345-0@lo:104: 00010000:00010000:0.0:1787096552.254733:0:7402:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.254790:0:7402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787096552.254795:0:7402:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5131fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7414:x1873906360243968:12345-0@lo:104: Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096552.254806:0:7402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787096552.254817:0:7414:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7414:1873906360243968:0@lo:104: 00010000:00010000:3.0:1787096552.254819:0:8377:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096552.254826:0:8377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.254833:0:7414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b43c62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.254834:0:8377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3a00 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:3.0:1787096552.254848:0:8377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096552.254857:0:8377:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.254875:0:8377:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.254879:0:8377:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096552.254896:0:8377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.254901:0:8377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b43c0e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.254917:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096552.254918:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7dad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360244096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096552.254919:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096552.254922:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096552.254949:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096552.254973:0:7855:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360244096 00000100:00100000:0.0:1787096552.254977:0:7855:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360244096 00010000:00010000:0.0:1787096552.254991:0:7855:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b9fb40e15b43c07 expref: 6 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096552.255013:0:7855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787096552.255017:0:7855:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5131c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3626:x1873906360244096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096552.255024:0:7855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096552.255328:0:7855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b43c0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b9fb40e15b43c07 expref: 6 pid: 7723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.255340:0:7855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9c41286b00) 00010000:00010000:0.0:1787096552.255345:0:7855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b43c62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.255353:0:7855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b43c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.255359:0:7855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b43c62 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096552.255380:0:7855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096552.255422:0:7414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b43c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.255428:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b43c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096552.255451:0:7855:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5131c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360244096:12345-0@lo:103:ldlm_bl.0 Request processed in 432us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096552.255460:0:7855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00200000:1.0:1787096552.255473:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1787096552.255479:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1787096552.255496:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7dad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360244096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096552.255514:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b43c5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bf3 expref: 9 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.255531:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce800/0x1b9fb40e15b43c62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bf3 expref: 8 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.255539:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9c41286b00) 00010000:00010000:1.0:1787096552.255540:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096552.255543:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce800, rc 0) 00000100:00100000:1.0:1787096552.255570:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:33699:x1873906352832896:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1100us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096552.255575:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 151 00000100:00100000:3.0:1787096552.256700:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096552.256733:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352833024 00000100:00100000:2.0:1787096552.256746:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352833024 00000100:00100000:2.0:1787096552.256775:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00100000:2.0:1787096552.256781:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7dad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:33699:x1873906352833024:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096552.256790:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096552.256800:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b43c69 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6bfa expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.256834:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.256851:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.256858:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258748:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258758:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258763:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258808:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258813:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258816:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258828:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258832:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a600 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096552.258835:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258839:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258863:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9c9d6b3f0800) 00010000:00010000:2.0:1787096552.258865:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096552.258869:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258874:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b43c70 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258884:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258887:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258891:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258894:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096552.258895:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258905:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258909:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x7b711ae6 (ffff9c9d6b340b00) 00010000:00010000:2.0:1787096552.258911:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096552.258912:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258916:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b43c77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258941:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b43c69 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bfa expref: 10 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258947:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9c9d6b3f0800) 00010000:00010000:2.0:1787096552.258949:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096552.258951:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b43c69 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bfa expref: 10 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.258956:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4a000, rc 0) 00000100:00100000:2.0:1787096552.259001:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7dad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:33699:x1873906352833024:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2220us (2301us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096552.259007:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 152 00000100:00100000:0.0:1787096552.260219:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096552.260254:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352833280 00000100:00100000:1.0:1787096552.260262:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352833280 00000100:00100000:1.0:1787096552.260306:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 153 00000100:00100000:1.0:1787096552.260316:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:33699:x1873906352833280:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096552.260334:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096552.260337:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787096552.260368:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b43c54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6bec expref: 9 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.260381:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9c9d6b3f0800) 00010000:00010000:1.0:1787096552.260385:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096552.260417:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b43c7e lrc: 2/0,0 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6c01 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.260507:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6e9cfa00/0x1b9fb40e15b43c85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.260513:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6e9cfa00/0x1b9fb40e15b43c85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.260522:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6e9cfa00/0x1b9fb40e15b43c85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096552.260544:0:6480:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6480:1873906360244224:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787096552.260586:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096552.260611:0:6480:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787096552.260636:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360244224 00000100:00100000:3.0:1787096552.260641:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360244224 00000100:00100000:3.0:1787096552.260678:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787096552.260693:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:6480:x1873906360244224:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787096552.260712:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096552.260725:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b43c85 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.260752:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b43c85 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.260765:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3a00/0x1b9fb40e15b43c8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b43c85 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096552.260773:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096552.260776:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787096552.260780:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3a00, rc 0) 00000100:00100000:3.0:1787096552.260825:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6480:x1873906360244224:12345-0@lo:101:mdt00_001.0 Request processed in 134us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096552.260833:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787096552.260868:0:6480:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967358 gen 2 00000004:00080000:1.0:1787096552.260874:0:6480:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967358 committed transno 4294967358 00000100:00100000:1.0:1787096552.260922:0:6480:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42ebd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6480:1873906360244224:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096552.260933:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6e9cfa00/0x1b9fb40e15b43c85 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43c8c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.260942:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6e9cfa00/0x1b9fb40e15b43c85 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b43c8c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096552.260953:0:6480:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787096552.260958:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6e9cfa00/0x1b9fb40e15b43c85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43c8c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.260964:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d6e9cfa00/0x1b9fb40e15b43c85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b43c8c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261010:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261017:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261022:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261030:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261034:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261038:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096552.261142:0:6480:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42f9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6480:1873906360244352:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787096552.261170:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096552.261192:0:6480:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53000 going to sleep for 11 seconds 00000100:00100000:2.0:1787096552.261211:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360244352 00000100:00100000:2.0:1787096552.261215:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360244352 00000100:00100000:2.0:1787096552.261246:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787096552.261254:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6480:x1873906360244352:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787096552.261322:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6480:x1873906360244352:12345-0@lo:1000:mdt00_001.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096552.261333:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787096552.261349:0:6480:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42f9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6480:1873906360244352:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787096552.261682:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261692:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261699:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096552.261718:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787096552.261747:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261752:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261756:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261759:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cf000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096552.261762:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261766:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261771:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x0 (ffff9c9d6b3f0800) 00010000:00010000:1.0:1787096552.261773:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096552.261775:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261779:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf000/0x1b9fb40e15b43c93 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096552.261786:0:6480:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b138e94a reply state 00000000111dc2e8 transno 4294967300 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261793:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b43c9a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x2:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261803:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x2:0x0].0x7b711ae6 (ffff9c9d48c61800) 00010000:00010000:1.0:1787096552.261805:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096552.261808:0:6480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787096552.261833:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b43c7e lrc: 0/0,0 mode: --/CW res: [0x240000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c01 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261859:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c01 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.261866:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff9c9d48c61900) 00010000:00010000:1.0:1787096552.261869:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096552.261871:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce600, rc 0) 00000100:00100000:1.0:1787096552.261905:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:33699:x1873906352833280:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1592us (1689us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787096552.261910:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 153 00000100:00100000:0.0:1787096552.263232:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096552.263294:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352833536 00000100:00100000:2.0:1787096552.263302:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352833536 00000100:00100000:2.0:1787096552.263347:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 154 00000100:00100000:2.0:1787096552.263356:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d75983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:33699:x1873906352833536:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096552.263374:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096552.263388:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b43caf lrc: 2/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6c08 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.263503:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.263516:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c01 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.263524:0:6479:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.263553:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c01 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.263568:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c01 expref: 12 pid: 6480 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096552.263591:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6479:1873906360244480:192.168.203.27@tcp:104: 00000100:00100000:2.0:1787096552.263658:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d4568d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787096552.264554:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6479:1873906360244480:192.168.203.27@tcp:104: 00010000:00010000:2.0:1787096552.264585:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096552.264800:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096552.264858:0:6465:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352833664 00000100:00100000:1.0:1787096552.264864:0:6465:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352833664 00010000:00010000:1.0:1787096552.264889:0:6465:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c01 expref: 13 pid: 6480 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096552.264917:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 62 00000100:00100000:1.0:1787096552.264926:0:6465:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+13:2402:x1873906352833664:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096552.264937:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096552.264944:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c01 expref: 13 pid: 6480 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.264968:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c01 expref: 13 pid: 6480 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.264985:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b43ca1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c01 expref: 13 pid: 6480 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.264999:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff9c9d48c61900) 00010000:00010000:1.0:1787096552.265004:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.265022:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.265029:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096552.265053:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096552.265085:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265092:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096552.265095:0:6465:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:2402:x1873906352833664:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 170us (294us total) trans 0 rc 0/0 00000004:00200000:2.0:1787096552.265109:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x2:0x0]: returning size 0 00000100:00100000:1.0:1787096552.265111:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 62 00010000:00010000:2.0:1787096552.265285:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265293:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265300:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265305:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096552.265309:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265316:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265325:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff9c9d48c61900) 00010000:00010000:2.0:1787096552.265327:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787096552.265331:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265337:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b43cb6 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265377:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b43caf lrc: 1/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c08 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265387:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2:0x0].0x0 (ffff9c9d48c61900) 00010000:00010000:2.0:1787096552.265412:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096552.265417:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b43caf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6c08 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096552.265431:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4a400, rc 0) 00000100:00100000:2.0:1787096552.265468:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d75983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:33699:x1873906352833536:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2114us (2241us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096552.265476:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 154 00000100:00100000:0.0:1787096552.266484:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096552.266543:0:6482:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352833920 00000100:00100000:3.0:1787096552.266550:0:6482:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352833920 00000100:00100000:3.0:1787096552.266592:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 21 00000100:00100000:3.0:1787096552.266602:0:6482:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:33699:x1873906352833920:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:3.0:1787096552.266784:0:6482:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:33699:x1873906352833920:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 184us (300us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787096552.266792:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 21 00000001:02000400:1.0:1787096552.737996:0:21774:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_23a: @@@@@@ FAIL: setstripe failed 00010000:00010000:3.0:1787096553.166520:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096553.166590:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360244608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096553.166666:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096553.166718:0:8363:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360244608 00000100:00100000:3.0:1787096553.166728:0:8363:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360244608 00000100:00080000:1.0:1787096553.166802:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096553.166826:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787096553.166848:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360244608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787096553.166883:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787096553.166928:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360244608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096553.166935:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787096553.166973:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360244608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096553.167495:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360244736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787096553.167545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096553.167604:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360244736 00000100:00100000:0.0:1787096553.167609:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360244736 00000100:00080000:1.0:1787096553.167649:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096553.167650:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787096553.167659:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360244736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787096553.167672:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787096553.167710:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360244736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096553.167717:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787096553.167746:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360244736:0@lo:13:osp-pre-0-1.0 Debug log: 2020 lines, 2020 kept, 0 dropped, 0 bad.