00010000:00010000:1.0F:1787096588.849631:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1787096588.912434:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0F:1787096588.912494:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345532672 00000100:00100000:0.0:1787096588.912543:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345532672 00000100:00080000:2.0F:1787096588.912605:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096588.912615:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 285 00000100:00100000:0.0:1787096588.912641:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2836c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+13:40017:x1873906345532672:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:0.0:1787096588.912662:0:7424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096588.912680:0:7424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4000/0xdf123ee4d63435a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d874a expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.912746:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d634361 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.912760:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d634361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.912779:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d634361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096588.912959:0:7424:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 7680 00000004:00200000:0.0:1787096588.912963:0:7424:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787096588.913050:0:7424:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d634361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.913090:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4000/0xdf123ee4d63435a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d874a expref: 15 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.913105:0:7424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d634361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d874a expref: 14 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.913114:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9db2a2946500) 00010000:00010000:0.0:1787096588.913116:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096588.913120:0:7424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda4c00, rc 0) 00000100:00100000:0.0:1787096588.913179:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2836c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+14:40017:x1873906345532672:12345-192.168.203.45@tcp:101:rm.0 Request processed in 544us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096588.913186:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 285 00000100:00100000:2.0:1787096588.915431:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096588.915469:0:5766:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345532800 00000100:00100000:3.0:1787096588.915476:0:5766:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345532800 00000100:00100000:3.0:1787096588.915562:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:3.0:1787096588.915571:0:5766:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db1828eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7354022b-ee92-4e63-a611-5f745ec24594+14:40017:x1873906345532800:12345-192.168.203.45@tcp:37:rm.0 00000100:00100000:0.0:1787096588.918752:0:5766:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db1828eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7354022b-ee92-4e63-a611-5f745ec24594+14:40017:x1873906345532800:12345-192.168.203.45@tcp:37:rm.0 Request processed in 3175us (3323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096588.918764:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:0.0:1787096588.921840:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096588.921903:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345532928 00000100:00100000:1.0:1787096588.921917:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345532928 00000100:00100000:1.0:1787096588.921986:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 286 00000100:00100000:1.0:1787096588.922003:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfa0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+14:40017:x1873906345532928:12345-192.168.203.45@tcp:41:rm.0 00000004:00000024:1.0:1787096588.922095:0:5765:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7713325056 00000100:00100000:1.0:1787096588.922184:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfa0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+14:40017:x1873906345532928:12345-192.168.203.45@tcp:41:rm.0 Request processed in 186us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096588.922190:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 286 00000100:00100000:3.0:1787096588.923248:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096588.923293:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345533056 00000100:00100000:0.0:1787096588.923303:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345533056 00000100:00100000:0.0:1787096588.923355:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 287 00000100:00100000:0.0:1787096588.923369:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2836c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+14:40017:x1873906345533056:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:0.0:1787096588.923389:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096588.923408:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4000/0xdf123ee4d634368 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8751 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923471:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923485:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923497:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923541:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923548:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923566:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923924:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63437d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923930:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63437d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923935:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63437d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096588.923962:0:5764:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x21:0x0]: returning size 3145729 00000004:00200000:0.0:1787096588.923964:0:5764:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787096588.923977:0:5764:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63437d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923985:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63437d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.923993:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924000:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924006:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924012:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda4400 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096588.924016:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924031:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924043:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9db2a2946500) 00010000:00010000:0.0:1787096588.924046:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096588.924050:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924054:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4400/0xdf123ee4d63436f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924062:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924065:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924069:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924072:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda5200 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096588.924074:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924077:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924082:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0xc0870d27 (ffff9db2bca3ac00) 00010000:00010000:0.0:1787096588.924084:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096588.924085:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924096:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d634376 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924119:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4000/0xdf123ee4d634368 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8751 expref: 16 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924128:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63437d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8751 expref: 15 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.924135:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9db2bca3a600) 00010000:00010000:0.0:1787096588.924137:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096588.924140:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda5e00, rc 0) 00000100:00100000:0.0:1787096588.924197:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2836c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+15:40017:x1873906345533056:12345-192.168.203.45@tcp:101:rm.0 Request processed in 831us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096588.924204:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 287 00000100:00100000:3.0:1787096588.925462:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096588.925603:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345533312 00000100:00100000:1.0:1787096588.925616:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345533312 00000100:00100000:1.0:1787096588.925688:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 288 00000100:00100000:1.0:1787096588.925702:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2836c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+15:40017:x1873906345533312:12345-192.168.203.45@tcp:36:rm.0 00010000:00010000:1.0:1787096588.925775:0:7424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787096588.925804:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63437d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8751 expref: 15 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.925825:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9db2bca3a600) 00010000:00010000:1.0:1787096588.925844:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d634361 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d874a expref: 14 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.925856:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9db2a2946500) 00010000:00010000:1.0:1787096588.925860:0:7424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096588.925880:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.925895:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.925921:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.925938:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.925946:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.925953:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.927739:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.927752:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.927761:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787096588.928970:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8760 00000004:00080000:1.0:1787096588.928982:0:7424:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 271151480551ns, next at 272151478104ns, rc = 0 00000040:00080000:1.0:1787096588.929035:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 64 off8824 00000004:00080000:1.0:1787096588.929040:0:7424:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 271151539694ns, next at 272151538876ns, rc = 0 00000040:00080000:1.0:1787096588.929058:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 64 off8824 00000040:00080000:1.0:1787096588.929069:0:7424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].9, 64 off8888 00010000:00010000:1.0:1787096588.929120:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929128:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929143:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929151:0:7424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929157:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929163:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929182:0:7424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787096588.929201:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929207:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.929212:0:8214:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096588.929214:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.929219:0:8214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929222:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28364ea00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096588.929239:0:8214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28364fa00 already unused, calling callback (ffffffffc16156f0) 00010000:00010000:1.0:1787096588.929241:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.929242:0:8214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.929262:0:8214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929262:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.929286:0:8214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:3.0:1787096588.929288:0:8214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096588.929292:0:8214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929292:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:1.0:1787096588.929299:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096588.929300:0:8214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fa00/0xdf123ee4d634399 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.929310:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096588.929310:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.929313:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096588.929316:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096588.929321:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ea00/0xdf123ee4d634392 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929345:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929351:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929356:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929362:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28364f800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096588.929364:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929370:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929377:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9db2a2946500) 00010000:00010000:1.0:1787096588.929380:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.929383:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.929389:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f800/0xdf123ee4d634384 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096588.929399:0:7424:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e22bfd89 reply state 00000000d78f7b67 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096588.929420:0:7424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787096588.929526:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2836c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+15:40017:x1873906345533312:12345-192.168.203.45@tcp:36:rm.0 Request processed in 3825us (4063us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1787096588.929537:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 288 00010000:00010000:1.0:1787096588.930218:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.930235:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.930240:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.930244:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28364ee00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096588.930246:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.930250:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.930257:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0xc0870d27 (ffff9db2a2946800) 00010000:00010000:1.0:1787096588.930260:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.930262:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.930266:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364ee00/0xdf123ee4d63438b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0xc0870d27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096588.931841:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096588.931897:0:5767:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345533568 00000100:00100000:1.0:1787096588.931906:0:5767:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345533568 00000100:00100000:1.0:1787096588.931983:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:1.0:1787096588.931993:0:5767:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2836c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7354022b-ee92-4e63-a611-5f745ec24594+14:40017:x1873906345533568:12345-192.168.203.45@tcp:35:rm.0 00000100:00100000:1.0:1787096588.932190:0:5767:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2836c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7354022b-ee92-4e63-a611-5f745ec24594+15:40017:x1873906345533568:12345-192.168.203.45@tcp:35:rm.0 Request processed in 198us (351us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787096588.932197:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:1.0:1787096588.933493:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096588.934212:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345533824 00000100:00100000:2.0:1787096588.934219:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345533824 00000100:00100000:2.0:1787096588.934275:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 289 00000100:00100000:2.0:1787096588.934285:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+15:40017:x1873906345533824:12345-192.168.203.45@tcp:36:rm.0 00010000:00010000:2.0:1787096588.934323:0:5765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787096588.934354:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d634043 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8678 expref: 15 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934376:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e800/0xdf123ee4d633f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8647 expref: 14 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934389:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9db2a2946500) 00010000:00010000:2.0:1787096588.934403:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d633f7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8640 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934411:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3ad00) 00010000:00010000:2.0:1787096588.934418:0:5765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096588.934438:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934451:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934459:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934471:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934488:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934496:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934771:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934780:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.934788:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096588.935389:0:5765:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20:0x0]: returning size 7680 00010000:00010000:2.0:1787096588.935402:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935410:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935417:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935423:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0ae00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096588.935427:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935435:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935453:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff9db282c28800) 00010000:00010000:2.0:1787096588.935456:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096588.935460:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935466:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ae00/0xdf123ee4d6343ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935482:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935488:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935494:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935656:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0b400 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096588.935659:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935666:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935674:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db282c28c00) 00010000:00010000:2.0:1787096588.935677:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096588.935679:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.935686:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0b400/0xdf123ee4d6343a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096588.935706:0:5765:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009d040dfc reply state 00000000d5c1b345 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096588.935714:0:5765:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096588.935773:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+14:40017:x1873906345533824:12345-192.168.203.45@tcp:36:rm.0 Request processed in 1489us (2282us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787096588.935781:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 289 00010000:00010000:1.0:1787096588.936438:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.936448:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.936453:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.936457:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0ba00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096588.936459:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.936465:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.936475:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6ab828e0 (ffff9db282c28f00) 00010000:00010000:1.0:1787096588.936477:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.936481:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.936487:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0ba00/0xdf123ee4d6343a7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6ab828e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096589.873752:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096589.876294:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096589.876370:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096589.876399:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096589.876438:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096589.876442:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345534080 00000100:00100000:3.0:1787096589.876443:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345533952 00000100:00100000:3.0:1787096589.876454:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345533952 00000100:00100000:0.0:1787096589.876454:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345534080 00000100:00100000:2.0:1787096589.876459:0:6539:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345534208 00000100:00100000:2.0:1787096589.876467:0:6539:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345534208 00000100:00100000:1.0:1787096589.876487:0:6536:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345534336 00000100:00100000:1.0:1787096589.876492:0:6536:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345534336 00000100:00100000:3.0:1787096589.876563:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 264 00000100:00100000:2.0:1787096589.876564:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:0.0:1787096589.876565:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 150 00000100:00100000:1.0:1787096589.876574:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:3.0:1787096589.876580:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a06b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2357:x1873906345533952:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787096589.876582:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+13:2358:x1873906345534080:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787096589.876584:0:6539:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7354022b-ee92-4e63-a611-5f745ec24594+8:2357:x1873906345534208:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787096589.876589:0:6536:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7354022b-ee92-4e63-a611-5f745ec24594+8:2358:x1873906345534336:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096589.876657:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a06b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2357:x1873906345533952:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096589.876657:0:6539:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7354022b-ee92-4e63-a611-5f745ec24594+8:2357:x1873906345534208:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096589.876669:0:6536:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7354022b-ee92-4e63-a611-5f745ec24594+8:2358:x1873906345534336:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096589.876671:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+13:2358:x1873906345534080:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096589.876676:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 264 00000100:00100000:2.0:1787096589.876678:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:1.0:1787096589.876688:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 79 00000100:00100000:0.0:1787096589.876692:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 150 00000100:00080000:2.0:1787096589.876705:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787096589.876711:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787096590.897645:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096591.153679:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db1828e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353905664:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787096591.153696:0:6995:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 273376194367ns, next at 274376191462ns, rc = 0 00000100:00100000:0.0:1787096591.153779:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096591.153848:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353905664 00000100:00100000:0.0:1787096591.153855:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353905664 00000100:00080000:2.0:1787096591.153910:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096591.153919:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787096591.153929:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfa0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3294:x1873906353905664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096591.153961:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096591.154021:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfa0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3294:x1873906353905664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096591.154028:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787096591.154072:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db1828e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353905664:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096591.735242:0:31419:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27b: test we can create -c n --ec 4+2 with n OSTs ========================================================== 19:43:10 (1787096590) 00010000:00010000:1.0:1787096591.922636:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787096592.177713:0:7837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 274400209872ns, next at 275400205859ns, rc = 0 00000100:00100000:2.0:1787096592.177778:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db1828e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353905920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096592.177779:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353905792:0@lo:400:kworker.0 00000100:00100000:0.0:1787096592.177890:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096592.177892:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096592.177978:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1873906353906432:0@lo:400:kworker.0 00000100:00100000:0.0:1787096592.177980:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353906304:0@lo:400:kworker.0 00000100:00100000:2.0:1787096592.178027:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096592.178032:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353906176:0@lo:400:kworker.0 00000100:00100000:2.0:1787096592.178069:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787096592.178079:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096592.178095:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353906048:0@lo:400:kworker.0 00000100:00100000:2.0:1787096592.178139:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096592.178165:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353905792 00000100:00100000:2.0:1787096592.178171:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353906560:0@lo:400:kworker.0 00000100:00100000:0.0:1787096592.178175:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353905792 00000100:00100000:2.0:1787096592.178228:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096592.178263:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787096592.178276:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a06ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353905792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096592.178279:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353906432 00000100:00100000:2.0:1787096592.178288:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353906432 00000100:00100000:2.0:1787096592.178352:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353906176 00000100:00100000:2.0:1787096592.178356:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353906176 00000100:00100000:2.0:1787096592.178395:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353906048 00000100:00100000:2.0:1787096592.178399:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353906048 00000100:00100000:2.0:1787096592.178431:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787096592.178442:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db1828e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1873906353906432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096592.178561:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db1828e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1873906353906432:12345-0@lo:400:kworker.0 Request processed in 122us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096592.178569:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787096592.178589:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787096592.178602:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353906176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096592.178627:0:6540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353905920 00000100:00100000:0.0:1787096592.178635:0:6540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353905920 00000100:00100000:2.0:1787096592.178648:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfa0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353906176:12345-0@lo:400:kworker.0 Request processed in 51us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096592.178655:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787096592.178674:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787096592.178683:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db1828e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353906048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096592.178691:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787096592.178704:0:6540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db1828e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3296:x1873906353905920:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096592.178717:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db1828e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353906048:12345-0@lo:400:kworker.0 Request processed in 36us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096592.178722:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00002000:00000024:0.0:1787096592.178746:0:6540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096592.178747:0:6538:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353906560 00000100:00100000:2.0:1787096592.178754:0:6538:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353906560 00000100:00100000:2.0:1787096592.178801:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787096592.178813:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db1828e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3296:x1873906353906560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096592.178851:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db1828e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3296:x1873906353906560:12345-0@lo:400:kworker.0 Request processed in 44us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096592.178856:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787096592.178874:0:6540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db1828e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3296:x1873906353905920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (986us total) trans 0 rc 0/0 00000100:00080000:2.0:1787096592.178875:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787096592.178883:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096592.178893:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787096592.178922:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353906048:0@lo:400:kworker.0 00000100:00100000:2.0:1787096592.178930:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353906560:0@lo:400:kworker.0 00000100:00100000:2.0:1787096592.178946:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db1828e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353905920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096592.178951:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1873906353906432:0@lo:400:kworker.0 00000100:00100000:0.0:1787096592.179274:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353906176:0@lo:400:kworker.0 00000100:00100000:0.0:1787096592.179366:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a06ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353905792:12345-0@lo:400:kworker.0 Request processed in 1093us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096592.179386:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787096592.179495:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096592.179555:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353905792:0@lo:400:kworker.0 00000100:00100000:1.0:1787096592.179577:0:6536:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353906304 00000100:00100000:1.0:1787096592.179580:0:6536:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353906304 00000100:00100000:1.0:1787096592.179605:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787096592.179612:0:6536:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1873906353906304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096592.179648:0:6536:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3295:x1873906353906304:12345-0@lo:400:kworker.0 Request processed in 37us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096592.179655:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787096592.179684:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353906304:0@lo:400:kworker.0 00000001:00080000:3.0:1787096592.194656:0:6565:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1787096592.194690:0:6565:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1787096592.195897:0:7427:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787096592.195905:0:7427:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787096592.195910:0:7427:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:02000400:0.0:1787096592.271669:0:31471:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27b needs >= 8 OSTs 00000001:00080000:3.0:1787096592.703717:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000001:00080000:3.0:1787096592.703731:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000004:00080000:3.0:1787096592.703744:0:5785:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1787096592.703753:0:5785:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1787096592.703771:0:5785:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1787096592.703776:0:5785:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1787096592.703783:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000100:00100000:3.0:1787096592.703859:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353906688:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787096592.703886:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353906944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787096592.703886:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353906816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787096592.703927:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096592.703937:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353907072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787096592.703955:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353906688 00000100:00100000:0.0:1787096592.703961:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353906688 00000100:00100000:2.0:1787096592.703965:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096592.704006:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353906944 00000100:00100000:0.0:1787096592.704008:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353906944 00000100:00100000:0.0:1787096592.704033:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787096592.704044:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787096592.704045:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2836c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1873906353906688:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787096592.704060:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db1828e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1873906353906944:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787096592.704066:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1787096592.704068:0:7838:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00080000:2.0:1787096592.704078:0:6538:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000100:00100000:3.0:1787096592.704090:0:30718:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353906816 00002000:00010000:0.0:1787096592.704092:0:7838:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 3145728, mtime: 0x6a84ee0a, atime: 0x0, ctime: 0x6a84ee0a, blocks: 0x807 00010000:00010000:2.0:1787096592.704095:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096592.704096:0:30718:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353906816 00010000:00010000:0.0:1787096592.704098:0:7838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096592.704120:0:7838:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1787096592.704122:0:7838:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1787096592.704127:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6eef05d/0xdf123ee4d634281 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8704 expref: 5 pid: 6539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096592.704128:0:7838:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096592.704135:0:30718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787096592.704148:0:30718:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353906816:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787096592.704155:0:7838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787096592.704164:0:30718:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00010000:00010000:2.0:1787096592.704170:0:6538:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1787096592.704173:0:6538:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1787096592.704174:0:7838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096592.704177:0:6538:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787096592.704185:0:30718:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 524288, mtime: 0x6a84ee0a, atime: 0x6a84ee0a, ctime: 0x6a84ee0a, blocks: 0x403 00010000:00010000:0.0:1787096592.704190:0:7838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.704198:0:30718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.704227:0:30718:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1787096592.704234:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6eef05d/0xdf123ee4d634281 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8704 expref: 5 pid: 6539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.704236:0:30718:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1787096592.704241:0:30718:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096592.704243:0:7838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096592.704257:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6eef05d/0xdf123ee4d634281 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8704 expref: 5 pid: 6539 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.704259:0:30718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.704280:0:30718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096592.704282:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db1828eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6538:1873906353907200:192.168.203.45@tcp:104: 00010000:00010000:3.0:1787096592.704294:0:30718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.704311:0:30718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787096592.704329:0:5752:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787096592.704337:0:5752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704348:0:5752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda5400 already unused, calling callback (ffffffffc16156f0) 00000100:00100000:2.0:1787096592.704351:0:6538:0:(client.c:2692:ptlrpc_set_wait()) set ffff9db182cbba80 going to sleep for 11 seconds 00010000:00010000:1.0:1787096592.704353:0:5752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704365:0:5752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704385:0:5752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704391:0:5752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c49d0ee/0xdf123ee4d6343b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704404:0:5752:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096592.704407:0:5752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704412:0:5752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28528d400 already unused, calling callback (ffffffffc16156f0) 00010000:00010000:1.0:1787096592.704414:0:5752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704422:0:5752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704444:0:5752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704450:0:5752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f68a8fa/0xdf123ee4d6343c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 30718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.704471:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096592.704474:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096592.704475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096592.704479:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096592.704544:0:6539:0:(service.c:3465:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:2.0:1787096592.704552:0:6539:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:0.0:1787096592.704875:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2836c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3294:x1873906353906688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 833us (947us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787096592.704884:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787096592.704902:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353907072 00000100:00100000:0.0:1787096592.704906:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353907072 00000100:00100000:1.0:1787096592.704910:0:3294:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787096592.704916:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9db1828e8000, transno 4294967304 00000100:00100000:0.0:1787096592.704926:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1787096592.704927:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9db2bfa08380, transno 4294967305 00000004:00080000:1.0:1787096592.704932:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9db2bfa0b100, transno 4294967306 00000100:00100000:0.0:1787096592.704936:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db1828e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3297:x1873906353907072:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787096592.704941:0:3294:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9db2bfa08000 x1873906353906688/t4294967308(4294967308) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787096608 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787096592.704952:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9db2bfa08000/2, rc 0, transno 4294967308 00000100:00100000:1.0:1787096592.704957:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353906688:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787096592.704997:0:7838:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787096592.705015:0:7838:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787096592.705020:0:7838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096592.705029:0:7838:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1787096592.705030:0:7838:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1787096592.705033:0:7838:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096592.705042:0:7838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096592.705046:0:30718:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3295:x1873906353906816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 899us (981us total) trans 4294967307 rc 0/0 00010000:00010000:0.0:1787096592.705054:0:7838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096592.705060:0:30718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787096592.705064:0:3295:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787096592.705071:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9db2bfa0b800, transno 4294967302 00010000:00010000:0.0:1787096592.705072:0:7838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096592.705080:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9db2bfb76680, transno 4294967304 00000004:00080000:1.0:1787096592.705084:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9db2bfb75c00, transno 4294967305 00000004:00080000:1.0:1787096592.705089:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9db2bfb75180, transno 4294967306 00000100:00100000:1.0:1787096592.705097:0:3295:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9db2bfb77800 x1873906353906816/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787096608 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787096592.705106:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9db2bfb77800/2, rc 0, transno 4294967307 00010000:00010000:0.0:1787096592.705109:0:7838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787096592.705119:0:5753:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787096592.705119:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353906816:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787096592.705124:0:5753:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.705133:0:5753:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda4e00 already unused, calling callback (ffffffffc16156f0) 00010000:00010000:3.0:1787096592.705137:0:5753:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.705144:0:5753:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.705167:0:5753:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.705175:0:5753:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1c4686a/0xdf123ee4d6343ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.705190:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096592.705192:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096592.705194:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096592.705362:0:6538:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db1828eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6538:1873906353907200:192.168.203.45@tcp:104: 00010000:00010000:2.0:1787096592.705378:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096592.705475:0:7836:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 4 done 00010000:00010000:2.0:1787096592.705549:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096592.705601:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db1828e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3297:x1873906353907072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 665us (1127us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787096592.705607:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1787096592.705618:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9db2bfb74700/2, rc 0, transno 4294967308 00000100:00100000:2.0:1787096592.705626:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353907072:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1787096592.705765:0:6994:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 2 in progress, 1 in flight, 3 done 00000100:00100000:0.0:1787096592.705932:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096592.705971:0:5749:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345534464 00000100:00100000:1.0:1787096592.705975:0:5749:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345534464 00010000:00010000:1.0:1787096592.706013:0:5749:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6eef05d/0xdf123ee4d634281 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8704 expref: 6 pid: 6539 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787096592.706021:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787096592.706042:0:5749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:1.0:1787096592.706052:0:5749:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfa08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7354022b-ee92-4e63-a611-5f745ec24594+6:2357:x1873906345534464:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096592.706062:0:5749:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096592.706068:0:5749:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6eef05d/0xdf123ee4d634281 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8704 expref: 6 pid: 6539 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706080:0:5749:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6eef05d/0xdf123ee4d634281 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8704 expref: 6 pid: 6539 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706094:0:5749:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6eef05d/0xdf123ee4d634281 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8704 expref: 6 pid: 6539 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706103:0:5749:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1787096592.706104:0:5749:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1787096592.706107:0:5749:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706115:0:5749:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706158:0:5749:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096592.706169:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.706176:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.706182:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096592.706186:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096592.706192:0:5749:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfa08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7354022b-ee92-4e63-a611-5f745ec24594+5:2357:x1873906345534464:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 140us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096592.706200:0:5749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00010000:00010000:3.0:1787096592.706214:0:6538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787096592.706235:0:6553:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096592.706241:0:6553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706248:0:6553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0b400 already unused, calling callback (ffffffffc16156f0) 00010000:00010000:1.0:1787096592.706252:0:6553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706260:0:6553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706273:0:6553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706279:0:6553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038f40ae3/0xdf123ee4d6343bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096592.706292:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096592.706294:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096592.706296:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096592.706641:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db1828e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3296:x1873906353906944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2585us (2676us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787096592.706651:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00080000:2.0:1787096592.706667:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9db2bfa0a300/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787096592.706679:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353906944:0@lo:6:osp-syn-0-0.0 00000001:02000400:0.0:1787096592.845879:0:31524:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27c: test creating with n+2 OSTs ======= 19:43:11 (1787096591) 00010000:00010000:1.0:1787096592.945680:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096593.425120:0:31572:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27c needs >= 8 OSTs 00010000:00010000:3.0:1787096593.969619:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096594.067234:0:31620:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27d: test raidset OSTs allocations are valid for -C 8 --ec 5+2 ========================================================== 19:43:13 (1787096593) 00000001:02000400:2.0:1787096594.602349:0:31668:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27d needs >= 8 OSTs 00010000:00010000:2.0:1787096594.993659:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096594.997303:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096594.997345:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096594.997355:0:5758:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345534592 00000100:00100000:0.0:1787096594.997366:0:5758:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345534592 00000100:00100000:3.0:1787096594.997379:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096594.997412:0:30718:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345534848 00000100:00100000:1.0:1787096594.997418:0:30718:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345534848 00000100:00100000:3.0:1787096594.997429:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096594.997438:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 266 00000100:00100000:2.0:1787096594.997440:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345534720 00000100:00100000:2.0:1787096594.997446:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345534720 00000100:00100000:0.0:1787096594.997451:0:5758:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a06b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2358:x1873906345534592:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096594.997460:0:6536:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345534976 00000100:00100000:3.0:1787096594.997465:0:6536:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345534976 00000100:00100000:1.0:1787096594.997493:0:30718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 82 00000100:00100000:3.0:1787096594.997531:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 83 00000100:00100000:2.0:1787096594.997535:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 154 00000100:00100000:1.0:1787096594.997536:0:30718:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2836c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7354022b-ee92-4e63-a611-5f745ec24594+5:2358:x1873906345534848:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096594.997546:0:6536:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2836c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7354022b-ee92-4e63-a611-5f745ec24594+5:2358:x1873906345534976:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787096594.997553:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2836c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+5:2358:x1873906345534720:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787096594.997556:0:5758:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a06b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2358:x1873906345534592:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096594.997574:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 266 00000100:00100000:1.0:1787096594.997579:0:30718:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2836c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7354022b-ee92-4e63-a611-5f745ec24594+5:2358:x1873906345534848:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096594.997593:0:6536:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2836c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7354022b-ee92-4e63-a611-5f745ec24594+5:2358:x1873906345534976:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 47us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096594.997593:0:30718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 82 00000100:00100000:2.0:1787096594.997602:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2836c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+5:2358:x1873906345534720:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 55us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096594.997609:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 83 00000100:00100000:2.0:1787096594.997618:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 154 00000100:00080000:2.0:1787096594.997643:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787096594.997649:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787096594.997652:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787096595.212063:0:31716:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27e: test raidset OSTs allocations are valid for -C 13 --ec 5+2 ========================================================== 19:43:14 (1787096594) 00000001:02000400:1.0:1787096595.784900:0:31764:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27e needs >= 8 OSTs 00010000:00010000:1.0:1787096596.018094:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096596.274694:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353907328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096596.274759:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096596.274800:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353907328 00000100:00100000:2.0:1787096596.274808:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353907328 00000100:00100000:2.0:1787096596.274877:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1787096596.274881:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096596.274892:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1873906353907328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096596.274929:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1787096596.274975:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1873906353907328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096596.274981:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787096596.275158:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353907328:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787096596.412786:0:31812:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 27f: test raidset OSTs allocations are valid for -C 20 --ec 5+2 ========================================================== 19:43:15 (1787096595) 00000001:02000400:1.0:1787096596.955754:0:31860:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_27f needs >= 8 OSTs 00010000:00010000:1.0:1787096597.041636:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096597.297636:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db1828eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353907456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096597.297716:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096597.297768:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353907456 00000100:00100000:0.0:1787096597.297778:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353907456 00000100:00100000:2.0:1787096597.297786:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353907968:0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.297847:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096597.297878:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096597.297885:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787096597.297889:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1873906353907840:0@lo:400:kworker.0 00000100:00100000:0.0:1787096597.297900:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db1828e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1873906353907456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787096597.297936:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096597.297965:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096597.298032:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353907840 00000100:00100000:0.0:1787096597.298035:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353907840 00000100:00100000:2.0:1787096597.298043:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353907584:0@lo:400:kworker.0 00000100:00100000:0.0:1787096597.298077:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787096597.298084:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096597.298089:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bca49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1873906353907840:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787096597.298120:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096597.298123:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1873906353908096:0@lo:400:kworker.0 00000100:00080000:3.0:1787096597.298127:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787096597.298156:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096597.298204:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787096597.298214:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353907712:0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.298246:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096597.298271:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353908224:0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.298304:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096597.298329:0:6538:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353907968 00000100:00100000:3.0:1787096597.298334:0:6538:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353907968 00000100:00100000:2.0:1787096597.298359:0:31497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353908224 00000100:00100000:2.0:1787096597.298364:0:31497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353908224 00000100:00100000:3.0:1787096597.298377:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787096597.298389:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bca4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1873906353907968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.298409:0:31497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787096597.298421:0:31497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bca48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3296:x1873906353908224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096597.298455:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bca4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1873906353907968:12345-0@lo:400:kworker.0 Request processed in 69us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096597.298464:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787096597.298479:0:31497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bca48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3296:x1873906353908224:12345-0@lo:400:kworker.0 Request processed in 61us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096597.298490:0:31497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787096597.298871:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353908096 00000100:00100000:2.0:1787096597.298876:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353908096 00000100:00100000:2.0:1787096597.299032:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353907712 00000100:00100000:2.0:1787096597.299037:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353907712 00000100:00080000:3.0:1787096597.299076:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096597.299097:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787096597.299105:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bca48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1873906353908096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.299150:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bca48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1873906353908096:12345-0@lo:400:kworker.0 Request processed in 44us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096597.299158:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787096597.299202:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787096597.299211:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bca4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353907712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096597.299234:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bca49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1873906353907840:12345-0@lo:400:kworker.0 Request processed in 1148us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096597.299242:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787096597.299259:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bca4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353907712:12345-0@lo:400:kworker.0 Request processed in 49us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096597.299267:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787096597.299288:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db1828e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1873906353907456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1393us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096597.299292:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787096597.299330:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353907584 00000100:00100000:1.0:1787096597.299333:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353907584 00000100:00100000:1.0:1787096597.299370:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787096597.299372:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353907712:0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.299386:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353908224:0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.299399:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1873906353908096:0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.299443:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1873906353907840:0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.299458:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353907968:0@lo:400:kworker.0 00000100:00100000:2.0:1787096597.299476:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db1828eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353907456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096597.299732:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a06bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353907584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096597.299791:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a06bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353907584:12345-0@lo:400:kworker.0 Request processed in 378us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096597.299798:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787096597.299854:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353907584:0@lo:400:kworker.0 00000001:00080000:2.0:1787096597.312035:0:7427:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1787096597.312254:0:6565:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1787096597.312264:0:6565:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:02000400:0.0:1787096597.497937:0:31912:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28a: EC parity correctly tracks writes through hardlinks ========================================================== 19:43:16 (1787096596) 00000100:00100000:2.0:1787096597.559791:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096597.559840:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345535104 00000100:00100000:0.0:1787096597.559848:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345535104 00000100:00080000:3.0:1787096597.559894:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096597.559907:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 290 00000100:00100000:0.0:1787096597.559916:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bca48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:41774:x1873906345535104:12345-192.168.203.45@tcp:101:mkdir.0 00010000:00010000:0.0:1787096597.559931:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096597.559986:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d6343d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8758 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.560036:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d6343d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.560047:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d6343d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.560060:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d6343d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096597.560272:0:5764:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787096597.560276:0:5764:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787096597.560383:0:5764:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d6343d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.560409:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d6343d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8758 expref: 7 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.560426:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d6343d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8758 expref: 6 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.560435:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3aa00) 00010000:00010000:0.0:1787096597.560444:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096597.560448:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda4c00, rc 0) 00000100:00100000:0.0:1787096597.560498:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bca48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+6:41774:x1873906345535104:12345-192.168.203.45@tcp:101:mkdir.0 Request processed in 583us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096597.560530:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 290 00000100:00100000:1.0:1787096597.561869:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096597.561905:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345535360 00000100:00100000:2.0:1787096597.561910:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345535360 00000100:00100000:2.0:1787096597.561938:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 291 00000100:00100000:2.0:1787096597.561944:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+6:41774:x1873906345535360:12345-192.168.203.45@tcp:36:mkdir.0 00010000:00010000:2.0:1787096597.561972:0:7424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096597.561985:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d6343d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8758 expref: 6 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.562003:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3aa00) 00010000:00010000:2.0:1787096597.562009:0:7424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096597.562141:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.562152:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.562159:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.562208:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.562214:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.562219:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096597.562992:0:7424:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23:0x0]: returning size 512 00010000:00010000:2.0:1787096597.563000:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.563005:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.563009:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.563013:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0bc00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096597.563019:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.563025:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.563031:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db282c28b00) 00010000:00010000:2.0:1787096597.563032:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096597.563035:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096597.563038:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0bc00/0xdf123ee4d6343df lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096597.563046:0:7424:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006d1e1930 reply state 000000009c199d3e transno 4294967448 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096597.563052:0:7424:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096597.563103:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+7:41774:x1873906345535360:12345-192.168.203.45@tcp:36:mkdir.0 Request processed in 1158us (1235us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1787096597.563109:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 291 00010000:00010000:1.0:1787096597.564281:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.564292:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.564299:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.564304:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2b7a0aa00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096597.564308:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.564314:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.564324:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff9db282c28100) 00010000:00010000:1.0:1787096597.564327:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096597.564330:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.564335:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2b7a0aa00/0xdf123ee4d6343e6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096597.579348:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096597.579400:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345535488 00000100:00100000:0.0:1787096597.579410:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345535488 00000100:00100000:0.0:1787096597.579465:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 292 00000100:00100000:0.0:1787096597.579475:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+6:41779:x1873906345535488:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787096597.579520:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096597.579541:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d6343ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d875f expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.579603:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4600/0xdf123ee4d6343f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.579616:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4600/0xdf123ee4d6343f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.579627:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4600/0xdf123ee4d6343f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096597.579678:0:5763:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787096597.579682:0:5763:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787096597.579702:0:5763:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4600/0xdf123ee4d6343f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.579724:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5000/0xdf123ee4d6343ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d875f expref: 8 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.579751:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4600/0xdf123ee4d6343f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d875f expref: 7 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.579760:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3ab00) 00010000:00010000:0.0:1787096597.579762:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096597.579766:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda4600, rc 0) 00000100:00100000:0.0:1787096597.579815:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+7:41779:x1873906345535488:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 342us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096597.579823:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 292 00000100:00100000:3.0:1787096597.580794:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096597.581109:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345535616 00000100:00100000:0.0:1787096597.581118:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345535616 00000100:00100000:0.0:1787096597.581185:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 293 00000100:00100000:0.0:1787096597.581195:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2836c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+7:41779:x1873906345535616:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787096597.581213:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096597.581231:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d6343fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8766 expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581291:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581305:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581316:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581332:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581349:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581356:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581588:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4200/0xdf123ee4d634410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581599:0:5764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4200/0xdf123ee4d634410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581604:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4200/0xdf123ee4d634410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096597.581638:0:5764:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23:0x0]: returning size 512 00000004:00200000:0.0:1787096597.581642:0:5764:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787096597.581657:0:5764:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4200/0xdf123ee4d634410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581668:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581672:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581677:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581680:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda5400 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096597.581683:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581694:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581700:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3ab00) 00010000:00010000:0.0:1787096597.581702:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096597.581705:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581708:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5400/0xdf123ee4d634402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581715:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581719:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581722:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581725:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda4800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096597.581726:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581729:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581733:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x774e2b0 (ffff9db2bca3ae00) 00010000:00010000:0.0:1787096597.581734:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096597.581736:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581744:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d634409 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x774e2b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581763:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d6343fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8766 expref: 9 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581770:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4200/0xdf123ee4d634410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8766 expref: 8 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.581775:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9db2bca3af00) 00010000:00010000:0.0:1787096597.581776:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787096597.581778:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda4200, rc 0) 00000100:00100000:0.0:1787096597.581807:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2836c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+8:41779:x1873906345535616:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 615us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096597.581811:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 293 00000100:00100000:2.0:1787096597.582614:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096597.582665:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345535744 00000100:00100000:1.0:1787096597.582670:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345535744 00000100:00100000:1.0:1787096597.582696:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 294 00000100:00100000:1.0:1787096597.582704:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bca48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+8:41779:x1873906345535744:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787096597.582712:0:7424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096597.582719:0:7424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e600/0xdf123ee4d634417 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d876d expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582748:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582755:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582760:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582767:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582771:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582784:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582830:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582835:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582845:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582849:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28364f600 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096597.582850:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582854:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582859:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9db2bca3af00) 00010000:00010000:1.0:1787096597.582861:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096597.582863:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582867:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364f600/0xdf123ee4d63441e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582873:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582876:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582879:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582882:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28364fe00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096597.582883:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582892:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582897:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0xe0be4298 (ffff9db2a2946b00) 00010000:00010000:1.0:1787096597.582898:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096597.582899:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582902:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364fe00/0xdf123ee4d634425 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582917:0:7424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e600/0xdf123ee4d634417 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d876d expref: 9 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582923:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9db2bca3af00) 00010000:00010000:1.0:1787096597.582924:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096597.582926:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28364e600/0xdf123ee4d634417 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d876d expref: 9 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.582930:0:7424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db28364e600, rc 0) 00000100:00100000:1.0:1787096597.582956:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bca48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+8:41779:x1873906345535744:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 254us (343us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096597.582960:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 294 00000100:00100000:1.0:1787096597.583877:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096597.583911:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345536000 00000100:00100000:0.0:1787096597.583917:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345536000 00000100:00100000:0.0:1787096597.583956:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 295 00000100:00100000:0.0:1787096597.583965:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+8:41779:x1873906345536000:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787096597.583975:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096597.583986:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d63442c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8774 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584045:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584055:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584068:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584080:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584086:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584092:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584604:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584613:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584619:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096597.584627:0:5763:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 0 00010000:00010000:0.0:1787096597.584647:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584653:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584658:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584663:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda4a00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096597.584672:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584677:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584685:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9db2bca3af00) 00010000:00010000:0.0:1787096597.584688:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096597.584691:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584697:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d634433 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096597.584707:0:5763:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003f9117d4 reply state 000000000ccce868 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096597.584715:0:5763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787096597.584734:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4c00/0xdf123ee4d63442c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8774 expref: 11 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584745:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8774 expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.584752:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9db2bca3a900) 00010000:00010000:0.0:1787096597.584754:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096597.584757:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda5a00, rc 0) 00000100:00100000:0.0:1787096597.584794:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+11:41779:x1873906345536000:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 832us (917us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787096597.584801:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 295 00010000:00010000:1.0:1787096597.585366:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.585373:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.585384:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.585390:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda5800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096597.585393:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.585399:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.585409:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0xe0be4298 (ffff9db2bca3a100) 00010000:00010000:1.0:1787096597.585411:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096597.585414:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.585420:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63443a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0xe0be4298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096597.586081:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096597.586117:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345536256 00000100:00100000:0.0:1787096597.586123:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345536256 00000100:00100000:0.0:1787096597.586156:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 296 00000100:00100000:0.0:1787096597.586163:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+10:41779:x1873906345536256:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787096597.586187:0:5764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096597.586196:0:5764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63444f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d877b expref: -99 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.586231:0:5764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.586238:0:5764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8774 expref: 11 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.586243:0:5764:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.586263:0:5764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8774 expref: 11 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.586271:0:5764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8774 expref: 11 pid: 5763 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096597.586280:0:5764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5764:1873906353908352:192.168.203.45@tcp:104: 00000100:00100000:0.0:1787096597.586334:0:5764:0:(client.c:2692:ptlrpc_set_wait()) set ffff9db2bf9e1480 going to sleep for 11 seconds 00000100:00100000:0.0:1787096597.587097:0:5764:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5764:1873906353908352:192.168.203.45@tcp:104: 00010000:00010000:0.0:1787096597.587113:0:5764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096597.587230:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096597.587264:0:6554:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345536384 00000100:00100000:0.0:1787096597.587269:0:6554:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345536384 00010000:00010000:0.0:1787096597.587287:0:6554:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8774 expref: 12 pid: 5763 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096597.587311:0:6554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:0.0:1787096597.587318:0:6554:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7354022b-ee92-4e63-a611-5f745ec24594+12:2358:x1873906345536384:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787096597.587327:0:6554:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096597.587332:0:6554:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8774 expref: 12 pid: 5763 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.587342:0:6554:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8774 expref: 12 pid: 5763 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.587354:0:6554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5a00/0xdf123ee4d634441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8774 expref: 12 pid: 5763 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.587364:0:6554:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9db2bca3a900) 00010000:00010000:0.0:1787096597.587368:0:6554:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.587375:0:6554:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.587380:0:6554:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096597.587394:0:6554:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096597.587413:0:5764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096597.587420:0:6554:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7354022b-ee92-4e63-a611-5f745ec24594+11:2358:x1873906345536384:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 102us (190us total) trans 0 rc 0/0 00010000:00010000:1.0:1787096597.587426:0:5764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096597.587430:0:6554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00000004:00200000:1.0:1787096597.587442:0:5764:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 0 00010000:00010000:1.0:1787096597.587630:0:5764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.587637:0:5764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.587649:0:5764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.587654:0:5764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda5c00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096597.587656:0:5764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.587662:0:5764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.587670:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9db2bca3a900) 00010000:00010000:1.0:1787096597.587672:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787096597.587674:0:5764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.587680:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5c00/0xdf123ee4d634456 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.587706:0:5764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63444f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d877b expref: 10 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.587714:0:5764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9db2bca3af00) 00010000:00010000:1.0:1787096597.587716:0:5764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096597.587719:0:5764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5e00/0xdf123ee4d63444f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d877b expref: 10 pid: 5764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096597.587727:0:5764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda5e00, rc 0) 00000100:00100000:1.0:1787096597.587756:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+9:41779:x1873906345536256:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 1594us (1676us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096597.587771:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 296 00000100:00100000:1.0:1787096597.588546:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096597.588572:0:12749:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345536640 00000100:00100000:3.0:1787096597.588576:0:12749:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345536640 00000100:00100000:3.0:1787096597.588597:0:12749:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:3.0:1787096597.588602:0:12749:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7354022b-ee92-4e63-a611-5f745ec24594+9:41779:x1873906345536640:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:3.0:1787096597.588724:0:12749:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7354022b-ee92-4e63-a611-5f745ec24594+10:41779:x1873906345536640:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 121us (178us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787096597.588729:0:12749:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 61 00000001:00080000:3.0:1787096597.818408:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000001:00080000:0.0:1787096597.818427:0:31496:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000001:02000400:1.0:1787096598.058360:0:31962:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_28a: @@@@@@ FAIL: setstripe failed 00010000:00010000:3.0:1787096598.065627:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 916 lines, 916 kept, 0 dropped, 0 bad.