00010000:00010000:0.0F:1787096451.633645:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1787096451.636349:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096451.636405:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0F:1787096451.636407:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345465856 00000100:00100000:1.0:1787096451.636424:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345465856 00000100:00100000:2.0F:1787096451.636474:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345465984 00000100:00100000:1.0:1787096451.636481:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 210 00000100:00100000:2.0:1787096451.636487:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345465984 00000100:00100000:1.0:1787096451.636496:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a06bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345465856:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787096451.636548:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:2.0:1787096451.636555:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+7:2355:x1873906345465984:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787096451.636620:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+7:2355:x1873906345465984:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096451.636624:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a06bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345465856:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 130us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096451.636630:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 46 00000100:00100000:1.0:1787096451.636639:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 210 00000100:00100000:2.0:1787096451.642269:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096451.642326:0:6539:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345466112 00000100:00100000:0.0:1787096451.642333:0:6539:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345466112 00000100:00080000:2.0:1787096451.642374:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096451.642387:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 15 00000100:00100000:0.0:1787096451.642396:0:6539:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7354022b-ee92-4e63-a611-5f745ec24594+5:2354:x1873906345466112:12345-192.168.203.45@tcp:9:kworker.0 00000020:00000080:0.0:1787096451.642421:0:6539:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xdf123ee4d632e1b 00000100:00080000:0.0:1787096451.642429:0:6539:0:(import.c:65:import_set_state_nolock()) ffff9db2bf8a7000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787096451.642460:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787096451.642467:0:6539:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1787096451.642748:0:6539:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7354022b-ee92-4e63-a611-5f745ec24594+2:2354:x1873906345466112:12345-192.168.203.45@tcp:9:kworker.0 Request processed in 354us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096451.642755:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 15 00000001:00080000:0.0:1787096451.902196:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000100:00100000:3.0:1787096451.927418:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096451.927463:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345466240 00000100:00100000:0.0:1787096451.927472:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345466240 00000100:00100000:0.0:1787096451.927553:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:0.0:1787096451.927564:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+5:13781:x1873906345466240:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:0.0:1787096451.927580:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096451.927608:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4000/0xdf123ee4d633163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d827a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.927673:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d63316a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.927686:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d63316a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.927696:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d63316a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096451.927935:0:5795:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787096451.927945:0:5795:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787096451.928089:0:5795:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d63316a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.928132:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4000/0xdf123ee4d633163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d827a expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.928151:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d63316a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d827a expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.928159:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3a200) 00010000:00010000:0.0:1787096451.928162:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096451.928166:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda4e00, rc 0) 00000100:00100000:0.0:1787096451.928233:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+6:13781:x1873906345466240:12345-192.168.203.45@tcp:101:rm.0 Request processed in 671us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096451.928241:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 59 00000100:00100000:3.0:1787096451.929271:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096451.929320:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345466368 00000100:00100000:0.0:1787096451.929327:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345466368 00000100:00100000:0.0:1787096451.929371:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:0.0:1787096451.929382:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+6:13781:x1873906345466368:12345-192.168.203.45@tcp:101:rm.0 00010000:00010000:0.0:1787096451.929394:0:7424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096451.929405:0:7424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d633171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8281 expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929439:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929449:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929468:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929481:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929488:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929495:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929815:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d633186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929823:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d633186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929830:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d633186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096451.929850:0:7424:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787096451.929852:0:7424:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787096451.929861:0:7424:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d633186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929870:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d633186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929877:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929894:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929902:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929907:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda4a00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096451.929912:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929919:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929929:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3a200) 00010000:00010000:0.0:1787096451.929931:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096451.929935:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929940:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4a00/0xdf123ee4d633178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929951:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929957:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929963:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929968:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda5800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096451.929975:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929982:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.929991:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xddb0fc11 (ffff9db2bca3ab00) 00010000:00010000:0.0:1787096451.929994:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096451.929997:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.930003:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5800/0xdf123ee4d63317f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.930036:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5600/0xdf123ee4d633171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8281 expref: 8 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.930047:0:7424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d633186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8281 expref: 7 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096451.930055:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9db2bca3ae00) 00010000:00010000:0.0:1787096451.930058:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787096451.930061:0:7424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda5200, rc 0) 00000100:00100000:0.0:1787096451.930105:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+7:13781:x1873906345466368:12345-192.168.203.45@tcp:101:rm.0 Request processed in 725us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096451.930128:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 60 00000100:00100000:2.0:1787096451.931431:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096451.931470:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345466624 00000100:00100000:1.0:1787096451.931477:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345466624 00000100:00100000:1.0:1787096451.931551:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 61 00000100:00100000:1.0:1787096451.931559:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+7:13781:x1873906345466624:12345-192.168.203.45@tcp:36:rm.0 00010000:00010000:1.0:1787096451.931588:0:5763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787096451.931602:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d633186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8281 expref: 7 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931614:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9db2bca3ae00) 00010000:00010000:1.0:1787096451.931624:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d63316a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d827a expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931632:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2bca3a200) 00010000:00010000:1.0:1787096451.931636:0:5763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096451.931649:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931656:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931663:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931679:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931684:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931689:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931974:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931983:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.931989:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932823:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932831:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932837:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932842:0:5763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932847:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932861:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932879:0:5763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787096451.932892:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932896:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096451.932900:0:8214:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096451.932901:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096451.932907:0:8214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932908:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372a000 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096451.932914:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096451.932919:0:8214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372b400 already unused, calling callback (ffffffffc16156f0) 00010000:00010000:1.0:1787096451.932922:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096451.932924:0:8214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096451.932938:0:8214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932938:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9db2a2946300) 00010000:00010000:1.0:1787096451.932945:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096451.932952:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096451.932956:0:8214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9db2a2946300) 00010000:00010000:1.0:1787096451.932957:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d63319b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096451.932961:0:8214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096451.932966:0:8214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096451.932971:0:8214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932974:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.932982:0:5763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096451.932986:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096451.932989:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096451.932992:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096451.932996:0:5763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933001:0:5763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372a800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096451.933003:0:5763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933008:0:5763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933015:0:5763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946200) 00010000:00010000:1.0:1787096451.933016:0:5763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096451.933018:0:5763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933022:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d63318d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096451.933032:0:5763:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bfd8a478 reply state 0000000045466262 transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096451.933038:0:5763:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787096451.933085:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+7:13781:x1873906345466624:12345-192.168.203.45@tcp:36:rm.0 Request processed in 1527us (1658us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787096451.933091:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 61 00010000:00010000:1.0:1787096451.933691:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933701:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933720:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933727:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372ac00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096451.933730:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933739:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933747:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xddb0fc11 (ffff9db2a2946100) 00010000:00010000:1.0:1787096451.933750:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096451.933753:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096451.933757:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d633194 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5763 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787096452.410054:0:6565:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7354022b-ee92-4e63-a611-5f745ec24594 00000020:00000080:3.0:1787096452.410061:0:6565:0:(genops.c:906:class_export_put()) final put ffff9db2bf8a6800/7354022b-ee92-4e63-a611-5f745ec24594 00000020:00000080:2.0:1787096452.410089:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9db2bf8a6800/7354022b-ee92-4e63-a611-5f745ec24594 for lustre-OST0000 00000020:00000080:2.0:1787096452.410152:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9db2bf8a7000 for lustre-OST0000 00010000:00010000:1.0:1787096452.657611:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096452.913653:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353874176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096452.913731:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096452.913762:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353874176 00000100:00100000:1.0:1787096452.913771:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353874176 00000100:00080000:3.0:1787096452.913815:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787096452.913833:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787096452.913844:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353874176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787096452.913884:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096452.913935:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353874176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096452.913941:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787096452.913971:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353874176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787096453.681678:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096453.937625:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353874304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096453.937641:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1873906353874560:0@lo:400:kworker.0 00000100:00100000:1.0:1787096453.937705:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1873906353874688:0@lo:400:kworker.0 00000100:00100000:2.0:1787096453.937723:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096453.937723:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096453.937774:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096453.937806:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353874944:0@lo:400:kworker.0 00000100:00100000:0.0:1787096453.937808:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353875072:0@lo:400:kworker.0 00000100:00100000:1.0:1787096453.937819:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353874432:0@lo:400:kworker.0 00000100:00100000:2.0:1787096453.937842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096453.937855:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096453.937869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096453.937910:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353874816:0@lo:400:kworker.0 00000100:00100000:0.0:1787096453.937916:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353874560 00000100:00100000:0.0:1787096453.937926:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353874560 00000100:00100000:1.0:1787096453.937939:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096453.937987:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353874688 00000100:00100000:2.0:1787096453.937988:0:6540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353874304 00000100:00100000:0.0:1787096453.937988:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353874944 00000100:00100000:1.0:1787096453.937991:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353874688 00000100:00100000:2.0:1787096453.937995:0:6540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353874304 00000100:00100000:0.0:1787096453.937995:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353874944 00000100:00100000:0.0:1787096453.938047:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787096453.938050:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787096453.938057:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787096453.938062:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1873906353874560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096453.938063:0:6540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353874304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096453.938071:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1873906353874688:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1787096453.938126:0:6540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096453.938153:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1873906353874688:12345-0@lo:400:kworker.0 Request processed in 85us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096453.938159:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1873906353874560:12345-0@lo:400:kworker.0 Request processed in 100us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096453.938165:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787096453.938174:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787096453.938176:0:6540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353874304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096453.938184:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787096453.938193:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787096453.938203:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353874944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096453.938215:0:6536:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353875072 00000100:00100000:0.0:1787096453.938220:0:6536:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353875072 00010000:00080000:2.0:1787096453.938236:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bf980a80 x1873906353874304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096453.938247:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353874944:12345-0@lo:400:kworker.0 Request processed in 44us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096453.938253:0:6536:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353874816 00000100:00100000:1.0:1787096453.938257:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787096453.938258:0:6536:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353874816 00000100:00100000:2.0:1787096453.938261:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf980a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353874304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096453.938288:0:5758:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353874432 00000100:00100000:0.0:1787096453.938292:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787096453.938294:0:5758:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353874432 00000100:00100000:2.0:1787096453.938298:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353874944:0@lo:400:kworker.0 00000100:00100000:0.0:1787096453.938303:0:6536:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353875072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096453.938341:0:6536:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353875072:12345-0@lo:400:kworker.0 Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096453.938346:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00080000:2.0:1787096453.938354:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096453.938354:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787096453.938359:0:5758:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a06bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353874432:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787096453.938362:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096453.938373:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787096453.938386:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353874816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096453.938402:0:5758:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a06bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353874432:12345-0@lo:400:kworker.0 Request processed in 46us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096453.938410:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00010000:00080000:0.0:1787096453.938414:0:3294:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bfce0a80 x1873906353875072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096453.938426:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353875072:0@lo:400:kworker.0 00000100:00100000:3.0:1787096453.938437:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353874816:12345-0@lo:400:kworker.0 Request processed in 54us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096453.938454:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1873906353874560:0@lo:400:kworker.0 00000100:00100000:3.0:1787096453.938455:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787096453.938481:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353874432:0@lo:400:kworker.0 00000100:00100000:1.0:1787096453.938544:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353874816:0@lo:400:kworker.0 00000100:00100000:3.0:1787096453.938564:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3295:1873906353874688:0@lo:400:kworker.0 00000001:02000400:2.0:1787096454.458849:0:15074:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1h: setstripe with -N flag and explicit stripe counts with --ec ========================================================== 19:40:53 (1787096453) 00010000:00010000:1.0:1787096454.705720:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096455.047836:0:15123:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1h needs >= 6 OSTs 00000001:02000400:1.0:1787096455.718728:0:15171:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1i: default EC layout on directory ===== 19:40:54 (1787096454) 00010000:00010000:3.0:1787096455.730586:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096456.367296:0:15219:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1i needs >= 6 OSTs 00010000:00010000:1.0:1787096456.753718:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096456.756960:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096456.757005:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096456.757109:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345466752 00000100:00100000:1.0:1787096456.757118:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345466752 00000100:00100000:1.0:1787096456.757170:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 212 00000100:00100000:1.0:1787096456.757181:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2358:x1873906345466752:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787096456.757289:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2358:x1873906345466752:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 110us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096456.757298:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 212 00000100:00100000:2.0:1787096456.757616:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345466880 00000100:00100000:2.0:1787096456.757621:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345466880 00000100:00100000:2.0:1787096456.757684:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 50 00000100:00100000:2.0:1787096456.757695:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+6:2358:x1873906345466880:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787096456.757742:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+6:2358:x1873906345466880:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 50us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096456.757749:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 50 00000100:00080000:0.0:1787096456.757889:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787096457.030336:0:5785:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967323 is committed 00000001:02000400:3.0:1787096457.131898:0:15268:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1j: verify EC component inherits stripe size from data component ========================================================== 19:40:56 (1787096456) 00000001:02000400:1.0:1787096457.756760:0:15316:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1j needs >= 6 OSTs 00010000:00010000:3.0:1787096457.778645:0:364:0:(ldlm_pool.c:1331:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:0.0:1787096457.778675:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096458.033756:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353875200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096458.033821:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096458.034040:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353875200 00000100:00100000:0.0:1787096458.034048:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353875200 00000100:00080000:2.0:1787096458.034124:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096458.034176:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787096458.034187:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353875200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096458.034219:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096458.034272:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353875200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096458.034278:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787096458.034346:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353875200:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096458.570062:0:15364:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1k: test we can create -c (n-2) --ec (n-2)+2 with n OSTs ========================================================== 19:40:57 (1787096457) 00010000:00010000:1.0:1787096458.802204:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096459.057749:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787096459.057821:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353875328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096459.058327:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096459.058483:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353875328 00000100:00100000:0.0:1787096459.058494:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353875328 00000100:00100000:0.0:1787096459.058612:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787096459.058676:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787096459.058730:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353875328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787096459.058775:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096459.058845:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353875328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 224us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096459.058858:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787096459.058953:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bf982d80 x1873906353875328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096459.058978:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf982d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353875328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096459.065236:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1873906353875584:0@lo:400:kworker.0 00000100:00100000:0.0:1787096459.065310:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3297:1873906353875456:0@lo:400:kworker.0 00000100:00100000:1.0:1787096459.065328:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096459.066105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096459.066123:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787096459.066136:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353875712:0@lo:400:kworker.0 00000100:00100000:1.0:1787096459.066164:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096459.066200:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353875584 00000100:00100000:1.0:1787096459.066207:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353875584 00000100:00100000:0.0:1787096459.066226:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353875968:0@lo:400:kworker.0 00000100:00100000:1.0:1787096459.066253:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353875712 00000100:00100000:1.0:1787096459.066257:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353875712 00000100:00100000:0.0:1787096459.066258:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096459.066284:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787096459.066289:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353875968 00000100:00100000:1.0:1787096459.066293:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353875968 00000100:00100000:0.0:1787096459.066301:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353875840:0@lo:400:kworker.0 00000100:00100000:1.0:1787096459.066313:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787096459.066322:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1873906353875584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096459.066334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096459.066368:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787096459.066382:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1873906353875584:12345-0@lo:400:kworker.0 Request processed in 58us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096459.066382:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353875712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096459.066395:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787096459.066417:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787096459.066423:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353875712:12345-0@lo:400:kworker.0 Request processed in 47us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096459.066428:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353875968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096459.066435:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787096459.066459:0:6536:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353875840 00000100:00100000:0.0:1787096459.066464:0:6536:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353875840 00000100:00100000:1.0:1787096459.066471:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1873906353875968:12345-0@lo:400:kworker.0 Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096459.066480:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787096459.066529:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096459.066536:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787096459.066545:0:6536:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353875840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096459.066560:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353875712:0@lo:400:kworker.0 00000100:00100000:1.0:1787096459.066574:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3294:1873906353875584:0@lo:400:kworker.0 00000100:00100000:0.0:1787096459.066580:0:6536:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353875840:12345-0@lo:400:kworker.0 Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096459.066587:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787096459.066614:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353875840:0@lo:400:kworker.0 00000100:00100000:1.0:1787096459.066625:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3297:1873906353875968:0@lo:400:kworker.0 00000100:00100000:3.0:1787096459.066706:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353875456 00000100:00100000:3.0:1787096459.066710:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353875456 00000100:00100000:3.0:1787096459.066743:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787096459.066750:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3297:x1873906353875456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096459.067623:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3297:x1873906353875456:12345-0@lo:400:kworker.0 Request processed in 872us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096459.067631:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787096459.067696:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3297:1873906353875456:0@lo:400:kworker.0 00000001:02000400:3.0:1787096459.247413:0:15412:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1k needs 8 OSTs 00010000:00010000:3.0:1787096459.825584:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096460.022870:0:15460:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1l: test stripe creation fails when parity needs one stripe too many ========================================================== 19:40:58 (1787096458) 00000001:02000400:2.0:1787096460.765985:0:15508:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1l needs 8 OSTs 00010000:00010000:1.0:1787096460.849652:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096461.574406:0:15556:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2a: setstripe with -N and EC =========== 19:41:00 (1787096460) 00010000:00010000:0.0:1787096461.873682:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096461.877545:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096461.877625:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096461.877702:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345467136 00000100:00100000:2.0:1787096461.877721:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345467136 00000100:00100000:2.0:1787096461.877790:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00100000:2.0:1787096461.877800:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+5:2358:x1873906345467136:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787096461.877870:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+5:2358:x1873906345467136:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096461.877877:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 54 00000100:00080000:3.0:1787096461.878288:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096461.878324:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345467008 00000100:00100000:1.0:1787096461.878329:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345467008 00000100:00100000:1.0:1787096461.878391:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 214 00000100:00100000:1.0:1787096461.878398:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2358:x1873906345467008:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787096461.878436:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2358:x1873906345467008:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 39us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096461.878450:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 214 00000001:02000400:3.0:1787096462.257387:0:15605:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2a needs >= 8 OSTs 00010000:00010000:2.0:1787096462.897682:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096463.070161:0:15653:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2b: setstripe with -N: two data mirrors, one with EC ========================================================== 19:41:01 (1787096461) 00000100:00100000:2.0:1787096463.157769:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787096463.157788:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfd28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353876096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787096463.157863:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096463.157937:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353876096 00000100:00100000:0.0:1787096463.157945:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353876096 00000100:00100000:0.0:1787096463.158002:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787096463.158011:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353876096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096463.158057:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787096463.158066:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096463.158108:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353876096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096463.158116:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787096463.158164:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfd28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353876096:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787096463.791234:0:15701:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2b needs >= 8 OSTs 00010000:00010000:3.0:1787096463.921649:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096464.179170:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353876224:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179239:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096464.179290:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353876736:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179319:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096464.179356:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096464.179362:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353876608:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179391:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096464.179420:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353876352:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179443:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096464.179458:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353876864:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179483:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096464.179518:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787096464.179525:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1873906353876480:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179551:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096464.179581:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353876736 00000100:00100000:1.0:1787096464.179588:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353876736 00000100:00100000:1.0:1787096464.179637:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353876352 00000100:00100000:1.0:1787096464.179640:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353876352 00000100:00100000:1.0:1787096464.179657:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353876480 00000100:00100000:1.0:1787096464.179659:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353876480 00000100:00100000:1.0:1787096464.179676:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787096464.179684:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353876736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179737:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353876736:12345-0@lo:400:kworker.0 Request processed in 52us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096464.179744:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787096464.179774:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787096464.179781:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353876352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179817:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353876352:12345-0@lo:400:kworker.0 Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096464.179823:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787096464.179836:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787096464.179842:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1873906353876480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179868:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1873906353876480:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096464.179874:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787096464.179893:0:6538:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353876608 00000100:00100000:1.0:1787096464.179896:0:6538:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353876608 00000100:00100000:1.0:1787096464.179921:0:6538:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353876864 00000100:00100000:1.0:1787096464.179924:0:6538:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353876864 00000100:00100000:1.0:1787096464.179948:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787096464.179955:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353876608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.179987:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353876608:12345-0@lo:400:kworker.0 Request processed in 34us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096464.179992:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787096464.180004:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787096464.180010:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353876864:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787096464.180133:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787096464.180138:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787096464.180189:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1873906353876480:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.180201:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353876864:12345-0@lo:400:kworker.0 Request processed in 189us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096464.180203:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353876352:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.180216:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787096464.180222:0:3296:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db286395180 x1873906353876864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096464.180233:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353876864:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.180268:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353876608:0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.180280:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353876736:0@lo:400:kworker.0 00000100:00100000:3.0:1787096464.181126:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353876224 00000100:00100000:3.0:1787096464.181130:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353876224 00000100:00100000:1.0:1787096464.181161:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353876992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096464.181162:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787096464.181173:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353876224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096464.181201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096464.181230:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353876224:12345-0@lo:400:kworker.0 Request processed in 58us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096464.181238:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787096464.181242:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353876992 00000100:00100000:1.0:1787096464.181248:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353876992 00000100:00100000:1.0:1787096464.181280:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787096464.181289:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db286396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353876992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096464.181304:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353876224:0@lo:400:kworker.0 00002000:00000024:1.0:1787096464.181316:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096464.181409:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db286396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353876992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096464.181414:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787096464.181449:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bfce0e00 x1873906353876992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096464.181460:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353876992:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787096464.506548:0:15749:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2c: setstripe with -N: two data mirrors, both with EC ========================================================== 19:41:03 (1787096463) 00010000:00010000:1.0:1787096464.945663:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096465.167145:0:15797:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2c needs >= 8 OSTs 00000001:02000400:3.0:1787096465.958009:0:15845:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2d: setstripe with -N2: multiple identical EC mirrors ========================================================== 19:41:04 (1787096464) 00010000:00010000:1.0:1787096465.970624:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096466.688773:0:15893:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2d needs >= 8 OSTs 00010000:00010000:2.0:1787096466.993746:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096466.997626:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096466.997744:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096466.997811:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345467264 00000100:00100000:1.0:1787096466.997824:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345467264 00000100:00100000:2.0:1787096466.997844:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345467392 00000100:00100000:2.0:1787096466.997859:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345467392 00000100:00100000:1.0:1787096466.997950:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 216 00000100:00100000:1.0:1787096466.997963:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345467264:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787096466.998026:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00100000:2.0:1787096466.998040:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345467392:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787096466.998067:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345467264:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 105us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096466.998077:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 216 00000100:00100000:2.0:1787096466.998121:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345467392:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 84us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096466.998129:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 58 00000100:00080000:0.0:1787096466.998295:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787096467.478215:0:15941:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2e: setstripe with -N: mixed regular and EC mirrors ========================================================== 19:41:06 (1787096466) 00010000:00010000:2.0:1787096468.018027:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096468.196444:0:15989:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2e needs >= 8 OSTs 00000100:00100000:3.0:1787096468.275043:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787096468.275064:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfd29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353877120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096468.275124:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096468.275160:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353877120 00000100:00100000:2.0:1787096468.275168:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353877120 00000100:00080000:3.0:1787096468.275203:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096468.275241:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787096468.275252:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353877120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096468.275294:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096468.275346:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353877120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096468.275353:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787096468.275451:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfd29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353877120:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787096469.022105:0:16037:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2f: default EC layout on directory using mirror mode ========================================================== 19:41:07 (1787096467) 00010000:00010000:0.0:1787096469.041739:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096469.297754:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353877632:0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.297754:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353877376:0@lo:400:kworker.0 00000100:00100000:1.0:1787096469.297770:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353877248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096469.297820:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873906353877504:0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.297831:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096469.297851:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096469.297873:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db284906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353878016:0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.297873:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1873906353877888:0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.297892:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096469.297893:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096469.297958:0:5758:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353877376 00000100:00100000:0.0:1787096469.297958:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353877504 00000100:00100000:1.0:1787096469.297963:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096469.297964:0:5758:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353877376 00000100:00100000:0.0:1787096469.297965:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353877504 00000100:00100000:1.0:1787096469.297991:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db286395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353877760:0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.298013:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353877888 00000100:00100000:0.0:1787096469.298018:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353877888 00000100:00100000:3.0:1787096469.298026:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787096469.298035:0:5758:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353877376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096469.298043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096469.298064:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787096469.298071:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873906353877504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096469.298079:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353877248 00000100:00100000:3.0:1787096469.298089:0:5758:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353877376:12345-0@lo:400:kworker.0 Request processed in 54us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096469.298090:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353877248 00000100:00100000:0.0:1787096469.298107:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873906353877504:12345-0@lo:400:kworker.0 Request processed in 36us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096469.298112:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787096469.298113:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787096469.298129:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787096469.298132:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787096469.298139:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bbfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353877248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096469.298143:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1873906353877888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096469.298152:0:6538:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353878016 00000100:00100000:3.0:1787096469.298155:0:6538:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353878016 00000100:00100000:0.0:1787096469.298170:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1873906353877888:12345-0@lo:400:kworker.0 Request processed in 31us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096469.298176:0:6538:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353877760 00000100:00100000:0.0:1787096469.298176:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787096469.298178:0:6538:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353877760 00000100:00100000:3.0:1787096469.298203:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787096469.298207:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787096469.298208:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1873906353878016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.298212:0:6536:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc6e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353877760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096469.298238:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1873906353878016:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096469.298239:0:6536:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc6e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353877760:12345-0@lo:400:kworker.0 Request processed in 28us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096469.298247:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787096469.298251:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787096469.298267:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787096469.298271:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:1.0:1787096469.298276:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787096469.298321:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bbfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353877248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096469.298328:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787096469.298387:0:3295:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bfce1880 x1873906353877248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096469.298407:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353877248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096469.298422:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353877760:0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.298437:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353877376:0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.298449:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1873906353877888:0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.298522:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873906353877504:0@lo:400:kworker.0 00010000:00080000:0.0:1787096469.298537:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db284906680 x1873906353878016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096469.298546:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db284906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353878016:0@lo:400:kworker.0 00000100:00100000:2.0:1787096469.299318:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096469.299422:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353877632 00000100:00100000:0.0:1787096469.299427:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353877632 00000100:00100000:0.0:1787096469.299532:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787096469.299549:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353877632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096469.299600:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353877632:12345-0@lo:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096469.299606:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787096469.299705:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096469.300034:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db286395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353877632:0@lo:400:kworker.0 00000001:02000400:1.0:1787096469.704939:0:16086:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2f needs >= 8 OSTs 00010000:00010000:1.0:1787096470.065741:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096470.560322:0:16134:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3a: lfs mirror create with single EC mirror ========================================================== 19:41:09 (1787096469) 00010000:00010000:0.0:1787096471.090720:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096471.270047:0:16182:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3a needs >= 8 OSTs 00000001:02000400:1.0:1787096472.012230:0:16230:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3b: lfs mirror create with -N2 and EC == 19:41:10 (1787096470) 00010000:00010000:2.0:1787096472.116056:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096472.119375:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096472.119419:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096472.119489:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345467648 00000100:00100000:1.0:1787096472.119556:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345467520 00000100:00100000:1.0:1787096472.119562:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345467520 00000100:00100000:1.0:1787096472.119613:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 218 00000100:00100000:1.0:1787096472.119624:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345467520:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787096472.119658:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345467648 00000100:00100000:0.0:1787096472.119713:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:0.0:1787096472.119721:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:2356:x1873906345467648:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787096472.119743:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2356:x1873906345467520:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 119us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096472.119752:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 218 00000100:00100000:0.0:1787096472.119756:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:2356:x1873906345467648:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 33us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096472.119763:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00080000:3.0:1787096472.119825:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787096472.680179:0:16278:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3b needs >= 8 OSTs 00010000:00010000:1.0:1787096473.138159:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096473.393724:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787096473.393741:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfd2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353878144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096473.393792:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096473.393938:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353878144 00000100:00100000:2.0:1787096473.393944:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353878144 00000100:00100000:2.0:1787096473.394041:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787096473.394052:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353878144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096473.394084:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096473.394138:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353878144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096473.394144:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787096473.394198:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787096473.394328:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfd2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353878144:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787096473.449670:0:16326:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3c: lfs mirror create with mixed EC and regular mirrors ========================================================== 19:41:12 (1787096472) 00000001:02000400:1.0:1787096474.104219:0:16374:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3c needs >= 8 OSTs 00010000:00010000:1.0:1787096474.161678:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096474.417681:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787096474.417706:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bbfb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3294:1873906353878272:0@lo:400:kworker.0 00000100:00100000:1.0:1787096474.417732:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bbfb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353878400:0@lo:400:kworker.0 00000100:00100000:2.0:1787096474.417802:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bbfb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353878784:0@lo:400:kworker.0 00000100:00100000:1.0:1787096474.417833:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096474.417863:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bbfb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1873906353878528:0@lo:400:kworker.0 00000100:00100000:2.0:1787096474.417890:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096474.417892:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353878912:0@lo:400:kworker.0 00000100:00100000:1.0:1787096474.417926:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096474.417934:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096474.417962:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096474.417990:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353878400 00000100:00100000:1.0:1787096474.417998:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353878400 00000100:00100000:3.0:1787096474.418057:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353879040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096474.418073:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353878528 00000100:00100000:1.0:1787096474.418077:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353878528 00000100:00100000:3.0:1787096474.418100:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096474.418105:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353878784 00000100:00100000:1.0:1787096474.418109:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353878784 00000100:00080000:3.0:1787096474.418142:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096474.418143:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787096474.418154:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353878400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096474.418159:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787096474.418170:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1873906353878528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096474.418212:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfa85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353878400:12345-0@lo:400:kworker.0 Request processed in 59us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096474.418219:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1873906353878528:12345-0@lo:400:kworker.0 Request processed in 51us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096474.418222:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787096474.418231:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787096474.418248:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787096474.418256:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353878784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096474.418261:0:6538:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353878912 00000100:00100000:3.0:1787096474.418265:0:6538:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353878912 00000100:00100000:1.0:1787096474.418289:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353878784:12345-0@lo:400:kworker.0 Request processed in 35us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096474.418297:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787096474.418301:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787096474.418309:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353878912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096474.418327:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353879040 00000100:00100000:1.0:1787096474.418331:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353879040 00000100:00100000:3.0:1787096474.418344:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfa86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3296:x1873906353878912:12345-0@lo:400:kworker.0 Request processed in 36us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096474.418359:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787096474.418364:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787096474.418369:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1873906353879040:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787096474.418394:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787096474.418397:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787096474.418420:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bbfb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1873906353878528:0@lo:400:kworker.0 00000100:00100000:1.0:1787096474.418442:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353879040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (341us total) trans 0 rc 0/0 00010000:00080000:3.0:1787096474.418446:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bfce3480 x1873906353879040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096490 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096474.418452:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787096474.418468:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353879040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096474.418491:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bbfb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353878400:0@lo:400:kworker.0 00010000:00080000:1.0:1787096474.418529:0:3296:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bfa86d80 x1873906353878912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787096474.418539:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfa86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353878912:0@lo:400:kworker.0 00000100:00100000:0.0:1787096474.418573:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096474.418657:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bbfb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353878656:0@lo:400:kworker.0 00000100:00100000:2.0:1787096474.418680:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096474.418711:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bbfb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353878784:0@lo:400:kworker.0 00000100:00100000:0.0:1787096474.418819:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353878656 00000100:00100000:0.0:1787096474.418823:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353878656 00000100:00100000:0.0:1787096474.418857:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787096474.418865:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353878656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096474.418897:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353878656:12345-0@lo:400:kworker.0 Request processed in 33us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096474.418903:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787096474.418972:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bbfb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353878656:0@lo:400:kworker.0 00000100:00100000:3.0:1787096474.419023:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353878272 00000100:00100000:3.0:1787096474.419026:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353878272 00000100:00100000:3.0:1787096474.419134:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787096474.419141:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3294:x1873906353878272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096474.419234:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3294:x1873906353878272:12345-0@lo:400:kworker.0 Request processed in 93us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096474.419240:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787096474.419296:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bbfb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3294:1873906353878272:0@lo:400:kworker.0 00000001:02000400:1.0:1787096474.895947:0:16422:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3d: lfs mirror create with different EC configs per mirror ========================================================== 19:41:13 (1787096473) 00010000:00010000:0.0:1787096475.185748:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096475.598178:0:16470:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3d needs >= 8 OSTs 00010000:00010000:0.0:1787096476.217030:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096476.364109:0:16519:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3e: lfs mirror create with multiple EC specs in one mirror ========================================================== 19:41:15 (1787096475) 00000001:02000400:1.0:1787096477.077431:0:16568:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3e needs >= 8 OSTs 00010000:00010000:1.0:1787096477.233730:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096477.238825:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096477.238872:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096477.238958:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345467904 00000100:00100000:1.0:1787096477.238961:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345467776 00000100:00100000:3.0:1787096477.238968:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345467904 00000100:00100000:1.0:1787096477.238968:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345467776 00000100:00100000:1.0:1787096477.239060:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 220 00000100:00100000:1.0:1787096477.239071:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345467776:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096477.239096:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:3.0:1787096477.239107:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345467904:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787096477.239137:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345467776:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 68us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096477.239145:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+5:2355:x1873906345467904:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 40us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096477.239147:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 220 00000100:00100000:3.0:1787096477.239157:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00080000:0.0:1787096477.239318:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787096477.924121:0:16616:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3f: EC inheritance with holes ========== 19:41:16 (1787096476) 00010000:00010000:1.0:1787096478.258536:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096478.513771:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787096478.513822:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353879168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787096478.513881:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096478.514005:0:6540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353879168 00000100:00100000:2.0:1787096478.514012:0:6540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353879168 00000100:00080000:0.0:1787096478.514082:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096478.514090:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787096478.514099:0:6540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353879168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096478.514130:0:6540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096478.514181:0:6540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfa86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353879168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096478.514188:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787096478.514240:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353879168:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787096478.612183:0:16664:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3f needs >= 8 OSTs 00010000:00010000:2.0:1787096479.281618:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787096479.432079:0:16712:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3g: EC parity mirror inherits pool from data mirror ========================================================== 19:41:18 (1787096478) 00000100:00100000:1.0:1787096479.537782:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353879296:0@lo:400:kworker.0 00000100:00100000:3.0:1787096479.537811:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353879680:0@lo:400:kworker.0 00000100:00100000:1.0:1787096479.537852:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096479.537914:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096479.537921:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353879808:0@lo:400:kworker.0 00000100:00100000:3.0:1787096479.537961:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1873906353879552:0@lo:400:kworker.0 00000100:00100000:1.0:1787096479.537968:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096479.537993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096479.538005:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353879424:0@lo:400:kworker.0 00000100:00100000:3.0:1787096479.538030:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353879296 00000100:00100000:1.0:1787096479.538035:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096479.538038:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353879296 00000100:00100000:1.0:1787096479.538055:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfce3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353879936:0@lo:400:kworker.0 00000100:00100000:1.0:1787096479.538076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096479.538083:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787096479.538092:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353879296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096479.538106:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353879808 00000100:00100000:1.0:1787096479.538111:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353879808 00000100:00100000:3.0:1787096479.538136:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353879296:12345-0@lo:400:kworker.0 Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096479.538142:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787096479.538151:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353879552 00000100:00100000:1.0:1787096479.538155:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353879552 00000100:00100000:3.0:1787096479.538172:0:6538:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353879680 00000100:00100000:1.0:1787096479.538179:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353879424 00000100:00100000:3.0:1787096479.538181:0:6538:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353879680 00000100:00100000:1.0:1787096479.538183:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353879424 00000100:00100000:3.0:1787096479.538206:0:6538:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353879936 00000100:00100000:3.0:1787096479.538210:0:6538:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353879936 00000100:00100000:1.0:1787096479.538210:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787096479.538220:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353879808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096479.538229:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787096479.538236:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353879680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096479.538262:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfa85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353879808:12345-0@lo:400:kworker.0 Request processed in 43us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096479.538268:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353879680:12345-0@lo:400:kworker.0 Request processed in 34us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096479.538272:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787096479.538276:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787096479.538291:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787096479.538299:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353879936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096479.538300:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787096479.538312:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1873906353879552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096479.538326:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353879936:12345-0@lo:400:kworker.0 Request processed in 31us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096479.538330:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787096479.538345:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787096479.538349:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353879424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096479.538357:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1873906353879552:12345-0@lo:400:kworker.0 Request processed in 47us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096479.538365:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787096479.538383:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353879424:12345-0@lo:400:kworker.0 Request processed in 34us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096479.538388:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787096479.538388:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787096479.538395:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096479.538437:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3297:1873906353879552:0@lo:400:kworker.0 00000100:00100000:1.0:1787096479.538458:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353879808:0@lo:400:kworker.0 00000100:00100000:3.0:1787096479.538464:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353879424:0@lo:400:kworker.0 00000100:00100000:1.0:1787096479.538476:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353879296:0@lo:400:kworker.0 00010000:00080000:3.0:1787096479.538478:0:3296:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bfce3800 x1873906353879936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096479.538487:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353879936:0@lo:400:kworker.0 00000100:00100000:3.0:1787096479.538520:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353879680:0@lo:400:kworker.0 00000100:00100000:3.0:1787096479.539125:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353880064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787096479.539153:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096479.539216:0:6541:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353880064 00000100:00100000:2.0:1787096479.539220:0:6541:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353880064 00000100:00100000:2.0:1787096479.539254:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787096479.539261:0:6541:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353880064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787096479.539288:0:6541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096479.539326:0:6541:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353880064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096479.539333:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787096479.539358:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bf980700 x1873906353880064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096479.539371:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf980700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353880064:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787096480.149410:0:16760:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3g needs >= 6 OSTs 00010000:00010000:0.0:1787096480.305855:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096480.885729:0:16808:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4a: reject invalid EC parameters: parity > data ========================================================== 19:41:19 (1787096479) 00000100:00100000:2.0:1787096480.954289:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096480.954340:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345468032 00000100:00100000:1.0:1787096480.954348:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345468032 00000100:00080000:2.0:1787096480.954430:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096480.954442:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:1.0:1787096480.954451:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+5:19124:x1873906345468032:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:1.0:1787096480.954466:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096480.954483:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d6331a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8288 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.954545:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d6331b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.954557:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d6331b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.954566:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d6331b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096480.954742:0:5765:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787096480.954746:0:5765:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787096480.954871:0:5765:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d6331b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.954895:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a800/0xdf123ee4d6331a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8288 expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.954909:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d6331b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8288 expref: 6 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.954936:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:1.0:1787096480.954939:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096480.954942:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db28372a000, rc 0) 00000100:00100000:1.0:1787096480.954991:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:19124:x1873906345468032:12345-192.168.203.45@tcp:101:bash.0 Request processed in 541us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096480.954998:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 62 00000100:00100000:3.0:1787096480.957078:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096480.957164:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345468160 00000100:00100000:1.0:1787096480.957172:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345468160 00000100:00100000:1.0:1787096480.957217:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 63 00000100:00100000:1.0:1787096480.957225:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+6:19124:x1873906345468160:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:1.0:1787096480.957242:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096480.957257:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6331b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d828f expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957307:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957319:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957329:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957380:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957387:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957404:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957633:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957641:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957648:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957654:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372a200 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096480.957658:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957671:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957684:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:1.0:1787096480.957686:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096480.957690:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957697:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d6331be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957707:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957717:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957727:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957732:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372ac00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096480.957735:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957741:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957748:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe4042ea3 (ffff9db2a2946300) 00010000:00010000:1.0:1787096480.957751:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096480.957753:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957758:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ac00/0xdf123ee4d6331c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957787:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6331b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d828f expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957796:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:1.0:1787096480.957798:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096480.957801:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a600/0xdf123ee4d6331b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d828f expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096480.957809:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db28372a600, rc 0) 00000100:00100000:1.0:1787096480.957860:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+6:19124:x1873906345468160:12345-192.168.203.45@tcp:101:bash.0 Request processed in 636us (840us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096480.957873:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 63 00010000:00010000:1.0:1787096481.329783:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096482.356685:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096482.358619:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096482.358664:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096482.358780:0:5764:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345468416 00000100:00100000:2.0:1787096482.358789:0:5764:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345468416 00000100:00080000:1.0:1787096482.358857:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096482.358858:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:2.0:1787096482.358875:0:5764:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bc846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+6:2355:x1873906345468416:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096482.358957:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345468288 00000100:00100000:2.0:1787096482.358960:0:5764:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bc846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7354022b-ee92-4e63-a611-5f745ec24594+6:2355:x1873906345468416:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096482.358963:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345468288 00000100:00100000:2.0:1787096482.358972:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 70 00000100:00100000:3.0:1787096482.359011:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 222 00000100:00100000:3.0:1787096482.359020:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345468288:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:3.0:1787096482.359049:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2355:x1873906345468288:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 30us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096482.359054:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 222 00010000:00010000:2.0:1787096483.377699:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096483.633833:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787096483.633853:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353880192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096483.633921:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096483.634005:0:6540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353880192 00000100:00100000:0.0:1787096483.634012:0:6540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353880192 00000100:00100000:0.0:1787096483.634058:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787096483.634137:0:6540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353880192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787096483.634169:0:6540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096483.634209:0:6540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1873906353880192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00080000:2.0:1787096483.634240:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787096483.634386:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3295:1873906353880192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096483.637403:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000001:02000400:3.0:1787096483.803355:0:17003:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4b: reject invalid EC parameters: data count < 2 ========================================================== 19:41:22 (1787096482) 00000100:00100000:3.0:1787096483.872271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096483.872318:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345468544 00000100:00100000:1.0:1787096483.872429:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345468544 00000100:00100000:1.0:1787096483.872479:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 64 00000100:00100000:1.0:1787096483.872488:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:19698:x1873906345468544:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:1.0:1787096483.872713:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096483.872817:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b600/0xdf123ee4d6331cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d8296 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.872955:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.872971:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.872984:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873000:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873006:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873022:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873281:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873289:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873295:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873301:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372ba00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096483.873304:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873311:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873322:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:1.0:1787096483.873325:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096483.873401:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873409:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372ba00/0xdf123ee4d6331d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873421:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873427:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873441:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873447:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372a400 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096483.873450:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873456:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873465:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91f44901 (ffff9db2a2946400) 00010000:00010000:1.0:1787096483.873468:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096483.873471:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873476:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a400/0xdf123ee4d6331da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873571:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b600/0xdf123ee4d6331cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8296 expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873582:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:1.0:1787096483.873585:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096483.873589:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b600/0xdf123ee4d6331cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8296 expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096483.873600:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db28372b600, rc 0) 00000100:00100000:1.0:1787096483.873675:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:19698:x1873906345468544:12345-192.168.203.45@tcp:101:bash.0 Request processed in 1188us (1411us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096483.873691:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 64 00010000:00010000:0.0:1787096484.402101:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096484.657738:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353880704:0@lo:400:kworker.0 00000100:00100000:3.0:1787096484.657772:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353880448:0@lo:400:kworker.0 00000100:00100000:2.0:1787096484.657800:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096484.657810:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bc847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873906353880576:0@lo:400:kworker.0 00000100:00100000:3.0:1787096484.657817:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096484.657852:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096484.657864:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2b4533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1873906353880960:0@lo:400:kworker.0 00000100:00100000:2.0:1787096484.657865:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787096484.657877:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bf983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353880320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096484.657881:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2b4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353881088:0@lo:400:kworker.0 00000100:00100000:2.0:1787096484.657932:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096484.657935:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353880704 00000100:00100000:0.0:1787096484.657939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096484.657943:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353880704 00000100:00100000:2.0:1787096484.657958:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2b4530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353880832:0@lo:400:kworker.0 00000100:00100000:2.0:1787096484.657987:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096484.657987:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353880576 00000100:00100000:0.0:1787096484.657993:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353880576 00000100:00100000:1.0:1787096484.658006:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787096484.658019:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353880704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096484.658034:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353881088 00000100:00100000:0.0:1787096484.658034:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787096484.658040:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353881088 00000100:00100000:0.0:1787096484.658047:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873906353880576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096484.658071:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353880832 00000100:00100000:2.0:1787096484.658074:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353880832 00000100:00100000:1.0:1787096484.658083:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1873906353880704:12345-0@lo:400:kworker.0 Request processed in 68us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096484.658091:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787096484.658099:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787096484.658104:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1873906353880576:12345-0@lo:400:kworker.0 Request processed in 58us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096484.658111:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353881088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787096484.658121:0:5758:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353880448 00000100:00100000:1.0:1787096484.658126:0:5758:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353880448 00000100:00100000:0.0:1787096484.658132:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787096484.658158:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353881088:12345-0@lo:400:kworker.0 Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096484.658163:0:5758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787096484.658167:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787096484.658178:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787096484.658179:0:5758:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353880448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787096484.658183:0:6538:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353880832:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787096484.658221:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787096484.658222:0:5758:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3296:x1873906353880448:12345-0@lo:400:kworker.0 Request processed in 48us (405us total) trans 0 rc 0/0 00000100:00080000:2.0:1787096484.658226:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096484.658234:0:5758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787096484.658240:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353880320 00000100:00100000:2.0:1787096484.658244:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353880320 00000100:00100000:0.0:1787096484.658246:0:6538:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353880832:12345-0@lo:400:kworker.0 Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096484.658256:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787096484.658276:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787096484.658295:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353880320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096484.658311:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3297:1873906353880576:0@lo:400:kworker.0 00000100:00100000:0.0:1787096484.658321:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2b4530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353880832:0@lo:400:kworker.0 00010000:00080000:1.0:1787096484.658329:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2b4530700 x1873906353881088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1787096484.658332:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787096484.658340:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3294:1873906353880704:0@lo:400:kworker.0 00000100:00100000:1.0:1787096484.658349:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2b4530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353881088:0@lo:400:kworker.0 00000100:00100000:2.0:1787096484.658377:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353880320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096484.658384:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787096484.658566:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096484.658596:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bc846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3296:1873906353880448:0@lo:400:kworker.0 00000100:00100000:1.0:1787096484.658648:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353880960 00000100:00100000:1.0:1787096484.658652:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353880960 00000100:00080000:2.0:1787096484.658698:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096484.658726:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787096484.658734:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1873906353880960:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787096484.658746:0:3294:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db2bf983480 x1873906353880320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787096484.658764:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bf983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353880320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787096484.658773:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1873906353880960:12345-0@lo:400:kworker.0 Request processed in 40us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096484.658786:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787096484.658811:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2b4533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3296:1873906353880960:0@lo:400:kworker.0 00010000:00010000:1.0:1787096485.426732:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096486.449754:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787096486.451327:0:17197:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4c: reject invalid EC parameters: parity = 0 ========================================================== 19:41:25 (1787096485) 00000100:00100000:0.0:1787096486.502180:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096486.502223:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345468672 00000100:00100000:2.0:1787096486.502231:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345468672 00000100:00100000:2.0:1787096486.502300:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 65 00000100:00080000:3.0:1787096486.502306:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096486.502312:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+6:20273:x1873906345468672:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:2.0:1787096486.502331:0:7424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096486.502349:0:7424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e69600/0xdf123ee4d6331e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d829d expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502395:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502405:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502412:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502460:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502469:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502489:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502835:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502843:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502850:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502856:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db282e68800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096486.502861:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502868:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502880:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:2.0:1787096486.502883:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096486.502902:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502909:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68800/0xdf123ee4d6331e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502921:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502928:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502941:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502947:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db282e68600 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:2.0:1787096486.502950:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502956:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502965:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefd6f96f (ffff9db282c28200) 00010000:00010000:2.0:1787096486.502968:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096486.502971:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.502977:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e68600/0xdf123ee4d6331ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.503022:0:7424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e69600/0xdf123ee4d6331e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d829d expref: 7 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.503032:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:2.0:1787096486.503035:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096486.503038:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db282e69600/0xdf123ee4d6331e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d829d expref: 7 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096486.503047:0:7424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db282e69600, rc 0) 00000100:00100000:2.0:1787096486.503105:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+6:20273:x1873906345468672:12345-192.168.203.45@tcp:101:bash.0 Request processed in 796us (931us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096486.503225:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 65 00010000:00010000:2.0:1787096487.473919:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096487.476746:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096487.477226:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:2.0:1787096487.477276:0:5763:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345468928 00000100:00100000:2.0:1787096487.477771:0:5763:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345468928 00000100:00100000:2.0:1787096487.477900:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 74 00000100:00100000:2.0:1787096487.477912:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+6:2358:x1873906345468928:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:2.0:1787096487.477983:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7354022b-ee92-4e63-a611-5f745ec24594+6:2358:x1873906345468928:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 73us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096487.477991:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 74 00000100:00100000:0.0:1787096487.478200:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345468800 00000100:00100000:0.0:1787096487.478205:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345468800 00000100:00100000:0.0:1787096487.478276:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 224 00000100:00100000:0.0:1787096487.478287:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2358:x1873906345468800:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787096487.478333:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2358:x1873906345468800:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 50us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096487.478340:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 224 00010000:00010000:0.0:1787096488.499915:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096488.756035:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfd28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353881216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096488.756094:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096488.756184:0:6540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353881216 00000100:00100000:2.0:1787096488.756191:0:6540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353881216 00000100:00100000:2.0:1787096488.756238:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787096488.756247:0:6540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353881216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096488.756275:0:6540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787096488.756548:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096488.760598:0:6540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353881216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4346us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096488.760612:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787096488.760651:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfd28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353881216:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787096489.050348:0:17391:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4d: reject malformed EC specifications ========================================================== 19:41:28 (1787096488) 00000100:00100000:2.0:1787096489.117417:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096489.117550:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345469056 00000100:00100000:1.0:1787096489.117558:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345469056 00000100:00100000:1.0:1787096489.117617:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 66 00000100:00100000:1.0:1787096489.117628:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:20847:x1873906345469056:12345-192.168.203.45@tcp:101:bash.0 00010000:00010000:1.0:1787096489.117646:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787096489.117653:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787096489.117709:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6331f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d82a4 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.117766:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.117782:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.117795:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.117810:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.117818:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.117825:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118112:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118125:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118131:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118136:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372b400 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096489.118140:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118147:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118158:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:1.0:1787096489.118162:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096489.118167:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118173:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d6331fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118185:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118191:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118196:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118201:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372a200 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:1.0:1787096489.118212:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118219:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118229:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe13ef5f2 (ffff9db2a2946000) 00010000:00010000:1.0:1787096489.118231:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096489.118234:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118240:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d633204 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118274:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6331f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82a4 expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118286:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:1.0:1787096489.118288:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096489.118293:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372bc00/0xdf123ee4d6331f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82a4 expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096489.118304:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db28372bc00, rc 0) 00000100:00100000:1.0:1787096489.118358:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:20847:x1873906345469056:12345-192.168.203.45@tcp:101:bash.0 Request processed in 732us (954us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096489.118365:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 66 00010000:00010000:1.0:1787096489.521839:0:5752:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096489.777621:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2bfd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353881344:0@lo:400:kworker.0 00000100:00100000:3.0:1787096489.777689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096489.777689:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db283718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353881472:0@lo:400:kworker.0 00000100:00100000:3.0:1787096489.777747:0:3295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db28371ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353881856:0@lo:400:kworker.0 00000100:00100000:0.0:1787096489.777785:0:3294:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db283719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353881728:0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.777974:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096489.777996:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db283719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353881984:0@lo:400:kworker.0 00000100:00100000:3.0:1787096489.778002:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096489.778028:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096489.778046:0:5759:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353881344 00000100:00100000:3.0:1787096489.778053:0:5759:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353881344 00000100:00100000:2.0:1787096489.778053:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787096489.778066:0:3296:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db283719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1873906353881600:0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.778093:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096489.778103:0:5759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787096489.778114:0:5759:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353881344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.778127:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353881472 00000100:00100000:2.0:1787096489.778132:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353881472 00000100:00100000:2.0:1787096489.778163:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353881856 00000100:00100000:2.0:1787096489.778166:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353881856 00000100:00100000:3.0:1787096489.778172:0:5759:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c+18:3295:x1873906353881344:12345-0@lo:400:kworker.0 Request processed in 60us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096489.778180:0:5759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787096489.778193:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353881600 00000100:00100000:2.0:1787096489.778196:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353881600 00000100:00100000:2.0:1787096489.778218:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787096489.778227:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db28371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353881472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787096489.778233:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787096489.778243:0:5763:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353881856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.778267:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db28371b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1873906353881472:12345-0@lo:400:kworker.0 Request processed in 42us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096489.778275:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787096489.778290:0:5763:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1873906353881856:12345-0@lo:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096489.778293:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787096489.778302:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db283719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1873906353881600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.778330:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db283719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1873906353881600:12345-0@lo:400:kworker.0 Request processed in 31us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096489.778336:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787096489.778353:0:7838:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353881984 00000100:00100000:2.0:1787096489.778357:0:7838:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353881984 00000100:00100000:3.0:1787096489.778369:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787096489.778384:0:7838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787096489.778391:0:7838:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db28371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353881984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787096489.778397:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787096489.778403:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096489.778431:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db28371ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3295:1873906353881856:0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.778436:0:7838:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db28371a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1873906353881984:12345-0@lo:400:kworker.0 Request processed in 44us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096489.778443:0:7838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787096489.778447:0:3295:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2bfd29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6fcd7dc5-8395-4e52-9587-0c2c9aa0341c:3295:1873906353881344:0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.778484:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db283719880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3296:1873906353881600:0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.778496:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db283718e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3296:1873906353881472:0@lo:400:kworker.0 00010000:00080000:2.0:1787096489.778538:0:3296:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db283719c00 x1873906353881984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787096505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096489.778550:0:3296:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db283719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3296:1873906353881984:0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.778617:0:3297:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db283719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353882112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787096489.778649:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096489.778685:0:7693:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353882112 00000100:00100000:2.0:1787096489.778688:0:7693:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353882112 00000100:00100000:2.0:1787096489.778719:0:7693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787096489.778729:0:7693:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db283718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353882112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787096489.778755:0:7693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787096489.778789:0:7693:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db283718e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1873906353882112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096489.778796:0:7693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787096489.778823:0:3297:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9db283719c00 x1873906353882112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787096489.778839:0:3297:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db283719c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3297:1873906353882112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787096489.778912:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096489.779028:0:6539:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353881728 00000100:00100000:2.0:1787096489.779032:0:6539:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353881728 00000100:00100000:2.0:1787096489.779102:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787096489.779111:0:6539:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353881728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787096489.779151:0:6539:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1873906353881728:12345-0@lo:400:kworker.0 Request processed in 43us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096489.779159:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787096489.779234:0:3294:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db283719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3294:1873906353881728:0@lo:400:kworker.0 00010000:00010000:1.0:1787096490.545753:0:5753:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096491.570583:0:6553:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096491.571470:0:17586:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4e: auto-create [0,EOF] component when --ec without -E ========================================================== 19:41:30 (1787096490) 00000100:00100000:0.0:1787096491.632902:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096491.632939:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345469184 00000100:00100000:0.0:1787096491.632947:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345469184 00000100:00100000:0.0:1787096491.633010:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:0.0:1787096491.633020:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+6:21570:x1873906345469184:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:0.0:1787096491.633037:0:7424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096491.633056:0:7424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d63320b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d82ab expref: -99 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633110:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633123:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633133:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633186:0:7424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787096491.633189:0:5760:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787096491.633196:0:7424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633214:0:7424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633438:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633447:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633454:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633460:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda4e00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096491.633464:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633471:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633483:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:0.0:1787096491.633486:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096491.633491:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633497:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4e00/0xdf123ee4d633212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633538:0:7424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633545:0:7424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633557:0:7424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633562:0:7424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2acda4800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096491.633566:0:7424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633572:0:7424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633581:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35a08a1b (ffff9db2bca3a900) 00010000:00010000:0.0:1787096491.633583:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096491.633586:0:7424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633592:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda4800/0xdf123ee4d633219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633636:0:7424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d63320b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82ab expref: 7 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633646:0:7424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:0.0:1787096491.633649:0:7424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096491.633653:0:7424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2acda5200/0xdf123ee4d63320b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82ab expref: 7 pid: 7424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.633665:0:7424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2acda5200, rc 0) 00000100:00100000:0.0:1787096491.633718:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+6:21570:x1873906345469184:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 699us (821us total) trans 0 rc 301/301 00000100:00100000:0.0:1787096491.633733:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 67 00000100:00100000:3.0:1787096491.637478:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:3.0:1787096491.637714:0:5795:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345469440 00000100:00100000:3.0:1787096491.637720:0:5795:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345469440 00000100:00100000:3.0:1787096491.637754:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 68 00000100:00100000:3.0:1787096491.637762:0:5795:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+6:21570:x1873906345469440:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:3.0:1787096491.637780:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096491.637782:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787096491.637804:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a000/0xdf123ee4d6331b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d8288 expref: 6 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.637819:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946d00) 00010000:00010000:3.0:1787096491.637828:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096491.637838:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebe00/0xdf123ee4d633220 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d82b2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.638099:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.638113:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.638253:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.638273:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.638280:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.638287:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639707:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639715:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639721:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096491.639727:0:5795:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:3.0:1787096491.639744:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639748:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639752:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639756:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2a23eb800 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096491.639760:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639777:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639787:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db284b25100) 00010000:00010000:3.0:1787096491.639791:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096491.639795:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639801:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb800/0xdf123ee4d633227 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096491.639814:0:5795:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000976b8461 reply state 00000000d4b6bbb1 transno 4294967324 ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096491.639822:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096491.639846:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebe00/0xdf123ee4d633220 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b2 expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639871:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b2 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.639878:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9db284b25000) 00010000:00010000:3.0:1787096491.639881:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096491.639883:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db2a23eb000, rc 0) 00000100:00100000:3.0:1787096491.639948:0:5795:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7354022b-ee92-4e63-a611-5f745ec24594+8:21570:x1873906345469440:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 2186us (2473us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787096491.639956:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 68 00010000:00010000:0.0:1787096491.641133:0:3280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.641143:0:3280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.641151:0:3280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.641158:0:3280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db2a23ebc00 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:0.0:1787096491.641161:0:3280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.641168:0:3280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.641179:0:3280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35a08a1b (ffff9db284b25800) 00010000:00010000:0.0:1787096491.641181:0:3280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096491.641185:0:3280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096491.641191:0:3280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23ebc00/0xdf123ee4d63322e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096491.641821:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096491.641896:0:5765:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345469696 00000100:00100000:1.0:1787096491.641902:0:5765:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345469696 00000100:00100000:1.0:1787096491.641952:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:1.0:1787096491.641962:0:5765:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+7:21570:x1873906345469696:12345-192.168.203.45@tcp:101:lfs.0 00010000:00010000:1.0:1787096491.641980:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096491.641994:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d633243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93bbba3c5a0d82b9 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.642051:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.642063:0:5765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b2 expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.642072:0:5765:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.642101:0:5765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b2 expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.642116:0:5765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b2 expref: 8 pid: 5795 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096491.642128:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9db2b4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5765:1873906353882240:192.168.203.45@tcp:104: 00000100:00100000:1.0:1787096491.642204:0:5765:0:(client.c:2692:ptlrpc_set_wait()) set ffff9db282b15a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787096491.643058:0:5765:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9db2b4530700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5765:1873906353882240:192.168.203.45@tcp:104: 00010000:00010000:1.0:1787096491.643078:0:5765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096491.643571:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096491.643612:0:5750:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345469824 00000100:00100000:1.0:1787096491.643624:0:5750:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345469824 00010000:00010000:1.0:1787096491.643646:0:5750:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b2 expref: 9 pid: 5795 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096491.643681:0:5750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 33 00000100:00100000:1.0:1787096491.643690:0:5750:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7354022b-ee92-4e63-a611-5f745ec24594+9:2357:x1873906345469824:12345-192.168.203.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096491.643699:0:5750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096491.643705:0:5750:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b2 expref: 9 pid: 5795 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.643716:0:5750:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b2 expref: 9 pid: 5795 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.643733:0:5750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db2a23eb000/0xdf123ee4d633235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b2 expref: 9 pid: 5795 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.643745:0:5750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9db284b25000) 00010000:00010000:1.0:1787096491.643749:0:5750:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.643757:0:5750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.643764:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096491.643785:0:5750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096491.643816:0:5750:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7354022b-ee92-4e63-a611-5f745ec24594+8:2357:x1873906345469824:12345-192.168.203.45@tcp:103:ldlm_bl.0 Request processed in 129us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096491.643832:0:5750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 33 00010000:00010000:3.0:1787096491.643920:0:5765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.643929:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096491.643942:0:5765:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:3.0:1787096491.644312:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.644321:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.644327:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.644332:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9db28372a200 already unused, calling callback (ffffffffc205b4f0) 00010000:00010000:3.0:1787096491.644336:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.644342:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.644352:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff9db284b25000) 00010000:00010000:3.0:1787096491.644355:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787096491.644358:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.644364:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372a200/0xdf123ee4d63324a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.644392:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d633243 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b9 expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.644412:0:5765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9db2a2946e00) 00010000:00010000:3.0:1787096491.644415:0:5765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096491.644419:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9db28372b400/0xdf123ee4d633243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.45@tcp remote: 0x93bbba3c5a0d82b9 expref: 7 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096491.644432:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9db28372b400, rc 0) 00000100:00100000:3.0:1787096491.644467:0:5765:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7354022b-ee92-4e63-a611-5f745ec24594+6:21570:x1873906345469696:12345-192.168.203.45@tcp:101:lfs.0 Request processed in 2507us (2649us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096491.644474:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 69 00000100:00100000:3.0:1787096491.646262:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:0.0:1787096491.646343:0:5766:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345470080 00000100:00100000:0.0:1787096491.646348:0:5766:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345470080 00000100:00100000:0.0:1787096491.646382:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 11 00000100:00100000:0.0:1787096491.646390:0:5766:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bfd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7354022b-ee92-4e63-a611-5f745ec24594+6:21570:x1873906345470080:12345-192.168.203.45@tcp:35:lfs.0 00000100:00100000:0.0:1787096491.646614:0:5766:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bfd29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7354022b-ee92-4e63-a611-5f745ec24594+7:21570:x1873906345470080:12345-192.168.203.45@tcp:35:lfs.0 Request processed in 225us (354us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787096491.646629:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 11 00000001:02000400:2.0:1787096492.134994:0:17634:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_4e: @@@@@@ FAIL: setstripe failed 00010000:00010000:0.0:1787096492.594412:0:8214:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096492.596323:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096492.596408:0:5757:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345470208 00000100:00100000:1.0:1787096492.596417:0:5757:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345470208 00000100:00100000:1.0:1787096492.596463:0:5757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 226 00000100:00100000:1.0:1787096492.596473:0:5757:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2a0687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2357:x1873906345470208:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:0.0:1787096492.596574:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.45@tcp (source: 12345-192.168.203.45@tcp) 00000100:00100000:1.0:1787096492.596612:0:5757:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2a0687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ec888d3e-dbb7-4169-a63e-f9e2c57de4f6+9:2357:x1873906345470208:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 140us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096492.596620:0:5757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 226 00000100:00100000:1.0:1787096492.596668:0:7424:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345470336 00000100:00100000:1.0:1787096492.596672:0:7424:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345470336 00000100:00100000:1.0:1787096492.596708:0:7424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.45@tcp, seq: 78 00000100:00100000:1.0:1787096492.596715:0:7424:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9db2bf982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+7:2357:x1873906345470336:12345-192.168.203.45@tcp:400:kworker.0 00000100:00100000:1.0:1787096492.596757:0:7424:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9db2bf982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7354022b-ee92-4e63-a611-5f745ec24594+7:2357:x1873906345470336:12345-192.168.203.45@tcp:400:kworker.0 Request processed in 39us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096492.596764:0:7424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.45@tcp, seq: 78 Debug log: 1346 lines, 1346 kept, 0 dropped, 0 bad.