00000100:00100000:0.0F:1782107392.066101:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec215d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472466944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107392.066225:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1782107392.066345:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472466944 00000100:00100000:3.0:1782107392.066358:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472466944 00000100:00100000:3.0:1782107392.066486:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782107392.066496:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472466944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107392.066542:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107392.066648:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472466944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107392.066655:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1782107392.066812:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107392.066847:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec215d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472466944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107392.320236:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1782107393.092953:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472467072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107393.093080:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107393.093161:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472467072 00000100:00100000:2.0:1782107393.093169:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472467072 00000100:00100000:2.0:1782107393.093218:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1782107393.093227:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472467072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107393.093261:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107393.094059:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472467072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 830us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107393.094069:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:2.0:1782107393.094095:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782107393.094196:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990fb800 x1868674472467072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107393.094218:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472467072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107393.285140:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107393.285412:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447238016 00000100:00100000:3.0:1782107393.285425:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447238016 00000100:00100000:3.0:1782107393.285522:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 136 00000100:00100000:3.0:1782107393.285535:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:28520:x1868674447238016:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:3.0:1782107393.285559:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1782107393.285561:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782107393.285587:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7c51c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec6088df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.285656:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7c523 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.285670:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7c523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.285683:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7c523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107393.285997:0:5807:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782107393.286001:0:5807:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782107393.286077:0:5807:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7c523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.286171:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7c51c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088df expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.286187:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7c523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088df expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.286197:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54300) 00010000:00010000:3.0:1782107393.286200:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782107393.286203:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec16f5200, rc 0) 00000100:00100000:3.0:1782107393.286310:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:28520:x1868674447238016:12345-192.168.202.26@tcp:101:rm.0 Request processed in 778us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107393.286318:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 136 00000100:00100000:0.0:1782107393.293917:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107393.294217:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447238144 00000100:00100000:3.0:1782107393.294228:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447238144 00000100:00100000:3.0:1782107393.294281:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 137 00000100:00100000:3.0:1782107393.294291:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:28520:x1868674447238144:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:3.0:1782107393.294312:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107393.294333:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c52a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec6088e6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.294414:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.294430:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.294441:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.294464:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.294472:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.294478:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295298:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c53f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295309:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c53f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295317:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c53f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107393.295347:0:5809:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x11:0x0]: returning size 0 00000004:00200000:3.0:1782107393.295350:0:5809:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782107393.295369:0:5809:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c53f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295379:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c53f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295387:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295393:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295409:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295415:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f5600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107393.295420:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295428:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295439:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54300) 00010000:00010000:3.0:1782107393.295442:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107393.295447:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295453:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295464:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295470:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295475:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295480:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f5e00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107393.295483:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295499:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295507:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff8abe86b54d00) 00010000:00010000:3.0:1782107393.295510:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107393.295523:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295530:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c538 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295562:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c52a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088e6 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295574:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c53f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088e6 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107393.295582:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff8abe86b54c00) 00010000:00010000:3.0:1782107393.295584:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782107393.295587:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec16f4800, rc 0) 00000100:00100000:3.0:1782107393.295962:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+7:28520:x1868674447238144:12345-192.168.202.26@tcp:101:rm.0 Request processed in 1670us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107393.295994:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 137 00000100:00100000:3.0:1782107393.302925:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107393.303969:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447238400 00000100:00100000:2.0:1782107393.304002:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447238400 00000100:00100000:2.0:1782107393.304056:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 138 00000100:00100000:2.0:1782107393.304066:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:28520:x1868674447238400:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:2.0:1782107393.304127:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782107393.304151:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c53f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088e6 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304169:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff8abe86b54c00) 00010000:00010000:2.0:1782107393.304183:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7c523 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088df expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304191:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54300) 00010000:00010000:2.0:1782107393.304217:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782107393.304241:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304254:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304272:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304285:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304292:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304298:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304639:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304649:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.304657:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305385:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305395:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305415:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305423:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305430:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305435:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305454:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782107393.305473:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305480:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305486:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305492:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107393.305496:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305503:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305524:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff8abe898b2b00) 00010000:00010000:2.0:1782107393.305527:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782107393.305536:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305543:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348600/0xc2d453a189c7c554 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x11:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305559:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305565:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305571:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305576:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107393.305579:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305586:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305594:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe898b2a00) 00010000:00010000:2.0:1782107393.305597:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107393.305600:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.305606:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7c546 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782107393.305618:0:5808:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a32fcf78 reply state 00000000db7b64f6 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107393.305636:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0F:1782107393.305640:0:5796:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782107393.305654:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107393.305663:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1349600 already unused, calling callback (ffffffffc13e26f0) 00010000:00010000:1.0:1782107393.305666:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107393.305674:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107393.305686:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x11:0x0].0x0 (ffff8abe898b2b00) 00010000:00010000:1.0:1782107393.305689:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782107393.305693:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107393.305699:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7c55b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x11:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107393.305712:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:28520:x1868674447238400:12345-192.168.202.26@tcp:36:rm.0 Request processed in 1644us (2795us total) trans 4294967353 rc 0/0 00010000:00010000:1.0:1782107393.305714:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107393.305717:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107393.305720:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107393.305724:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 138 00010000:00010000:2.0:1782107393.308864:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.308880:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.308887:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.308893:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1349400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107393.308897:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.308904:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.308920:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe65b522 (ffff8abe898b2800) 00010000:00010000:2.0:1782107393.308923:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107393.308928:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107393.308934:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7c54d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfe65b522 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107393.326032:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107393.326105:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447238528 00000100:00100000:0.0:1782107393.326116:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447238528 00000100:00100000:0.0:1782107393.326173:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 361 00000100:00100000:0.0:1782107393.326184:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447238528:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107393.326260:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447238528:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107393.326269:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 361 00010000:00010000:1.0:1782107393.344284:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107394.369109:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107395.136272:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472467456:0@lo:400:kworker.0 00000100:00100000:0.0:1782107395.136347:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107395.136398:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107395.136404:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472467584:0@lo:400:kworker.0 00000100:00100000:0.0:1782107395.136426:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107395.136451:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472467456 00000100:00100000:0.0:1782107395.136457:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472467456 00000100:00100000:0.0:1782107395.136510:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1782107395.136520:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472467456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107395.136570:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472467456:12345-0@lo:400:kworker.0 Request processed in 53us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107395.136578:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1782107395.136603:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472467584 00000100:00100000:0.0:1782107395.136613:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472467584 00000100:00100000:0.0:1782107395.136643:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1782107395.136649:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd810b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472467584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107395.136683:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd810b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472467584:12345-0@lo:400:kworker.0 Request processed in 34us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107395.136689:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1782107395.136705:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782107395.136709:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782107395.136748:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef4a300 x1868674472467584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107395.136761:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472467584:0@lo:400:kworker.0 00000100:00100000:0.0:1782107395.136772:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472467456:0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.136880:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472467200:0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.136914:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107395.136944:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472467712:0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.136967:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107395.137010:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782107395.137016:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472467328:0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.137039:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107395.137061:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472467840:0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.137083:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107395.137107:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472467712 00000100:00100000:1.0:1782107395.137111:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472467712 00000100:00100000:1.0:1782107395.137137:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472467328 00000100:00100000:1.0:1782107395.137140:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472467328 00000100:00100000:1.0:1782107395.137156:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1782107395.137162:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472467712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.137198:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472467712:12345-0@lo:400:kworker.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107395.137204:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1782107395.137217:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1782107395.137223:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472467328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.137259:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472467328:12345-0@lo:400:kworker.0 Request processed in 25us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107395.137266:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1782107395.137298:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472467328:0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.137307:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472467712:0@lo:400:kworker.0 00000100:00100000:0.0:1782107395.137624:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472467200 00000100:00100000:0.0:1782107395.137629:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472467200 00000100:00100000:1.0:1782107395.137687:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1782107395.137696:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472467200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.137731:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472467200:12345-0@lo:400:kworker.0 Request processed in 37us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107395.137737:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1782107395.137769:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472467840 00000100:00100000:0.0:1782107395.137773:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472467840 00000100:00100000:0.0:1782107395.137801:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1782107395.137807:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472467840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107395.137839:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472467840:12345-0@lo:400:kworker.0 Request processed in 33us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107395.137845:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:0.0:1782107395.137865:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782107395.137868:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107395.137926:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472467840:0@lo:400:kworker.0 00000100:00100000:1.0:1782107395.137934:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472467200:0@lo:400:kworker.0 00010000:00010000:2.0:1782107395.395069:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107396.425742:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782107396.707574:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000100:00100000:3.0:1782107397.184405:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107397.184428:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec215e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472467968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107397.184494:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107397.184692:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472467968 00000100:00100000:1.0:1782107397.184700:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472467968 00000100:00100000:1.0:1782107397.184767:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782107397.184777:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472467968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107397.184810:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107397.184857:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472467968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107397.184865:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782107397.184909:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec215e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472467968:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107397.185065:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782107397.440133:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107398.211169:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472468096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107398.211244:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107398.211338:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472468096 00000100:00100000:0.0:1782107398.211347:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472468096 00000100:00100000:0.0:1782107398.211407:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1782107398.211417:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472468096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107398.211459:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107398.211513:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472468096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107398.211521:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1782107398.211542:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782107398.211573:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef48380 x1868674472468096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107398.211588:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472468096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107398.445886:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107398.445933:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107398.446070:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447238784 00000100:00100000:3.0:1782107398.446082:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447238784 00000100:00100000:3.0:1782107398.446152:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 349 00000100:00100000:3.0:1782107398.446164:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447238784:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107398.446260:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447238784:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 99us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107398.446270:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 349 00000100:00080000:3.0:1782107398.446295:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107398.446680:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447238656 00000100:00100000:2.0:1782107398.446696:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447238656 00000100:00100000:2.0:1782107398.446733:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 363 00000100:00100000:2.0:1782107398.446740:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447238656:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107398.446774:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447238656:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 36us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107398.446781:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 363 00010000:00010000:2.0:1782107398.468260:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107399.488539:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107400.257501:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472468480:0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.257501:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472468352:0@lo:400:kworker.0 00000100:00100000:1.0:1782107400.257570:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec215d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472468224:0@lo:400:kworker.0 00000100:00100000:3.0:1782107400.262240:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107400.262556:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107400.262570:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472468608:0@lo:400:kworker.0 00000100:00100000:3.0:1782107400.262613:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107400.262931:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107400.262967:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472468864:0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.263023:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107400.263058:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472468480 00000100:00100000:2.0:1782107400.263066:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472468480 00000100:00100000:2.0:1782107400.263115:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472468352 00000100:00100000:2.0:1782107400.263118:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472468352 00000100:00100000:2.0:1782107400.263138:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1782107400.263146:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472468480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.263196:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472468480:12345-0@lo:400:kworker.0 Request processed in 51us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107400.263204:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1782107400.263221:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1782107400.263227:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472468352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.263258:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472468352:12345-0@lo:400:kworker.0 Request processed in 31us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107400.263264:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1782107400.263282:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472468608 00000100:00100000:2.0:1782107400.263298:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472468608 00000100:00100000:2.0:1782107400.263322:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472468864 00000100:00100000:2.0:1782107400.263324:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472468864 00000100:00100000:2.0:1782107400.263342:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1782107400.263347:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472468608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.263375:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472468608:12345-0@lo:400:kworker.0 Request processed in 28us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107400.263396:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1782107400.263408:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782107400.263414:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472468864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.263445:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472468864:12345-0@lo:400:kworker.0 Request processed in 32us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107400.263458:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:2.0:1782107400.263476:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782107400.263480:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782107400.263482:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782107400.263633:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef3ca80 x1868674472468608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107400.263647:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472468608:0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.263661:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472468480:0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.263691:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472468352:0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.264047:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472468864:0@lo:400:kworker.0 00000100:00100000:0.0:1782107400.266168:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107400.266274:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472468736:0@lo:400:kworker.0 00000100:00100000:0.0:1782107400.266315:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107400.266503:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472468736 00000100:00100000:2.0:1782107400.266513:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472468736 00000100:00100000:2.0:1782107400.266576:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1782107400.266585:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472468736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107400.266646:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472468736:12345-0@lo:400:kworker.0 Request processed in 62us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107400.266653:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:2.0:1782107400.266675:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107400.269223:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472468736:0@lo:400:kworker.0 00000100:00100000:1.0:1782107400.269998:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472468224 00000100:00100000:1.0:1782107400.270007:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472468224 00000100:00100000:1.0:1782107400.270056:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1782107400.270067:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472468224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107400.270154:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472468224:12345-0@lo:400:kworker.0 Request processed in 88us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107400.270163:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1782107400.270402:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec215d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472468224:0@lo:400:kworker.0 00010000:00010000:0.0:1782107400.513183:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107400.639227:0:23879:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 10: cannot create overly large ec mirrors ========================================================== 01:49:59 (1782107399) 00010000:00010000:0.0:1782107401.554965:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107402.091771:0:23928:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_10 needs >= 5 OSTs 00000100:00100000:3.0:1782107402.312428:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472468992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107402.312506:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107402.315772:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472468992 00000100:00100000:3.0:1782107402.315787:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472468992 00000100:00100000:3.0:1782107402.315865:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782107402.315876:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472468992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107402.315912:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107402.316002:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472468992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (3495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107402.316009:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1782107402.316048:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107402.316091:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472468992:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107402.560271:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107403.330395:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107403.330419:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472469120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107403.330504:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107403.330756:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472469120 00000100:00100000:2.0:1782107403.330765:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472469120 00000100:00100000:2.0:1782107403.330833:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782107403.330844:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472469120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107403.330897:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107403.330948:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472469120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107403.330956:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1782107403.331116:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782107403.331189:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec0e2df80 x1868674472469120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107403.331219:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472469120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107403.568842:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107403.568898:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107403.569250:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447239040 00000100:00100000:1.0:1782107403.569274:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447239040 00000100:00100000:1.0:1782107403.569338:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 353 00000100:00100000:1.0:1782107403.569349:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447239040:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107403.569436:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447239040:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107403.569444:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 353 00000100:00080000:3.0:1782107403.570609:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107403.573202:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447238912 00000100:00100000:0.0:1782107403.573222:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447238912 00000100:00100000:0.0:1782107403.573296:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 365 00000100:00100000:0.0:1782107403.573307:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447238912:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107403.573419:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447238912:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 106us (4582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107403.573449:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 365 00010000:00010000:1.0:1782107403.584085:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107403.624965:0:23976:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 11: can create --ec 2+2 ================ 01:50:02 (1782107402) 00010000:00010000:0.0:1782107404.618343:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107405.160064:0:24024:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_11 needs >= 4 OSTs 00000100:00100000:1.0:1782107405.376725:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472469504:0@lo:400:kworker.0 00000100:00100000:1.0:1782107405.376794:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107405.376844:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107405.376851:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf21f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472469632:0@lo:400:kworker.0 00000100:00100000:0.0:1782107405.376920:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472469376:0@lo:400:kworker.0 00000100:00100000:2.0:1782107405.376964:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe99077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472469248:0@lo:400:kworker.0 00000100:00100000:0.0:1782107405.379039:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107405.379093:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472469888:0@lo:400:kworker.0 00000100:00100000:0.0:1782107405.379128:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107405.383649:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107405.383724:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf21f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472469760:0@lo:400:kworker.0 00000100:00100000:2.0:1782107405.383764:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107405.383954:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472469248 00000100:00100000:0.0:1782107405.383964:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472469248 00000100:00100000:0.0:1782107405.384027:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1782107405.384036:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472469248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107405.384096:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472469248:12345-0@lo:400:kworker.0 Request processed in 60us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107405.384103:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1782107405.384927:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472469504 00000100:00100000:2.0:1782107405.384933:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472469504 00000100:00100000:2.0:1782107405.385052:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472469376 00000100:00100000:2.0:1782107405.385056:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472469376 00000100:00100000:2.0:1782107405.385069:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472469760 00000100:00100000:2.0:1782107405.385071:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472469760 00000100:00100000:1.0:1782107405.385447:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107405.386133:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472469888 00000100:00100000:1.0:1782107405.386139:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472469888 00000100:00100000:2.0:1782107405.387655:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1782107405.387669:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeafffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472469504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107405.387765:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeafffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472469504:12345-0@lo:400:kworker.0 Request processed in 100us (10970us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107405.387772:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1782107405.387788:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1782107405.387794:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472469376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107405.387842:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472469376:12345-0@lo:400:kworker.0 Request processed in 36us (8797us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107405.387848:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1782107405.387859:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782107405.387866:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472469760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107405.387894:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472469760:12345-0@lo:400:kworker.0 Request processed in 30us (4131us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107405.387900:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00080000:0.0:1782107405.388064:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782107405.388070:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107405.390825:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472469632 00000100:00100000:1.0:1782107405.390840:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472469632 00000100:00100000:1.0:1782107405.391391:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782107405.391404:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472469888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107405.391508:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472469888:12345-0@lo:400:kworker.0 Request processed in 107us (12378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107405.391516:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782107405.391724:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782107405.391735:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeafffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472469632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107405.391768:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeafffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472469632:12345-0@lo:400:kworker.0 Request processed in 36us (6326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107405.391775:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1782107405.391805:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107405.392073:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe99077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472469248:0@lo:400:kworker.0 00000100:00100000:3.0:1782107405.392092:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf21f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472469760:0@lo:400:kworker.0 00010000:00080000:2.0:1782107405.392657:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebf21f800 x1868674472469632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107405.392670:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf21f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472469632:0@lo:400:kworker.0 00000100:00100000:2.0:1782107405.392681:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472469504:0@lo:400:kworker.0 00000100:00100000:2.0:1782107405.392712:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472469376:0@lo:400:kworker.0 00000100:00100000:2.0:1782107405.392722:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472469888:0@lo:400:kworker.0 00010000:00010000:0.0:1782107405.632441:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107406.657278:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107406.753879:0:24072:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12a skipping ALWAYS excluded test 12a 00000100:00100000:1.0:1782107407.424466:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107407.424490:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472470016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107407.424561:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107407.424848:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472470016 00000100:00100000:0.0:1782107407.424857:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472470016 00000100:00100000:0.0:1782107407.424923:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782107407.424934:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeaffffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472470016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107407.424969:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782107407.425063:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107407.425572:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeaffffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472470016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 638us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107407.425581:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782107407.428224:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472470016:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107407.680277:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107408.448713:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782107408.448734:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472470144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107408.448801:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107408.448860:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472470144 00000100:00100000:2.0:1782107408.448878:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472470144 00000100:00100000:2.0:1782107408.448933:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1782107408.448942:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472470144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107408.448997:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107408.449042:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472470144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107408.449050:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1782107408.449069:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782107408.449168:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec1308380 x1868674472470144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107408.449184:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472470144:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1782107408.652187:0:24121:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_12b skipping ALWAYS excluded test 12b 00000100:00100000:3.0:1782107408.686224:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107408.686275:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447239296 00000100:00100000:3.0:1782107408.686278:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107408.686287:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447239296 00000100:00100000:2.0:1782107408.686361:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 357 00000100:00100000:2.0:1782107408.686372:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447239296:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107408.686458:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447239296:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107408.686465:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 357 00000100:00080000:3.0:1782107408.686524:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107408.688477:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447239168 00000100:00100000:1.0:1782107408.688492:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447239168 00000100:00100000:1.0:1782107408.688556:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 367 00000100:00100000:1.0:1782107408.688567:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447239168:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107408.688627:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447239168:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 62us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107408.688635:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 367 00010000:00010000:1.0:1782107408.704606:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107409.728850:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107410.290657:0:24169:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 13: parity of single stripe data is just a copy ========================================================== 01:50:09 (1782107409) 00000100:00100000:3.0:1782107410.498754:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf21f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472470400:0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.498839:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107410.498885:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472470912:0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.498909:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107410.498937:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782107410.498943:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472470272:0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.498967:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107410.499025:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472470784:0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.499047:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107410.499071:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf21f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472470528:0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.499102:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107410.499120:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107410.499125:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe99077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472470656:0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.499156:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107410.499182:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472470400 00000100:00100000:3.0:1782107410.499189:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472470400 00000100:00100000:3.0:1782107410.499230:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472470784 00000100:00100000:3.0:1782107410.499233:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472470784 00000100:00100000:3.0:1782107410.499256:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472470528 00000100:00100000:3.0:1782107410.499259:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472470528 00000100:00100000:3.0:1782107410.499275:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782107410.499282:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472470400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.499332:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83416680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472470400:12345-0@lo:400:kworker.0 Request processed in 50us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107410.499339:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782107410.499882:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1782107410.499890:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472470784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.499924:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83416300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472470784:12345-0@lo:400:kworker.0 Request processed in 35us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107410.499930:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1782107410.499943:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1782107410.499949:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472470528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.500006:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472470528:12345-0@lo:400:kworker.0 Request processed in 48us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107410.500013:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1782107410.500033:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472470272 00000100:00100000:3.0:1782107410.500037:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472470272 00000100:00100000:3.0:1782107410.500059:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1782107410.500065:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472470272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.500093:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472470272:12345-0@lo:400:kworker.0 Request processed in 29us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107410.500106:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:3.0:1782107410.500140:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107410.500168:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf21f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472470528:0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.500193:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472470272:0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.500201:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472470784:0@lo:400:kworker.0 00000100:00100000:3.0:1782107410.500209:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf21f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472470400:0@lo:400:kworker.0 00000100:00100000:1.0:1782107410.502574:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472470912 00000100:00100000:1.0:1782107410.502586:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472470912 00000100:00100000:1.0:1782107410.502641:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472470656 00000100:00100000:1.0:1782107410.502644:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472470656 00000100:00100000:1.0:1782107410.502669:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782107410.502677:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472470912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107410.502755:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472470912:12345-0@lo:400:kworker.0 Request processed in 79us (3844us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107410.502762:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782107410.502777:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1782107410.502794:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472470656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107410.502841:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472470656:12345-0@lo:400:kworker.0 Request processed in 49us (3684us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107410.502847:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:1.0:1782107410.503539:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782107410.503543:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107410.510220:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472470912:0@lo:400:kworker.0 00010000:00080000:1.0:1782107410.518774:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe99077800 x1868674472470656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107410.518793:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe99077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472470656:0@lo:400:kworker.0 00010000:00010000:0.0:1782107410.753953:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107411.776194:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107411.813612:0:24217:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_13 needs >= 4 OSTs 00000100:00100000:2.0:1782107412.544384:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782107412.544424:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472471040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782107412.544501:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107412.544564:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472471040 00000100:00100000:0.0:1782107412.544572:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472471040 00000100:00100000:0.0:1782107412.544721:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1782107412.544730:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472471040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107412.544761:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107412.544811:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472471040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107412.544818:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782107412.544940:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472471040:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782107412.545029:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782107412.810751:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107413.568181:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472471168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107413.568252:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107413.568366:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472471168 00000100:00100000:2.0:1782107413.568387:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472471168 00000100:00100000:2.0:1782107413.568449:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1782107413.568459:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472471168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107413.568503:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107413.568561:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472471168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107413.568568:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00080000:2.0:1782107413.568610:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abeb3ed0a80 x1868674472471168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107413.568629:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472471168:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107413.568926:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1782107413.607417:0:24265:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 20: test that stripe size of parity mirror is set correctly ========================================================== 01:50:12 (1782107412) 00000100:00100000:2.0:1782107413.813171:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107413.813221:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107413.813292:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447239552 00000100:00100000:1.0:1782107413.813302:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447239552 00000100:00100000:1.0:1782107413.813378:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 361 00000100:00100000:1.0:1782107413.813388:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb3ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447239552:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107413.813459:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb3ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447239552:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107413.813467:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 361 00000100:00080000:2.0:1782107413.813718:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107413.813790:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447239424 00000100:00100000:3.0:1782107413.813795:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447239424 00000100:00100000:3.0:1782107413.813828:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 369 00000100:00100000:3.0:1782107413.813835:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447239424:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107413.813872:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447239424:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 37us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107413.813878:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 369 00010000:00010000:3.0:1782107413.825214:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107414.849789:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107415.626250:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472471680:0@lo:400:kworker.0 00000100:00100000:3.0:1782107415.626340:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107415.626407:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107415.626414:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb4223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472471552:0@lo:400:kworker.0 00000100:00100000:3.0:1782107415.626441:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107415.626470:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472471680 00000100:00100000:3.0:1782107415.626477:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472471680 00000100:00100000:3.0:1782107415.626553:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1782107415.626563:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472471680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107415.626614:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472471680:12345-0@lo:400:kworker.0 Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107415.626621:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1782107415.626643:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472471552 00000100:00100000:3.0:1782107415.626647:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472471552 00000100:00100000:3.0:1782107415.626676:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1782107415.626684:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472471552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107415.626713:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472471552:12345-0@lo:400:kworker.0 Request processed in 31us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107415.626718:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:3.0:1782107415.626734:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782107415.626738:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107415.627054:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb4223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472471552:0@lo:400:kworker.0 00010000:00080000:3.0:1782107415.627068:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec1033b80 x1868674472471680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107415.627078:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472471680:0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627377:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472471296:0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627416:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107415.627452:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf21f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472471808:0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627476:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107415.627497:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782107415.627513:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472471424:0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627537:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107415.627553:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf21f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472471936:0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627571:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107415.627596:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472471808 00000100:00100000:1.0:1782107415.627600:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472471808 00000100:00100000:1.0:1782107415.627633:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472471424 00000100:00100000:1.0:1782107415.627636:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472471424 00000100:00100000:1.0:1782107415.627652:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1782107415.627658:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472471808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627698:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472471808:12345-0@lo:400:kworker.0 Request processed in 39us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107415.627704:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1782107415.627718:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1782107415.627724:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472471424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627749:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472471424:12345-0@lo:400:kworker.0 Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107415.627755:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1782107415.627775:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472471936 00000100:00100000:1.0:1782107415.627778:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472471936 00000100:00100000:1.0:1782107415.627802:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1782107415.627809:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472471936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627838:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472471936:12345-0@lo:400:kworker.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107415.627844:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:1.0:1782107415.627872:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107415.627875:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107415.627910:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472471424:0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627921:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf21f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472471936:0@lo:400:kworker.0 00000100:00100000:1.0:1782107415.627929:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf21f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472471808:0@lo:400:kworker.0 00000100:00100000:3.0:1782107415.630671:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472471296 00000100:00100000:3.0:1782107415.630686:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472471296 00000100:00100000:3.0:1782107415.633199:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1782107415.633218:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472471296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107415.633337:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472471296:12345-0@lo:400:kworker.0 Request processed in 125us (5918us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107415.633344:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1782107415.653419:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472471296:0@lo:400:kworker.0 00000001:02000400:1.0:1782107415.824656:0:24314:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_20 needs >= 4 OSTs 00010000:00010000:2.0:1782107415.885517:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107416.897700:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107417.677734:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472472064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107417.677936:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107417.680362:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472472064 00000100:00100000:0.0:1782107417.680379:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472472064 00000100:00100000:0.0:1782107417.680487:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1782107417.680500:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472472064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107417.680555:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107417.680649:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472472064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (2713us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107417.680656:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1782107417.682621:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107417.683448:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472472064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107417.921920:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107418.294217:0:24362:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22: test that lfs mirror read from ec does not change eof ========================================================== 01:50:16 (1782107416) 00000100:00100000:0.0:1782107418.688193:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107418.689923:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec215d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472472192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107418.690384:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107418.690752:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472472192 00000100:00100000:2.0:1782107418.690762:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472472192 00000100:00100000:2.0:1782107418.690885:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782107418.690897:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf21f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472472192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107418.690937:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107418.691023:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf21f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472472192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107418.691030:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00010000:00080000:1.0:1782107418.691354:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec215d500 x1868674472472192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107418.691374:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec215d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472472192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107418.693694:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107418.941933:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107418.942022:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107418.942274:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447239808 00000100:00100000:0.0:1782107418.942395:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447239808 00000100:00100000:0.0:1782107418.942471:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 365 00000100:00100000:0.0:1782107418.942481:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec215d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447239808:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107418.942557:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec215d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447239808:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107418.942578:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 365 00000100:00080000:1.0:1782107418.943182:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107418.943783:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447239680 00000100:00100000:3.0:1782107418.943792:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447239680 00000100:00100000:3.0:1782107418.943841:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 371 00000100:00100000:3.0:1782107418.943849:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447239680:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107418.943922:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447239680:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 73us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107418.943929:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 371 00010000:00010000:2.0:1782107418.944070:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107419.970674:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107420.571446:0:24410:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22 needs >= 8 OSTs 00000100:00100000:3.0:1782107420.742372:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472472448:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.742447:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107420.742502:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472472960:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.742531:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107420.742562:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782107420.742568:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472472320:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.742593:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107420.742614:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472472832:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.742637:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107420.742664:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472472576:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.742705:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107420.742725:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107420.742731:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472472704:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.742769:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107420.742804:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472472448 00000100:00100000:3.0:1782107420.742811:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472472448 00000100:00100000:3.0:1782107420.742850:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472472832 00000100:00100000:3.0:1782107420.742853:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472472832 00000100:00100000:3.0:1782107420.742889:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472472576 00000100:00100000:3.0:1782107420.742892:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472472576 00000100:00100000:3.0:1782107420.742910:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1782107420.742917:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472472448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.742968:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472472448:12345-0@lo:400:kworker.0 Request processed in 51us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107420.743000:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1782107420.743031:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1782107420.743038:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472472832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743066:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472472832:12345-0@lo:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107420.743072:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1782107420.743083:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1782107420.743089:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472472576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743119:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472472576:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107420.743125:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1782107420.743142:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472472960 00000100:00100000:3.0:1782107420.743145:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472472960 00000100:00100000:3.0:1782107420.743179:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472472704 00000100:00100000:3.0:1782107420.743183:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472472704 00000100:00100000:3.0:1782107420.743203:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1782107420.743210:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472472960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743243:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472472960:12345-0@lo:400:kworker.0 Request processed in 34us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107420.743249:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1782107420.743260:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782107420.743266:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472472704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743303:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472472704:12345-0@lo:400:kworker.0 Request processed in 38us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107420.743309:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782107420.743327:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472472320 00000100:00100000:3.0:1782107420.743330:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472472320 00000100:00100000:3.0:1782107420.743352:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1782107420.743359:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472472320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743388:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472472320:12345-0@lo:400:kworker.0 Request processed in 30us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107420.743394:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:3.0:1782107420.743432:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107420.743436:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107420.743439:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782107420.743474:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebf184a80 x1868674472472704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107420.743487:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472472704:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743497:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472472576:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743534:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472472320:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743543:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472472832:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743550:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472472448:0@lo:400:kworker.0 00000100:00100000:3.0:1782107420.743558:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472472960:0@lo:400:kworker.0 00010000:00010000:0.0:1782107420.993610:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107422.034167:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107422.575044:0:24458:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28b: test that lfs mirror verify for ec does not change eof ========================================================== 01:50:21 (1782107421) 00000100:00100000:0.0:1782107422.784149:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107422.784171:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472473088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107422.784234:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107422.784307:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472473088 00000100:00100000:0.0:1782107422.784314:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472473088 00000100:00100000:0.0:1782107422.784364:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1782107422.784373:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472473088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107422.784406:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107422.784449:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472473088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107422.784456:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:0.0:1782107422.784474:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107422.784504:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472473088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107423.041944:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107423.819304:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472473216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107423.819385:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107423.819462:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472473216 00000100:00100000:3.0:1782107423.819469:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472473216 00000100:00100000:3.0:1782107423.819526:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782107423.819534:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472473216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782107423.819568:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107423.819610:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472473216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107423.819617:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00010000:00080000:3.0:1782107423.819655:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef3e680 x1868674472473216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782107423.819669:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107423.819672:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472473216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107424.056928:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107424.057102:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107424.057181:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447239936 00000100:00100000:3.0:1782107424.057201:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447239936 00000100:00100000:3.0:1782107424.057263:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 373 00000100:00100000:3.0:1782107424.057274:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447239936:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107424.057350:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447239936:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107424.057357:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 373 00000100:00100000:0.0:1782107424.061904:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447240064 00000100:00100000:0.0:1782107424.061918:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447240064 00000100:00100000:0.0:1782107424.062011:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 369 00000100:00100000:0.0:1782107424.062021:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf21f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447240064:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107424.062099:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf21f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447240064:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 80us (5125us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107424.062108:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 369 00000100:00080000:0.0:1782107424.062150:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782107424.077936:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107424.708306:0:24507:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28b needs >= 8 OSTs 00010000:00010000:1.0:1782107425.088434:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107425.858127:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472473600:0@lo:400:kworker.0 00000100:00100000:0.0:1782107425.858239:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107425.858295:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107425.858302:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472473728:0@lo:400:kworker.0 00000100:00100000:0.0:1782107425.858329:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107425.858843:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472473344:0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.858893:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107425.858921:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472473856:0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.858945:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107425.858991:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782107425.858998:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472473472:0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.859020:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107425.859039:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472473984:0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.859060:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107425.859096:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472473600 00000100:00100000:3.0:1782107425.859103:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472473600 00000100:00100000:3.0:1782107425.859155:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472473856 00000100:00100000:3.0:1782107425.859158:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472473856 00000100:00100000:3.0:1782107425.859171:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472473472 00000100:00100000:3.0:1782107425.859173:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472473472 00000100:00100000:3.0:1782107425.859187:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1782107425.859195:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472473600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.859261:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472473600:12345-0@lo:400:kworker.0 Request processed in 66us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107425.859268:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1782107425.859288:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1782107425.859294:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd8352b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472473856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.859327:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd8352b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472473856:12345-0@lo:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107425.859342:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1782107425.859356:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1782107425.859361:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd8352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472473472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.859390:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd8352aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472473472:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107425.859396:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1782107425.859416:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472473728 00000100:00100000:3.0:1782107425.859420:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472473728 00000100:00100000:3.0:1782107425.859445:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472473984 00000100:00100000:3.0:1782107425.860322:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472473984 00000100:00100000:0.0:1782107425.860325:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472473344 00000100:00100000:0.0:1782107425.860328:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472473344 00000100:00100000:3.0:1782107425.860356:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782107425.860363:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472473728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107425.860367:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1782107425.860372:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472473344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.860406:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472473728:12345-0@lo:400:kworker.0 Request processed in 44us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107425.860406:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472473344:12345-0@lo:400:kworker.0 Request processed in 33us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107425.860413:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1782107425.860413:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1782107425.860426:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782107425.860431:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472473984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.860667:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472473984:12345-0@lo:400:kworker.0 Request processed in 235us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107425.860674:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1782107425.860702:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107425.860707:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107425.860710:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782107425.860757:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec0d1ca80 x1868674472473728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107425.860773:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472473728:0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.860807:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0e7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472473600:0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.860858:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0e78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472473472:0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.860867:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472473984:0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.860876:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472473344:0@lo:400:kworker.0 00000100:00100000:3.0:1782107425.860886:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472473856:0@lo:400:kworker.0 00010000:00010000:3.0:1782107426.116560:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107426.732613:0:24555:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 28c: test that reading past parity data returns zeros ========================================================== 01:50:25 (1782107425) 00010000:00010000:1.0:1782107427.139722:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107427.906235:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472474112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107427.906311:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107427.906386:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472474112 00000100:00100000:1.0:1782107427.906393:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472474112 00000100:00100000:1.0:1782107427.906461:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782107427.906471:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472474112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107427.906512:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107427.906557:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472474112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107427.906571:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1782107427.906593:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107427.906632:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472474112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782107428.167585:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107428.786220:0:24603:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_28c needs >= 8 OSTs 00000100:00100000:0.0:1782107428.933795:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107428.933818:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472474240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107428.933889:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107428.933957:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472474240 00000100:00100000:0.0:1782107428.933965:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472474240 00000100:00100000:0.0:1782107428.934032:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782107428.934040:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472474240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107428.934070:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107428.934108:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472474240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107428.934115:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1782107428.934134:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782107428.934163:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe81325500 x1868674472474240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107428.934191:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472474240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107429.167232:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107429.167731:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447240320 00000100:00100000:3.0:1782107429.167742:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447240320 00000100:00100000:3.0:1782107429.167837:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 373 00000100:00100000:3.0:1782107429.167850:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447240320:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107429.169612:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447240320:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 98us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107429.169637:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 373 00000100:00080000:0.0:1782107429.169782:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107429.176061:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107429.177461:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447240192 00000100:00100000:3.0:1782107429.177475:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447240192 00000100:00100000:3.0:1782107429.177537:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 375 00000100:00100000:3.0:1782107429.177548:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447240192:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107429.177638:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447240192:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 92us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107429.177647:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 375 00010000:00010000:3.0:1782107429.184828:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107430.212726:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107430.341923:0:24652:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31b: test that size of parity mirror is 1*2*1M ========================================================== 01:50:29 (1782107429) 00000100:00100000:1.0:1782107430.976340:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472474624:0@lo:400:kworker.0 00000100:00100000:1.0:1782107430.976407:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107430.976469:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107430.976476:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472474752:0@lo:400:kworker.0 00000100:00100000:1.0:1782107430.976512:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107430.976670:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472474624 00000100:00100000:3.0:1782107430.976693:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472474624 00000100:00100000:3.0:1782107430.976789:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1782107430.976800:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472474624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107430.976864:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472474624:12345-0@lo:400:kworker.0 Request processed in 57us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107430.976872:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1782107430.976899:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472474752 00000100:00100000:3.0:1782107430.976903:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472474752 00000100:00100000:3.0:1782107430.976930:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1782107430.976937:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472474752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107430.976964:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472474752:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107430.977003:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1782107430.977080:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782107430.977085:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782107430.977113:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe81491c00 x1868674472474752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107430.977126:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472474752:0@lo:400:kworker.0 00000100:00100000:1.0:1782107430.977137:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472474624:0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977257:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472474368:0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977292:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107430.977326:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472474880:0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977346:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107430.977369:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782107430.977374:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472474496:0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977393:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107430.977408:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472475008:0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977425:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107430.977448:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472474880 00000100:00100000:0.0:1782107430.977452:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472474880 00000100:00100000:0.0:1782107430.977477:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472474496 00000100:00100000:0.0:1782107430.977480:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472474496 00000100:00100000:0.0:1782107430.977497:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1782107430.977502:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472474880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977535:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472474880:12345-0@lo:400:kworker.0 Request processed in 33us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107430.977540:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1782107430.977552:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1782107430.977558:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472474496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977598:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472474496:12345-0@lo:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107430.977604:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1782107430.977623:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472475008 00000100:00100000:0.0:1782107430.977626:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472475008 00000100:00100000:0.0:1782107430.977650:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1782107430.977656:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472475008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977683:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472475008:12345-0@lo:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107430.977688:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1782107430.977718:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782107430.977721:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107430.977743:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472474496:0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977751:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472475008:0@lo:400:kworker.0 00000100:00100000:0.0:1782107430.977759:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472474880:0@lo:400:kworker.0 00000100:00100000:3.0:1782107430.977925:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472474368 00000100:00100000:3.0:1782107430.977929:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472474368 00000100:00100000:3.0:1782107430.977960:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1782107430.977968:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472474368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107430.978043:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472474368:12345-0@lo:400:kworker.0 Request processed in 76us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107430.978050:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1782107430.978122:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472474368:0@lo:400:kworker.0 00010000:00010000:1.0:1782107431.232101:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107432.010615:0:24700:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31b needs >= 8 OSTs 00010000:00010000:0.0:1782107432.256495:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107433.024758:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107433.024783:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472475136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107433.024852:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107433.025566:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472475136 00000100:00100000:3.0:1782107433.025575:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472475136 00000100:00100000:3.0:1782107433.025643:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1782107433.025653:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472475136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107433.025689:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107433.025739:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81325180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472475136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107433.025758:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1782107433.026001:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107433.026042:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472475136:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782107433.280185:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107434.049229:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107434.049255:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472475264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107434.049337:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107434.049532:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472475264 00000100:00100000:0.0:1782107434.049542:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472475264 00000100:00100000:0.0:1782107434.049631:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782107434.049641:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472475264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107434.049704:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107434.049769:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472475264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107434.049778:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00080000:0.0:1782107434.049828:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe81326300 x1868674472475264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107434.049847:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472475264:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107434.050138:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107434.286708:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107434.286750:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107434.286758:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447240448 00000100:00100000:0.0:1782107434.286769:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447240448 00000100:00100000:0.0:1782107434.286826:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 377 00000100:00100000:0.0:1782107434.286837:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447240448:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107434.286919:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447240448:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107434.287021:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 377 00000100:00100000:1.0:1782107434.287137:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447240576 00000100:00100000:1.0:1782107434.287143:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447240576 00000100:00100000:1.0:1782107434.287201:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 377 00000100:00100000:1.0:1782107434.287209:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447240576:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107434.287263:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447240576:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 55us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107434.287271:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 377 00000100:00080000:3.0:1782107434.287601:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782107434.321291:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107434.596624:0:24748:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31c: test that size of parity mirror is 1*2*64k ========================================================== 01:50:33 (1782107433) 00010000:00010000:0.0:1782107435.332490:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107436.098804:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472475648:0@lo:400:kworker.0 00000100:00100000:0.0:1782107436.098863:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472475520:0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.098877:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107436.098918:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107436.098939:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107436.098948:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472475776:0@lo:400:kworker.0 00000100:00100000:0.0:1782107436.098956:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472476032:0@lo:400:kworker.0 00000100:00100000:0.0:1782107436.099013:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107436.099029:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472475648 00000100:00100000:3.0:1782107436.099037:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472475648 00000100:00100000:0.0:1782107436.099049:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782107436.099057:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472475392:0@lo:400:kworker.0 00000100:00100000:0.0:1782107436.099092:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107436.099094:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472475520 00000100:00100000:3.0:1782107436.099098:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472475520 00000100:00100000:0.0:1782107436.099122:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472475904:0@lo:400:kworker.0 00000100:00100000:0.0:1782107436.099157:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107436.099205:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472475392 00000100:00100000:0.0:1782107436.099210:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472475392 00000100:00100000:0.0:1782107436.099246:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1782107436.099256:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472475392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.099268:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1782107436.099278:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd8352b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472475648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107436.099315:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472475392:12345-0@lo:400:kworker.0 Request processed in 59us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107436.099326:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd8352b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472475648:12345-0@lo:400:kworker.0 Request processed in 50us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107436.099333:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1782107436.099356:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472475904 00000100:00100000:3.0:1782107436.099360:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472475904 00000100:00100000:3.0:1782107436.099376:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1782107436.099382:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472475520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.099423:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472475520:12345-0@lo:400:kworker.0 Request processed in 41us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107436.099438:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1782107436.099450:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1782107436.099456:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472475904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.099484:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472475904:12345-0@lo:400:kworker.0 Request processed in 28us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107436.099490:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1782107436.099526:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472476032 00000100:00100000:3.0:1782107436.099530:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472476032 00000100:00100000:3.0:1782107436.100111:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1782107436.100124:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472476032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.100182:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472476032:12345-0@lo:400:kworker.0 Request processed in 62us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107436.100189:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:3.0:1782107436.100211:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107436.100216:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107436.100238:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107436.100280:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472475648:0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.100304:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472475776 00000100:00100000:3.0:1782107436.100307:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472475776 00000100:00100000:3.0:1782107436.100337:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1782107436.100343:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472475776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.100375:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472475776:12345-0@lo:400:kworker.0 Request processed in 31us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107436.100380:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1782107436.100394:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782107436.100409:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abd8352a300 x1868674472475776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107436.100428:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472475776:0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.112870:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472475392:0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.112896:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472475904:0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.112910:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472475520:0@lo:400:kworker.0 00000100:00100000:3.0:1782107436.112922:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472476032:0@lo:400:kworker.0 00000100:00100000:0.0:1782107436.114345:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000001:02000400:0.0:1782107436.337949:0:24796:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31c needs >= 8 OSTs 00010000:00010000:0.0:1782107436.353101:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107437.376551:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107438.164266:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782107438.164292:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472476160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782107438.164350:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107438.164400:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472476160 00000100:00100000:2.0:1782107438.164406:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472476160 00000100:00100000:2.0:1782107438.164452:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1782107438.164461:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472476160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107438.164494:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107438.164530:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472476160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107438.164536:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:2.0:1782107438.164553:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782107438.164582:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472476160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782107438.481387:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107438.636140:0:24845:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 31d: test that size of parity mirror is 1*2*64k ========================================================== 01:50:37 (1782107437) 00000100:00100000:1.0:1782107439.168336:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107439.168360:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472476288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107439.168426:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107439.168601:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472476288 00000100:00100000:0.0:1782107439.168610:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472476288 00000100:00080000:2.0:1782107439.168836:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107439.168882:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1782107439.168894:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472476288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107439.168930:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107439.169054:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472476288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107439.169062:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00080000:3.0:1782107439.170275:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe81327100 x1868674472476288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107439.170295:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472476288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107439.409940:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107439.410040:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107439.410311:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447240832 00000100:00100000:1.0:1782107439.410322:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447240832 00000100:00100000:1.0:1782107439.410426:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 381 00000100:00100000:1.0:1782107439.410437:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd8352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447240832:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107439.410519:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd8352a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447240832:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 83us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107439.410526:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 381 00000100:00080000:2.0:1782107439.411010:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107439.413384:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447240704 00000100:00100000:0.0:1782107439.413401:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447240704 00000100:00100000:0.0:1782107439.413486:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 379 00000100:00100000:0.0:1782107439.413496:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447240704:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107439.413591:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447240704:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 96us (3662us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107439.413599:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 379 00010000:00010000:0.0:1782107439.488389:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107440.512201:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107441.218857:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472476416:0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.218930:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107441.219002:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472476928:0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219033:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107441.219060:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782107441.219066:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472476544:0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219103:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107441.219123:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472477056:0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219149:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107441.219185:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472476672:0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219209:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107441.219229:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107441.219233:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472476800:0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219250:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107441.219275:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472476416 00000100:00100000:3.0:1782107441.219282:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472476416 00000100:00100000:3.0:1782107441.219322:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1782107441.219331:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472476416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219375:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472476416:12345-0@lo:400:kworker.0 Request processed in 47us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107441.219382:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1782107441.219411:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472476928 00000100:00100000:3.0:1782107441.219414:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472476928 00000100:00100000:3.0:1782107441.219440:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472476544 00000100:00100000:3.0:1782107441.219442:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472476544 00000100:00100000:3.0:1782107441.219451:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472476672 00000100:00100000:3.0:1782107441.219453:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472476672 00000100:00100000:3.0:1782107441.219463:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1782107441.219467:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd8352b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472476928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219493:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd8352b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472476928:12345-0@lo:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107441.219498:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1782107441.219509:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472477056 00000100:00100000:3.0:1782107441.219512:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1782107441.219515:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472477056 00000100:00100000:3.0:1782107441.219519:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472476544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219544:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472476544:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107441.219556:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472476800 00000100:00100000:3.0:1782107441.219557:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1782107441.219561:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472476800 00000100:00100000:3.0:1782107441.219574:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1782107441.219581:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472476672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107441.219589:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1782107441.219598:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472477056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219613:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472476672:12345-0@lo:400:kworker.0 Request processed in 32us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107441.219618:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00080000:3.0:1782107441.219636:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107441.219641:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107441.219643:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107441.219647:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472477056:12345-0@lo:400:kworker.0 Request processed in 49us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107441.219655:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1782107441.219660:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1782107441.219669:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472476800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.219698:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472476800:12345-0@lo:400:kworker.0 Request processed in 31us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107441.219703:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1782107441.219740:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472476544:0@lo:400:kworker.0 00000100:00100000:2.0:1782107441.219752:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472477056:0@lo:400:kworker.0 00000100:00100000:2.0:1782107441.219760:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472476416:0@lo:400:kworker.0 00000100:00100000:2.0:1782107441.219778:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472476928:0@lo:400:kworker.0 00010000:00080000:3.0:1782107441.221117:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abd8352a300 x1868674472476800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107441.221131:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472476800:0@lo:400:kworker.0 00000100:00100000:3.0:1782107441.221152:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472476672:0@lo:400:kworker.0 00010000:00010000:3.0:1782107441.539437:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107441.570395:0:24894:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_31d needs >= 8 OSTs 00010000:00010000:0.0:1782107442.562036:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107443.264184:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472477184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107443.264259:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107443.264396:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472477184 00000100:00100000:2.0:1782107443.264404:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472477184 00000100:00100000:2.0:1782107443.264491:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1782107443.264501:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472477184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107443.264546:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107443.264599:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472477184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107443.264606:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1782107443.264780:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472477184:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107443.265042:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782107443.604398:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107444.303268:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472477312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107444.303333:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107444.303404:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472477312 00000100:00100000:0.0:1782107444.303410:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472477312 00000100:00100000:0.0:1782107444.303466:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782107444.303476:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472477312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107444.303545:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107444.303589:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472477312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107444.303597:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:0.0:1782107444.303625:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782107444.303654:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe81325f80 x1868674472477312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107444.303672:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472477312:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1782107444.507139:0:24943:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 30d: test that size of parity mirror is 22*64k ========================================================== 01:50:42 (1782107442) 00000100:00100000:1.0:1782107444.537570:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107444.537654:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107444.537774:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447241088 00000100:00100000:2.0:1782107444.537785:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447241088 00000100:00100000:2.0:1782107444.537863:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 385 00000100:00100000:2.0:1782107444.537888:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447241088:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107444.537994:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447241088:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 102us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107444.538001:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 385 00000100:00080000:1.0:1782107444.538268:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107444.539167:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447240960 00000100:00100000:3.0:1782107444.539175:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447240960 00000100:00100000:0.0:1782107444.545432:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 381 00000100:00100000:0.0:1782107444.545448:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447240960:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107444.545536:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447240960:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 92us (7983us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107444.545544:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 381 00010000:00010000:1.0:1782107444.622080:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107445.632198:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107446.351279:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472477568:0@lo:400:kworker.0 00000100:00100000:3.0:1782107446.351360:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107446.351407:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472478080:0@lo:400:kworker.0 00000100:00100000:3.0:1782107446.351443:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107446.351467:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782107446.351473:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472477440:0@lo:400:kworker.0 00000100:00100000:3.0:1782107446.351499:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107446.351521:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472477952:0@lo:400:kworker.0 00000100:00100000:3.0:1782107446.351558:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107446.351588:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472477440 00000100:00100000:3.0:1782107446.351596:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472477440 00000100:00100000:3.0:1782107446.351651:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1782107446.351660:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472477440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107446.351707:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87df8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472477440:12345-0@lo:400:kworker.0 Request processed in 48us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107446.351714:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1782107446.351759:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472477440:0@lo:400:kworker.0 00000100:00100000:2.0:1782107446.352139:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472477568 00000100:00100000:2.0:1782107446.352144:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472477568 00000100:00100000:2.0:1782107446.352175:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472477952 00000100:00100000:2.0:1782107446.352178:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472477952 00000100:00100000:2.0:1782107446.352216:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1782107446.352223:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472477568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107446.352278:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472477568:12345-0@lo:400:kworker.0 Request processed in 55us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107446.352284:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1782107446.352318:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1782107446.352324:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472477952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107446.352352:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472477952:12345-0@lo:400:kworker.0 Request processed in 29us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107446.352358:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1782107446.352375:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472478080 00000100:00100000:2.0:1782107446.352379:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472478080 00000100:00100000:2.0:1782107446.352403:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1782107446.352409:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472478080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107446.352436:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472478080:12345-0@lo:400:kworker.0 Request processed in 27us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107446.352441:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1782107446.352477:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472477952:0@lo:400:kworker.0 00000100:00100000:2.0:1782107446.352487:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472477568:0@lo:400:kworker.0 00000100:00100000:2.0:1782107446.352495:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf184380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472478080:0@lo:400:kworker.0 00000100:00080000:1.0:1782107446.354949:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107446.354959:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107446.355014:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472477824:0@lo:400:kworker.0 00000100:00100000:1.0:1782107446.355098:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107446.355144:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107446.355153:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472477696:0@lo:400:kworker.0 00000100:00100000:1.0:1782107446.355179:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107446.355419:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472477696 00000100:00100000:3.0:1782107446.355428:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472477696 00000100:00100000:3.0:1782107446.355497:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1782107446.355505:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472477696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107446.355555:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472477696:12345-0@lo:400:kworker.0 Request processed in 51us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107446.355574:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:1.0:1782107446.355855:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107446.355890:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472477696:0@lo:400:kworker.0 00000100:00100000:2.0:1782107446.360170:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472477824 00000100:00100000:2.0:1782107446.360183:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472477824 00000100:00100000:2.0:1782107446.360399:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1782107446.360410:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472477824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107446.360742:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472477824:12345-0@lo:400:kworker.0 Request processed in 334us (5642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107446.360750:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00080000:2.0:1782107446.360814:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebf187100 x1868674472477824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107446.360830:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472477824:0@lo:400:kworker.0 00000100:00080000:1.0:1782107446.360947:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782107446.665086:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107446.827691:0:24991:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_30d needs >= 8 OSTs 00010000:00010000:1.0:1782107447.681111:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107448.387881:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472478208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107448.387963:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107448.388865:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472478208 00000100:00100000:1.0:1782107448.388876:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472478208 00000100:00100000:1.0:1782107448.388937:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1782107448.388947:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472478208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107448.389000:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107448.389072:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472478208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107448.389079:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1782107448.389104:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107448.389146:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472478208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107448.705963:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107449.086250:0:25039:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21a: migrate plain file to EC layout === 01:50:47 (1782107447) 00000100:00100000:1.0:1782107449.411101:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472478336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107449.411175:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107449.411485:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472478336 00000100:00100000:0.0:1782107449.411493:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472478336 00000100:00100000:0.0:1782107449.411562:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1782107449.411571:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472478336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107449.411602:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107449.411654:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472478336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107449.411661:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1782107449.411738:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782107449.411838:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe81324a80 x1868674472478336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107449.411857:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472478336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107449.659749:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107449.659790:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107449.660049:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447241344 00000100:00100000:2.0:1782107449.660058:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447241344 00000100:00100000:2.0:1782107449.660129:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 389 00000100:00100000:2.0:1782107449.660139:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447241344:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107449.660204:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447241344:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 68us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107449.660212:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 389 00000100:00100000:0.0:1782107449.660335:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447241216 00000100:00100000:0.0:1782107449.660340:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447241216 00000100:00100000:0.0:1782107449.660377:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 383 00000100:00100000:0.0:1782107449.660384:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe87df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447241216:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107449.660409:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe87df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447241216:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 27us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107449.660415:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 383 00000100:00080000:1.0:1782107449.661300:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782107449.732147:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107450.753243:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107451.013547:0:25087:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21a needs >= 3 OSTs 00000100:00100000:1.0:1782107451.460028:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472478464:0@lo:400:kworker.0 00000100:00100000:1.0:1782107451.460096:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107451.460170:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472478464 00000100:00100000:1.0:1782107451.460178:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472478464 00000100:00100000:2.0:1782107451.460297:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472478592:0@lo:400:kworker.0 00000100:00100000:0.0:1782107451.460309:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472478976:0@lo:400:kworker.0 00000100:00100000:2.0:1782107451.460334:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107451.460397:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472478720:0@lo:400:kworker.0 00000100:00100000:1.0:1782107451.460404:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1782107451.460416:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472478464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107451.469462:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107451.469562:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472478592 00000100:00100000:0.0:1782107451.469571:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472478592 00000100:00100000:2.0:1782107451.470252:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472479104:0@lo:400:kworker.0 00000100:00100000:2.0:1782107451.470308:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107451.470342:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472478848:0@lo:400:kworker.0 00000100:00100000:2.0:1782107451.470365:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107451.470390:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472478976 00000100:00100000:2.0:1782107451.470395:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472478976 00000100:00100000:2.0:1782107451.470450:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1782107451.470746:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472478976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107451.470818:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472478976:12345-0@lo:400:kworker.0 Request processed in 360us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107451.470825:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1782107451.470849:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472479104 00000100:00100000:2.0:1782107451.470852:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472479104 00000100:00100000:2.0:1782107451.470882:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472478848 00000100:00100000:2.0:1782107451.470885:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472478848 00000100:00100000:2.0:1782107451.470902:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1782107451.470921:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472479104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107451.470959:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472479104:12345-0@lo:400:kworker.0 Request processed in 38us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107451.470964:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1782107451.471005:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1782107451.471012:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472478848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107451.471043:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472478848:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107451.471048:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00010000:00080000:2.0:1782107451.471089:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef3e680 x1868674472478848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107451.471102:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472478848:0@lo:400:kworker.0 00000100:00100000:2.0:1782107451.471126:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472479104:0@lo:400:kworker.0 00000100:00100000:2.0:1782107451.471698:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472478976:0@lo:400:kworker.0 00000100:00100000:0.0:1782107451.471714:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1782107451.471724:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472478592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107451.471784:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782107451.471888:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107451.471893:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107451.471896:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107451.471913:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472478720 00000100:00100000:3.0:1782107451.471917:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472478720 00000100:00100000:3.0:1782107451.471945:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1782107451.471951:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472478720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107451.472018:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472478720:12345-0@lo:400:kworker.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107451.472024:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00080000:3.0:1782107451.472040:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107451.472053:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472478720:0@lo:400:kworker.0 00000100:00100000:0.0:1782107451.473848:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472478592:12345-0@lo:400:kworker.0 Request processed in 2118us (13507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107451.473861:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1782107451.474897:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472478592:0@lo:400:kworker.0 00000100:00100000:1.0:1782107451.476929:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472478464:12345-0@lo:400:kworker.0 Request processed in 16510us (16826us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107451.476941:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1782107451.477065:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472478464:0@lo:400:kworker.0 00010000:00010000:0.0:1782107451.776259:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107452.806123:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107453.391284:0:25136:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21b: migrate EC file to plain layout === 01:50:52 (1782107452) 00000100:00100000:0.0:1782107453.506179:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107453.506200:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472479232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107453.506267:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107453.506332:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472479232 00000100:00100000:0.0:1782107453.506339:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472479232 00000100:00100000:0.0:1782107453.506390:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782107453.506411:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472479232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107453.506446:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107453.506498:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472479232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107453.506506:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782107453.506551:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472479232:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107453.506663:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782107453.825745:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107454.446265:0:25184:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21b needs >= 3 OSTs 00000100:00100000:1.0:1782107454.528224:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107454.528263:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472479360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107454.528358:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107454.528529:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472479360 00000100:00100000:2.0:1782107454.528539:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472479360 00000100:00100000:2.0:1782107454.528694:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1782107454.528704:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472479360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107454.528742:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107454.528802:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472479360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107454.528815:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:1.0:1782107454.528868:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782107454.528898:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abd8352a300 x1868674472479360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107454.528916:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472479360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107454.770109:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107454.770164:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107454.770252:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447241600 00000100:00100000:3.0:1782107454.770262:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447241600 00000100:00100000:3.0:1782107454.770335:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 393 00000100:00100000:3.0:1782107454.770346:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447241600:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107454.770434:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447241600:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 90us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107454.770441:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 393 00000100:00100000:0.0:1782107454.770610:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447241472 00000100:00100000:0.0:1782107454.770615:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447241472 00000100:00100000:0.0:1782107454.770651:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 385 00000100:00100000:0.0:1782107454.770657:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447241472:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107454.770689:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447241472:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107454.770696:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 385 00000100:00080000:1.0:1782107454.770865:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782107454.848498:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107455.873179:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107456.213410:0:25232:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21c: migrate between different EC configurations ========================================================== 01:50:55 (1782107455) 00000100:00100000:1.0:1782107456.576394:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472479744:0@lo:400:kworker.0 00000100:00100000:1.0:1782107456.576461:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107456.576525:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107456.576531:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472479872:0@lo:400:kworker.0 00000100:00100000:1.0:1782107456.576566:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107456.576603:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472479872 00000100:00100000:1.0:1782107456.576624:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472479872 00000100:00100000:1.0:1782107456.576680:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1782107456.576689:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472479872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107456.576739:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472479872:12345-0@lo:400:kworker.0 Request processed in 51us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107456.576747:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:1.0:1782107456.576766:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782107456.576794:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abd8352a300 x1868674472479872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107456.576807:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472479872:0@lo:400:kworker.0 00000100:00100000:2.0:1782107456.576879:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472479744 00000100:00100000:2.0:1782107456.576884:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472479744 00000100:00100000:2.0:1782107456.576929:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1782107456.576936:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472479744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107456.577006:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472479744:12345-0@lo:400:kworker.0 Request processed in 70us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107456.577015:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1782107456.577123:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472479616:0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.577165:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107456.577189:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472480128:0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.577209:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107456.577228:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782107456.577233:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472479488:0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.577258:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107456.577276:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472480000:0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.577299:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107456.577329:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472479616 00000100:00100000:3.0:1782107456.577333:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472479616 00000100:00100000:3.0:1782107456.577356:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472480000 00000100:00100000:3.0:1782107456.577359:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472480000 00000100:00100000:3.0:1782107456.577379:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1782107456.577385:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472479616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.577420:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472479616:12345-0@lo:400:kworker.0 Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107456.577426:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1782107456.577439:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1782107456.577445:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472480000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.577469:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472480000:12345-0@lo:400:kworker.0 Request processed in 25us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107456.577486:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1782107456.577507:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472480128 00000100:00100000:3.0:1782107456.577510:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472480128 00000100:00100000:3.0:1782107456.577533:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1782107456.577538:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472480128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.577567:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472480128:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107456.577572:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1782107456.577602:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472480000:0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.577610:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472479616:0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.577617:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472480128:0@lo:400:kworker.0 00000100:00100000:1.0:1782107456.577818:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472479488 00000100:00100000:1.0:1782107456.577821:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472479488 00000100:00100000:1.0:1782107456.577855:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1782107456.577862:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472479488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107456.577905:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472479488:12345-0@lo:400:kworker.0 Request processed in 44us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107456.577911:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00080000:1.0:1782107456.577938:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107456.577943:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107456.577991:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472479744:0@lo:400:kworker.0 00000100:00100000:3.0:1782107456.578184:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472479488:0@lo:400:kworker.0 00010000:00010000:0.0:1782107456.896228:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107457.928653:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107458.013570:0:25280:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21c needs >= 4 OSTs 00000100:00100000:1.0:1782107458.624551:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472480256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107458.624637:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107458.624760:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472480256 00000100:00100000:2.0:1782107458.624769:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472480256 00000100:00100000:2.0:1782107458.624838:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1782107458.624848:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472480256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107458.624884:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782107458.624965:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782107458.632690:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472480256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7833us (8052us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107458.632706:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1782107458.632875:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472480256:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107458.947175:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107459.653656:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472480384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107459.653742:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107459.653826:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472480384 00000100:00100000:0.0:1782107459.653835:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472480384 00000100:00100000:0.0:1782107459.653903:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1782107459.653913:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472480384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107459.653991:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107459.654056:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472480384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107459.654065:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1782107459.654095:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782107459.654146:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe81325c00 x1868674472480384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107459.654172:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472480384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107459.896848:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107459.897115:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107459.897198:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447241856 00000100:00100000:1.0:1782107459.897209:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447241856 00000100:00100000:1.0:1782107459.897284:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 397 00000100:00100000:1.0:1782107459.897309:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447241856:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107459.897399:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447241856:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107459.897406:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 397 00000100:00100000:3.0:1782107459.897632:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447241728 00000100:00100000:3.0:1782107459.897636:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447241728 00000100:00100000:3.0:1782107459.897671:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 387 00000100:00100000:3.0:1782107459.897678:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447241728:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107459.897707:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447241728:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 30us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107459.897714:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 387 00000100:00080000:0.0:1782107459.898766:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1782107459.948406:0:25329:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 21d: migrate PFL file to EC layout ===== 01:50:58 (1782107458) 00010000:00010000:1.0:1782107459.972045:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107460.993706:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107461.697324:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472480640:0@lo:400:kworker.0 00000100:00100000:3.0:1782107461.697396:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107461.697437:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472480512:0@lo:400:kworker.0 00000100:00100000:3.0:1782107461.697447:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472481152:0@lo:400:kworker.0 00000100:00100000:3.0:1782107461.702408:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107461.702547:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472480640 00000100:00100000:3.0:1782107461.702558:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472480640 00000100:00100000:3.0:1782107461.702610:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1782107461.702620:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472480640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107461.702680:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472480640:12345-0@lo:400:kworker.0 Request processed in 61us (5283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107461.702687:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1782107461.702737:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472480640:0@lo:400:kworker.0 00000100:00100000:0.0:1782107461.709363:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107461.709431:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472481024:0@lo:400:kworker.0 00000100:00100000:0.0:1782107461.709493:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107461.709547:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472480768:0@lo:400:kworker.0 00000100:00100000:0.0:1782107461.709574:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107461.709599:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107461.709606:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe81493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472480896:0@lo:400:kworker.0 00000100:00100000:3.0:1782107461.709618:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472481024 00000100:00100000:3.0:1782107461.709626:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472481024 00000100:00100000:0.0:1782107461.709647:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107461.709681:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472480768 00000100:00100000:3.0:1782107461.709684:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472480768 00000100:00100000:3.0:1782107461.709705:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1782107461.709713:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472481024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107461.709768:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472481024:12345-0@lo:400:kworker.0 Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107461.709776:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1782107461.709795:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1782107461.709800:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe81327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472480768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107461.709824:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe81327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472480768:12345-0@lo:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107461.709830:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1782107461.712368:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472480768:0@lo:400:kworker.0 00000100:00100000:0.0:1782107461.712426:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472480512 00000100:00100000:0.0:1782107461.712432:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472480512 00000100:00100000:0.0:1782107461.712486:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1782107461.712495:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472480512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107461.712561:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472480512:12345-0@lo:400:kworker.0 Request processed in 67us (3207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107461.712570:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:0.0:1782107461.712606:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107461.712685:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472481152 00000100:00100000:1.0:1782107461.712690:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472481152 00000100:00100000:1.0:1782107461.712730:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472480896 00000100:00100000:1.0:1782107461.712733:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472480896 00000100:00100000:1.0:1782107461.712753:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1782107461.712760:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472481152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107461.712803:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472481152:12345-0@lo:400:kworker.0 Request processed in 44us (10403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107461.712810:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1782107461.712823:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1782107461.712829:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472480896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107461.712861:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472480896:12345-0@lo:400:kworker.0 Request processed in 32us (3213us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107461.712867:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1782107461.713338:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472480512:0@lo:400:kworker.0 00000100:00100000:1.0:1782107461.713354:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472481024:0@lo:400:kworker.0 00000100:00080000:0.0:1782107461.714621:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782107461.714628:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782107461.714663:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe81493480 x1868674472480896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107461.714677:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe81493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472480896:0@lo:400:kworker.0 00000100:00100000:3.0:1782107461.716167:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472481152:0@lo:400:kworker.0 00000001:02000400:2.0:1782107461.719948:0:25377:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_21d needs >= 3 OSTs 00010000:00010000:0.0:1782107462.016457:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107463.041907:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107463.755804:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd8352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472481280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107463.757341:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107463.757453:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472481280 00000100:00100000:0.0:1782107463.757461:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472481280 00000100:00100000:0.0:1782107463.757532:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1782107463.757542:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472481280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107463.757579:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107463.757622:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472481280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107463.757630:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:1.0:1782107463.758031:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107463.758130:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd8352ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472481280:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1782107463.798901:0:25425:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 22a: mirror split removes plain mirror, keeps EC ========================================================== 01:51:02 (1782107462) 00010000:00010000:0.0:1782107464.064281:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107464.769207:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472481408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107464.769346:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107464.769551:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472481408 00000100:00100000:0.0:1782107464.769560:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472481408 00000100:00100000:0.0:1782107464.769631:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1782107464.769641:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472481408:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782107464.769818:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782107464.769865:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107464.769924:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472481408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 285us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107464.769932:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00010000:00080000:1.0:1782107464.770016:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abd83421f80 x1868674472481408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107464.770034:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472481408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107465.012323:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107465.012370:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107465.012486:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447241984 00000100:00100000:2.0:1782107465.012495:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447241984 00000100:00100000:2.0:1782107465.012561:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 389 00000100:00100000:2.0:1782107465.012572:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447241984:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107465.012658:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447241984:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107465.012665:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 389 00000100:00100000:3.0:1782107465.012792:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447242112 00000100:00100000:3.0:1782107465.012796:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447242112 00000100:00100000:3.0:1782107465.012859:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 401 00000100:00100000:3.0:1782107465.012867:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447242112:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107465.012911:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447242112:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 45us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107465.012918:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 401 00000100:00080000:2.0:1782107465.013004:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782107465.088201:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107465.476356:0:25473:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_22a needs >= 6 OSTs 00010000:00010000:1.0:1782107466.113800:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107466.817234:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe98f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472481792:0@lo:400:kworker.0 00000100:00100000:3.0:1782107466.817308:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107466.817362:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107466.817368:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe98f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472481920:0@lo:400:kworker.0 00000100:00100000:3.0:1782107466.817395:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107466.817424:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472481792 00000100:00100000:3.0:1782107466.817431:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472481792 00000100:00100000:3.0:1782107466.817484:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1782107466.817493:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472481792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107466.817553:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472481792:12345-0@lo:400:kworker.0 Request processed in 61us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107466.817652:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe98f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472481664:0@lo:400:kworker.0 00000100:00100000:0.0:1782107466.817681:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107466.817704:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe98f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472482176:0@lo:400:kworker.0 00000100:00100000:0.0:1782107466.817724:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107466.817744:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782107466.817750:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe98f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472481536:0@lo:400:kworker.0 00000100:00100000:0.0:1782107466.817774:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107466.817791:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe98f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472482048:0@lo:400:kworker.0 00000100:00100000:0.0:1782107466.817809:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107466.822743:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472481920 00000100:00100000:1.0:1782107466.822759:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472481920 00000100:00100000:1.0:1782107466.822819:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472482176 00000100:00100000:1.0:1782107466.822823:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472482176 00000100:00100000:1.0:1782107466.822851:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782107466.822894:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472481920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107466.823007:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472481920:12345-0@lo:400:kworker.0 Request processed in 148us (5611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107466.823025:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1782107466.823042:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782107466.823048:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472482176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107466.823085:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472482176:12345-0@lo:400:kworker.0 Request processed in 37us (5358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107466.823091:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782107466.823114:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472481536 00000100:00100000:1.0:1782107466.823118:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472481536 00010000:00080000:2.0:1782107466.823129:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe98f3ed80 x1868674472481920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107466.823141:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1782107466.823146:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe98f3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472481920:0@lo:400:kworker.0 00000100:00100000:1.0:1782107466.823147:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472481536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107466.823161:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe98f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472481792:0@lo:400:kworker.0 00000100:00100000:1.0:1782107466.823195:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472481536:12345-0@lo:400:kworker.0 Request processed in 49us (5419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107466.823202:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1782107466.823204:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472481664 00000100:00100000:2.0:1782107466.823207:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472481664 00000100:00100000:2.0:1782107466.823223:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472482048 00000100:00100000:2.0:1782107466.823226:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472482048 00000100:00100000:2.0:1782107466.823242:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1782107466.823248:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472481664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107466.823250:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe98f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472481536:0@lo:400:kworker.0 00000100:00100000:1.0:1782107466.823270:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe98f3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472482176:0@lo:400:kworker.0 00000100:00100000:2.0:1782107466.823281:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472481664:12345-0@lo:400:kworker.0 Request processed in 34us (5600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107466.823286:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe98f3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472481664:0@lo:400:kworker.0 00000100:00100000:2.0:1782107466.823287:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1782107466.823300:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1782107466.823306:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472482048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107466.823357:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472482048:12345-0@lo:400:kworker.0 Request processed in 51us (5545us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107466.823362:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00080000:2.0:1782107466.823379:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782107466.823388:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782107466.823390:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107466.823880:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe98f3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472482048:0@lo:400:kworker.0 00000100:00100000:3.0:1782107466.827758:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00010000:00010000:0.0:1782107467.136142:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107467.387748:0:25522:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 23a: truncate EC file to smaller size == 01:51:06 (1782107466) 00000100:00100000:3.0:1782107467.589110:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107467.589155:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447242240 00000100:00100000:3.0:1782107467.589164:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447242240 00000100:00100000:3.0:1782107467.589240:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 139 00000100:00100000:3.0:1782107467.589250:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:33713:x1868674447242240:12345-192.168.202.26@tcp:101:mkdir.0 00010000:00010000:3.0:1782107467.589275:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107467.589343:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec6088ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.589451:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c569 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.589466:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c569 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.589477:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c569 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107467.589680:0:5807:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782107467.589684:0:5807:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782107467.589765:0:5807:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c569 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.589789:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088ed expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.589805:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c569 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088ed expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.589813:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54a00) 00010000:00010000:3.0:1782107467.589816:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782107467.589819:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec16f4800, rc 0) 00000100:00100000:3.0:1782107467.589896:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:33713:x1868674447242240:12345-192.168.202.26@tcp:101:mkdir.0 Request processed in 646us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107467.589903:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 139 00000100:00080000:3.0:1782107467.589928:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107467.602529:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107467.602569:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107467.602596:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447242368 00000100:00100000:0.0:1782107467.602605:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447242368 00000100:00100000:0.0:1782107467.602649:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447242624 00000100:00100000:0.0:1782107467.602652:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447242624 00000100:00100000:0.0:1782107467.602672:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 140 00000100:00100000:0.0:1782107467.602682:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:2373:x1868674447242368:12345-192.168.202.26@tcp:41:mkdir.0 00000004:00000024:0.0:1782107467.602726:0:5808:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782107467.602792:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:2373:x1868674447242368:12345-192.168.202.26@tcp:41:mkdir.0 Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107467.602799:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 140 00000100:00100000:0.0:1782107467.602817:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 141 00000100:00100000:0.0:1782107467.602823:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:33713:x1868674447242624:12345-192.168.202.26@tcp:36:mkdir.0 00010000:00010000:0.0:1782107467.602884:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782107467.602910:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4800/0xc2d453a189c7c569 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088ed expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.602927:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54a00) 00010000:00010000:0.0:1782107467.602938:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782107467.603365:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.603379:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.603388:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.603428:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.603436:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.603442:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107467.608928:0:5808:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x12:0x0]: returning size 512 00010000:00010000:0.0:1782107467.608946:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.608957:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.608964:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.609003:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439ea00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107467.609009:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.609016:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.609142:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048600) 00010000:00010000:0.0:1782107467.609146:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107467.609153:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.609158:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c570 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107467.609177:0:5808:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000225fb12 reply state 000000000f616e17 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107467.609185:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782107467.609278:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:33713:x1868674447242624:12345-192.168.202.26@tcp:36:mkdir.0 Request processed in 6450us (6703us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1782107467.609287:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 141 00010000:00010000:3.0:1782107467.619292:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.619317:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.619326:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.619332:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439ec00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107467.619337:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.619345:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.619362:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff8abe89048a00) 00010000:00010000:3.0:1782107467.619365:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107467.619370:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.619376:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c577 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107467.641073:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107467.641469:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447242752 00000100:00100000:3.0:1782107467.641481:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447242752 00000100:00100000:3.0:1782107467.641545:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 142 00000100:00100000:3.0:1782107467.641556:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:33716:x1868674447242752:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1782107467.641581:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107467.641612:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c57e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec6088f4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.641702:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7c585 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.641716:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7c585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.641728:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7c585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107467.642161:0:5809:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782107467.642166:0:5809:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782107467.642311:0:5809:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7c585 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.642343:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c57e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088f4 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.642360:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5400/0xc2d453a189c7c585 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088f4 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.642369:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54800) 00010000:00010000:3.0:1782107467.642371:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782107467.642375:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec16f5400, rc 0) 00000100:00100000:3.0:1782107467.642563:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+7:33716:x1868674447242752:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1007us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107467.642570:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 142 00000100:00100000:0.0:1782107467.647918:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107467.648019:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447242880 00000100:00100000:3.0:1782107467.648029:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447242880 00000100:00100000:3.0:1782107467.648102:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 143 00000100:00100000:3.0:1782107467.648112:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+7:33716:x1868674447242880:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1782107467.648133:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107467.648151:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7c58c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec6088fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648533:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648549:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648561:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648576:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648583:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648589:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648731:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c5a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648740:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648746:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107467.648791:0:5807:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x12:0x0]: returning size 512 00000004:00200000:3.0:1782107467.648795:0:5807:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782107467.648817:0:5807:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648829:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648836:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648842:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648848:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f5e00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107467.648860:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648867:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648879:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54800) 00010000:00010000:3.0:1782107467.648882:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107467.648886:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648892:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5e00/0xc2d453a189c7c593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648903:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648918:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648924:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648930:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f4c00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107467.648933:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648939:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648946:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5d0027 (ffff8abe86b54100) 00010000:00010000:3.0:1782107467.648948:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107467.648952:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.648957:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4c00/0xc2d453a189c7c59a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5d0027 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.649323:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7c58c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088fb expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.649338:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5600/0xc2d453a189c7c5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec6088fb expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.649345:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff8abe86b54500) 00010000:00010000:3.0:1782107467.649347:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782107467.649356:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec16f5600, rc 0) 00000100:00100000:2.0:1782107467.650513:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+8:33716:x1868674447242880:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 2396us (2598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107467.650524:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 143 00000100:00100000:0.0:1782107467.653523:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107467.653879:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447243008 00000100:00100000:3.0:1782107467.653889:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447243008 00000100:00100000:3.0:1782107467.653946:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 144 00000100:00100000:3.0:1782107467.653957:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd83421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+8:33716:x1868674447243008:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1782107467.654000:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107467.654019:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5800/0xc2d453a189c7c5a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608902 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654092:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654106:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654116:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654129:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654136:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654143:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654209:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654216:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654238:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654243:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f4400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107467.654247:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654254:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654265:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff8abe86b54500) 00010000:00010000:3.0:1782107467.654268:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107467.654271:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654277:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4400/0xc2d453a189c7c5af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654287:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654294:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654298:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654302:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f4a00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107467.654304:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654319:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654325:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x7b711ae6 (ffff8abe86b54400) 00010000:00010000:3.0:1782107467.654327:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107467.654330:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654336:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7c5b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654365:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5800/0xc2d453a189c7c5a8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608902 expref: 9 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654374:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff8abe86b54500) 00010000:00010000:3.0:1782107467.654376:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107467.654379:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5800/0xc2d453a189c7c5a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608902 expref: 9 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.654388:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec16f5800, rc 0) 00000100:00100000:3.0:1782107467.654453:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd83421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+8:33716:x1868674447243008:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 498us (939us total) trans 0 rc 301/301 00000100:00100000:3.0:1782107467.654461:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 144 00000100:00100000:3.0:1782107467.657675:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107467.657837:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447243264 00000100:00100000:0.0:1782107467.657848:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447243264 00000100:00100000:0.0:1782107467.657909:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 145 00000100:00100000:0.0:1782107467.657918:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+8:33716:x1868674447243264:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1782107467.657944:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107467.657960:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7c5bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608909 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658105:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658119:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658129:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658141:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658147:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658153:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658688:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658697:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658704:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107467.658714:0:5808:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 0 00010000:00010000:0.0:1782107467.658749:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658757:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658763:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658768:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439f800 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107467.658771:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658778:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658790:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff8abe86b54500) 00010000:00010000:0.0:1782107467.658793:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107467.658797:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658802:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f800/0xc2d453a189c7c5c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782107467.658814:0:5808:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000be133b7 reply state 00000000d3ec627c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107467.658822:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782107467.658846:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7c5bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608909 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658869:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608909 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.658881:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8abe89048f00) 00010000:00010000:0.0:1782107467.658883:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782107467.658885:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439ea00, rc 0) 00000100:00100000:0.0:1782107467.658954:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+11:33716:x1868674447243264:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1037us (1289us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1782107467.658962:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 145 00010000:00010000:2.0:1782107467.661582:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.661600:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.661618:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.661625:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439e800 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107467.661629:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.661636:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.661652:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x7b711ae6 (ffff8abe89048600) 00010000:00010000:2.0:1782107467.661655:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107467.661660:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.661665:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e800/0xc2d453a189c7c5cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x12:0x0].0x7b711ae6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107467.662891:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107467.663030:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447243520 00000100:00100000:0.0:1782107467.663042:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447243520 00000100:00100000:0.0:1782107467.663094:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 146 00000100:00100000:0.0:1782107467.663105:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+10:33716:x1868674447243520:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1782107467.663126:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107467.663142:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c5e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608910 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.663235:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.663247:0:7463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608909 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.663254:0:7463:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.663304:0:7463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608909 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107467.663317:0:7463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608909 expref: 11 pid: 5808 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107467.663346:0:7463:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83420700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7463:1868674472482304:192.168.202.26@tcp:104: 00000100:00100000:0.0:1782107467.663448:0:7463:0:(client.c:2692:ptlrpc_set_wait()) set ffff8abe99472840 going to sleep for 11 seconds 00000100:00100000:1.0:1782107467.666554:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107467.666710:0:5792:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447243648 00000100:00100000:3.0:1782107467.666720:0:5792:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447243648 00010000:00010000:3.0:1782107467.666756:0:5792:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608909 expref: 12 pid: 5808 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107467.666810:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 44 00000100:00100000:3.0:1782107467.666819:0:5792:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd8352a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+12:2372:x1868674447243648:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782107467.666832:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782107467.666837:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608909 expref: 12 pid: 5808 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.666849:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608909 expref: 12 pid: 5808 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.666881:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8abe89048f00) 00010000:00010000:3.0:1782107467.666885:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.666894:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.666901:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107467.666920:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782107467.667000:0:5792:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd8352a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+12:2372:x1868674447243648:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 181us (454us total) trans 0 rc 0/0 00010000:00010000:2.0:1782107467.667145:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ea00/0xc2d453a189c7c5d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608909 expref: 12 pid: 5808 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107467.667173:0:7463:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83420700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7463:1868674472482304:192.168.202.26@tcp:104: 00000100:00100000:3.0:1782107467.667297:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 44 00010000:00010000:2.0:1782107467.668192:0:7463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668216:0:7463:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668222:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782107467.668241:0:7463:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x13:0x0]: returning size 0 00010000:00010000:2.0:1782107467.668491:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668510:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668517:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668522:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439e200 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107467.668526:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668534:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668546:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x13:0x0].0x0 (ffff8abe89048f00) 00010000:00010000:2.0:1782107467.668549:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782107467.668564:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668571:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e200/0xc2d453a189c7c5e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668623:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c5e0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608910 expref: 10 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668634:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x12:0x0].0x0 (ffff8abe86b54500) 00010000:00010000:2.0:1782107467.668637:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782107467.668641:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439ec00/0xc2d453a189c7c5e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x12:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608910 expref: 10 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107467.668650:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439ec00, rc 0) 00000100:00100000:2.0:1782107467.668704:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+9:33716:x1868674447243520:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 5600us (5819us total) trans 0 rc 301/301 00000100:00100000:2.0:1782107467.668713:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 146 00000100:00100000:1.0:1782107467.671276:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107467.671355:0:5810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447243904 00000100:00100000:3.0:1782107467.671365:0:5810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447243904 00000100:00100000:3.0:1782107467.671529:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:3.0:1782107467.671540:0:5810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd8352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+9:33716:x1868674447243904:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:2.0:1782107467.671866:0:5810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd8352ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+10:33716:x1868674447243904:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 327us (596us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1782107467.671874:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 21 00010000:00010000:1.0:1782107468.160553:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782107468.418772:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000001:00080000:3.0:1782107468.418794:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000100:00100000:2.0:1782107468.867197:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472482432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782107468.867266:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107468.867345:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472482432 00000100:00100000:2.0:1782107468.867352:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472482432 00000100:00100000:2.0:1782107468.867403:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1782107468.867412:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472482432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107468.868424:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107468.868691:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472482432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1277us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107468.868701:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1782107468.868730:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107468.872585:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472482432:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1782107469.094703:0:25572:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_23a: @@@@@@ FAIL: setstripe failed 00010000:00010000:3.0:1782107469.186240:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107469.891713:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd83420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472482560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107469.891781:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107469.892068:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472482560 00000100:00100000:0.0:1782107469.892076:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472482560 00000100:00100000:0.0:1782107469.892136:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782107469.892145:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472482560:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782107469.892411:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1782107469.892492:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107469.892556:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472482560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 411us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107469.892563:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00010000:00080000:3.0:1782107469.893107:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abd83420e00 x1868674472482560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107469.893128:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd83420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472482560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107470.125517:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107470.125571:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107470.125646:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447244160 00000100:00100000:3.0:1782107470.125657:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447244160 00000100:00100000:3.0:1782107470.125731:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 405 00000100:00100000:3.0:1782107470.125742:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe98f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:2372:x1868674447244160:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107470.125817:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe98f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:2372:x1868674447244160:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107470.125825:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 405 00000100:00080000:3.0:1782107470.125860:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107470.126053:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447244032 00000100:00100000:2.0:1782107470.126059:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447244032 00000100:00100000:2.0:1782107470.126098:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 391 00000100:00100000:2.0:1782107470.126106:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447244032:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107470.126136:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447244032:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 32us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107470.126142:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 391 00010000:00010000:0.0:1782107470.215565:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 2053 lines, 2053 kept, 0 dropped, 0 bad.