00010000:00010000:3.0F:1782107157.760307:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1782107157.807104:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107157.807196:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0F:1782107157.807315:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447209344 00000100:00100000:0.0:1782107157.807331:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447209344 00000100:00100000:0.0:1782107157.807400:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 164 00000100:00100000:0.0:1782107157.807410:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447209344:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107157.807488:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447209344:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107157.807495:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 164 00000100:00080000:1.0:1782107157.807763:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107157.807844:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447209216 00000100:00100000:3.0:1782107157.807850:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447209216 00000100:00100000:3.0:1782107157.809064:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 269 00000100:00100000:3.0:1782107157.809080:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447209216:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107157.809150:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447209216:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 76us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107157.809157:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 269 00010000:00010000:1.0:1782107158.784791:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1782107159.488720:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107159.488909:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447209472 00000100:00100000:3.0:1782107159.488919:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447209472 00000100:00100000:3.0:1782107159.489012:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:3.0:1782107159.489024:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:13813:x1868674447209472:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:3.0:1782107159.489045:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107159.489067:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5800/0xc2d453a189c7beaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608718 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.489132:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5c00/0xc2d453a189c7beb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.489146:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5c00/0xc2d453a189c7beb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.489157:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5c00/0xc2d453a189c7beb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107159.489341:0:5808:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782107159.489345:0:5808:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:2.0:1782107159.489614:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1782107159.489651:0:5808:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5c00/0xc2d453a189c7beb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.489681:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5800/0xc2d453a189c7beaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608718 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.489714:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5c00/0xc2d453a189c7beb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608718 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.489724:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54500) 00010000:00010000:3.0:1782107159.489727:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782107159.489731:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec16f5c00, rc 0) 00000100:00100000:3.0:1782107159.489827:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:13813:x1868674447209472:12345-192.168.202.26@tcp:101:rm.0 Request processed in 805us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107159.489835:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:1.0:1782107159.494724:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107159.494808:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447209600 00000100:00100000:3.0:1782107159.494819:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447209600 00000100:00100000:3.0:1782107159.494903:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:3.0:1782107159.494915:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+6:13813:x1868674447209600:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:3.0:1782107159.494943:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107159.494962:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4200/0xc2d453a189c7bebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec60871f expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495054:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495068:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495080:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495103:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495127:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495135:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495486:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4000/0xc2d453a189c7bed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495495:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4000/0xc2d453a189c7bed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495501:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4000/0xc2d453a189c7bed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782107159.495529:0:7463:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782107159.495532:0:7463:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782107159.495551:0:7463:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4000/0xc2d453a189c7bed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495562:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4000/0xc2d453a189c7bed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495570:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495576:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495581:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495606:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f5200 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107159.495610:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495617:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495629:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54500) 00010000:00010000:3.0:1782107159.495632:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107159.495638:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495644:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bec4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495656:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495662:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495668:0:7463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495673:0:7463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f4600 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107159.495675:0:7463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495681:0:7463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495700:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xddb0fc11 (ffff8abe86b54f00) 00010000:00010000:3.0:1782107159.495702:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107159.495705:0:7463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495711:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7becb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495740:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4200/0xc2d453a189c7bebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60871f expref: 8 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495753:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4000/0xc2d453a189c7bed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60871f expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.495761:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abe86b54300) 00010000:00010000:3.0:1782107159.495763:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782107159.495765:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec16f4000, rc 0) 00000100:00100000:3.0:1782107159.495825:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+7:13813:x1868674447209600:12345-192.168.202.26@tcp:101:rm.0 Request processed in 912us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107159.495833:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:2.0:1782107159.509911:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107159.510831:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447209856 00000100:00100000:1.0:1782107159.510843:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447209856 00000100:00100000:1.0:1782107159.510907:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:1.0:1782107159.510918:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:13813:x1868674447209856:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:1.0:1782107159.510991:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782107159.511017:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4000/0xc2d453a189c7bed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60871f expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511037:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abe86b54300) 00010000:00010000:1.0:1782107159.511053:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5c00/0xc2d453a189c7beb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608718 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511063:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe86b54500) 00010000:00010000:1.0:1782107159.511068:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782107159.511093:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511106:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511116:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511130:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511153:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511160:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511522:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511532:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.511540:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512341:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512353:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512361:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512368:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512375:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512381:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512411:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782107159.512431:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512437:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512443:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512448:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe81406e00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:1.0:1782107159.512453:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512460:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512470:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abe84d6ad00) 00010000:00010000:1.0:1782107159.512473:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782107159.512477:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512482:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bee7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107159.512488:0:5795:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782107159.512494:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107159.512499:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe81407a00 already unused, calling callback (ffffffffc13e26f0) 00010000:00010000:1.0:1782107159.512499:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107159.512503:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512504:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107159.512509:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512510:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107159.512518:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8abe84d6ad00) 00010000:00010000:2.0:1782107159.512520:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782107159.512520:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe81406800 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107159.512523:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512523:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107159.512529:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7beee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512529:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107159.512537:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a500) 00010000:00010000:1.0:1782107159.512539:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107159.512541:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107159.512542:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107159.512544:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107159.512545:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107159.512547:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406800/0xc2d453a189c7bed9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782107159.512557:0:5808:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000745b13b5 reply state 00000000f79c7367 transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107159.512565:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782107159.512659:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+7:13813:x1868674447209856:12345-192.168.202.26@tcp:36:rm.0 Request processed in 1742us (2756us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1782107159.512669:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 63 00010000:00010000:3.0:1782107159.515744:0:3310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.515759:0:3310:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.515767:0:3310:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.515789:0:3310:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe81407000 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107159.515794:0:3310:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.515802:0:3310:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.515818:0:3310:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xddb0fc11 (ffff8abe84d6a800) 00010000:00010000:3.0:1782107159.515821:0:3310:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107159.515826:0:3310:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107159.515832:0:3310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bee0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xddb0fc11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107159.617151:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472419072:0@lo:400:kworker.0 00000100:00100000:0.0:1782107159.617214:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107159.617265:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107159.617271:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472419200:0@lo:400:kworker.0 00000100:00100000:0.0:1782107159.617295:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107159.617332:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472419072 00000100:00100000:0.0:1782107159.617340:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472419072 00000100:00100000:0.0:1782107159.617398:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782107159.617407:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472419072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107159.617458:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472419072:12345-0@lo:400:kworker.0 Request processed in 51us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107159.617464:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1782107159.617484:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107159.617515:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472419072:0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.617654:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472418944:0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.617685:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107159.617708:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472419456:0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.617731:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107159.617756:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782107159.617762:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472418816:0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.617797:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107159.617935:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472418944 00000100:00100000:0.0:1782107159.617940:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472418944 00000100:00100000:0.0:1782107159.617966:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1782107159.617989:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472418944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107159.618022:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472418944:12345-0@lo:400:kworker.0 Request processed in 50us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107159.618037:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782107159.618116:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472419328:0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.618140:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107159.618160:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472418944:0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.618182:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472419200 00000100:00100000:2.0:1782107159.618185:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472419200 00000100:00100000:2.0:1782107159.618226:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472419456 00000100:00100000:2.0:1782107159.618229:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472419456 00000100:00100000:2.0:1782107159.618247:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782107159.618253:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472419200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.618287:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472419200:12345-0@lo:400:kworker.0 Request processed in 34us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107159.618294:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782107159.618304:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782107159.618309:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472419456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.618336:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4208700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472419456:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107159.618342:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782107159.618385:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472418816 00000100:00100000:2.0:1782107159.618389:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472418816 00000100:00100000:2.0:1782107159.618409:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1782107159.618414:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472418816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.618442:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472418816:12345-0@lo:400:kworker.0 Request processed in 27us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107159.618448:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:00080000:2.0:1782107159.618489:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebfc4dc00 x1868674472419200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107159.618505:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472419200:0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.618529:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472418816:0@lo:400:kworker.0 00000100:00100000:2.0:1782107159.618539:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472419456:0@lo:400:kworker.0 00000100:00100000:0.0:1782107159.618614:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472419328 00000100:00100000:0.0:1782107159.618618:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472419328 00000100:00100000:0.0:1782107159.618653:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782107159.618659:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb4209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472419328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107159.618691:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb4209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472419328:12345-0@lo:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107159.618696:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782107159.618816:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472419328:0@lo:400:kworker.0 00000100:00080000:1.0:1782107159.618878:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782107159.618882:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107159.618884:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782107159.810519:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107160.834132:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782107161.199539:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967323 is committed 00000100:00100000:3.0:1782107161.672790:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472419584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107161.672861:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107161.672937:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472419584 00000100:00100000:3.0:1782107161.672947:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472419584 00000100:00100000:3.0:1782107161.673023:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782107161.673033:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472419584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107161.673084:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107161.673129:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472419584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107161.673136:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1782107161.673156:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107161.673206:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472419584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107161.857618:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107162.689251:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472419712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107162.689317:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107162.689532:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472419712 00000100:00100000:2.0:1782107162.689540:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472419712 00000100:00100000:2.0:1782107162.689671:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782107162.689682:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472419712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107162.689718:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107162.689784:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472419712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107162.689791:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1782107162.689862:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebfc4ea00 x1868674472419712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107162.689881:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472419712:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107162.689922:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782107162.881735:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107162.929949:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107162.930151:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107162.930261:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447210112 00000100:00100000:0.0:1782107162.930275:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447210112 00000100:00100000:0.0:1782107162.930382:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 168 00000100:00100000:0.0:1782107162.930395:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447210112:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107162.930479:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447210112:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 87us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107162.930487:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 168 00000100:00100000:1.0:1782107162.930749:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447209984 00000100:00100000:1.0:1782107162.930755:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447209984 00000100:00100000:1.0:1782107162.930793:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 271 00000100:00100000:1.0:1782107162.930801:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447209984:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107162.930844:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447209984:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 44us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107162.930850:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 271 00000100:00080000:2.0:1782107162.931552:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782107163.910086:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107164.739561:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472419840:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.739603:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472419968:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.739830:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107164.739882:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472420480:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.739909:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107164.739946:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107164.740409:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782107164.740417:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472420352:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.740471:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107164.740508:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472420096:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.741275:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107164.741373:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107164.741383:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472420224:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.741411:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107164.741455:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472419968 00000100:00100000:1.0:1782107164.741462:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472419968 00000100:00100000:1.0:1782107164.741500:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472420352 00000100:00100000:1.0:1782107164.741502:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472420352 00000100:00100000:1.0:1782107164.741522:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472420096 00000100:00100000:1.0:1782107164.741525:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472420096 00000100:00100000:1.0:1782107164.741543:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782107164.741563:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472419968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107164.741603:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472420480 00000100:00100000:3.0:1782107164.741609:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472420480 00000100:00100000:1.0:1782107164.741621:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472419968:12345-0@lo:400:kworker.0 Request processed in 69us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107164.741640:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1782107164.741644:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472420224 00000100:00100000:3.0:1782107164.741648:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472420224 00000100:00100000:1.0:1782107164.741661:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782107164.741669:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472420352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107164.741676:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782107164.741687:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472420480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107164.741733:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472420480:12345-0@lo:400:kworker.0 Request processed in 48us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107164.741740:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782107164.741753:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782107164.741759:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472420224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107164.741792:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472420224:12345-0@lo:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107164.741797:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782107164.742119:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472419840 00000100:00100000:0.0:1782107164.742124:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472419840 00000100:00100000:1.0:1782107164.742454:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472420352:12345-0@lo:400:kworker.0 Request processed in 35us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107164.742464:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782107164.742480:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782107164.742489:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472420096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.742529:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472420096:12345-0@lo:400:kworker.0 Request processed in 42us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107164.742535:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1782107164.742592:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782107164.742596:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107164.742598:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782107164.742729:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef4e300 x1868674472420224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107164.742744:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472420224:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.742755:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472420096:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.742788:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472420352:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.742800:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472419968:0@lo:400:kworker.0 00000100:00100000:1.0:1782107164.742814:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472420480:0@lo:400:kworker.0 00000100:00100000:0.0:1782107164.742870:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1782107164.742879:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472419840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107164.742933:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472419840:12345-0@lo:400:kworker.0 Request processed in 56us (2987us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107164.742947:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1782107164.743026:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472419840:0@lo:400:kworker.0 00010000:00010000:3.0:1782107164.930411:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107165.961786:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107166.794206:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472420608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107166.794277:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107166.794353:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472420608 00000100:00100000:3.0:1782107166.794361:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472420608 00000100:00100000:3.0:1782107166.794416:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782107166.794432:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472420608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107166.794469:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107166.794512:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472420608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107166.794520:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1782107166.794550:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107166.794774:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472420608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107166.976153:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107167.381705:0:15147:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1h: setstripe with -N flag and explicit stripe counts with --ec ========================================================== 01:46:06 (1782107166) 00000100:00100000:3.0:1782107167.808327:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472420736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107167.808413:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107167.808570:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472420736 00000100:00100000:2.0:1782107167.808579:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472420736 00000100:00100000:2.0:1782107167.808644:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782107167.808654:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472420736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107167.808688:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107167.808736:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472420736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107167.808758:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1782107167.808798:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebfc4ea00 x1868674472420736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107167.808816:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472420736:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107167.809001:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782107168.000206:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107168.059376:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107168.059491:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107168.059576:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447210368 00000100:00100000:3.0:1782107168.059587:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447210368 00000100:00100000:3.0:1782107168.059660:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 172 00000100:00100000:3.0:1782107168.059671:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447210368:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107168.059745:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447210368:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107168.059753:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 172 00000100:00080000:1.0:1782107168.060243:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107168.062304:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447210240 00000100:00100000:0.0:1782107168.062316:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447210240 00000100:00100000:1.0:1782107168.066220:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 273 00000100:00100000:1.0:1782107168.066235:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447210240:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107168.066320:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447210240:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 88us (6951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107168.066329:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 273 00000001:02000400:3.0:1782107168.610289:0:15195:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1h needs >= 6 OSTs 00010000:00010000:0.0:1782107169.024305:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107169.861578:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472421120:0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.861648:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107169.861711:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107169.861721:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472421248:0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.861749:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107169.861789:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472421120 00000100:00100000:3.0:1782107169.861796:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472421120 00000100:00100000:3.0:1782107169.861860:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782107169.861869:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472421120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.861921:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472421120:12345-0@lo:400:kworker.0 Request processed in 52us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107169.861928:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782107169.861951:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472421248 00000100:00100000:3.0:1782107169.861955:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472421248 00000100:00100000:3.0:1782107169.862008:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782107169.862016:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472421248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.862045:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472421248:12345-0@lo:400:kworker.0 Request processed in 31us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107169.862051:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1782107169.862066:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107169.862071:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782107169.862101:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec1314700 x1868674472421248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107169.862115:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472421248:0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.862125:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472421120:0@lo:400:kworker.0 00000100:00100000:0.0:1782107169.862211:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472420864:0@lo:400:kworker.0 00000100:00100000:0.0:1782107169.862243:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107169.862281:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472421376:0@lo:400:kworker.0 00000100:00100000:0.0:1782107169.862302:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107169.862316:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782107169.862322:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472420992:0@lo:400:kworker.0 00000100:00100000:0.0:1782107169.862343:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107169.862361:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472421504:0@lo:400:kworker.0 00000100:00100000:0.0:1782107169.862381:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107169.862406:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472421504 00000100:00100000:0.0:1782107169.862410:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472421504 00000100:00100000:0.0:1782107169.862438:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782107169.862445:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472421504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107169.862479:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472421504:12345-0@lo:400:kworker.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107169.862486:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782107169.862523:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472421504:0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.862797:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472420864 00000100:00100000:3.0:1782107169.862802:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472420864 00000100:00100000:3.0:1782107169.862839:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1782107169.862847:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472420864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.862886:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472420864:12345-0@lo:400:kworker.0 Request processed in 40us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107169.862893:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1782107169.862920:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472421376 00000100:00100000:3.0:1782107169.862932:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472421376 00000100:00100000:3.0:1782107169.862960:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472420992 00000100:00100000:3.0:1782107169.862963:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472420992 00000100:00100000:3.0:1782107169.863015:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782107169.863022:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472421376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.863055:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472421376:12345-0@lo:400:kworker.0 Request processed in 34us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107169.863061:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782107169.863073:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782107169.863078:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472420992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.863101:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472420992:12345-0@lo:400:kworker.0 Request processed in 23us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107169.863106:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1782107169.863122:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782107169.863126:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782107169.863146:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472420992:0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.863154:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472420864:0@lo:400:kworker.0 00000100:00100000:3.0:1782107169.863163:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472421376:0@lo:400:kworker.0 00010000:00010000:3.0:1782107170.059745:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107170.362530:0:15243:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1i: default EC layout on directory ===== 01:46:09 (1782107169) 00010000:00010000:0.0:1782107171.072778:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107171.908294:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472421632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107171.908384:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107171.909366:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472421632 00000100:00100000:0.0:1782107171.909377:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472421632 00000100:00100000:0.0:1782107171.909441:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782107171.909453:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472421632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107171.909504:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107171.909567:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472421632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107171.909574:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1782107171.909947:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107171.910436:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472421632:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1782107171.962868:0:15292:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1i needs >= 6 OSTs 00010000:00010000:0.0:1782107172.097066:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107172.930237:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107172.930260:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472421760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107172.930329:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107172.930412:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472421760 00000100:00100000:0.0:1782107172.930420:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472421760 00000100:00100000:0.0:1782107172.930489:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782107172.930500:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472421760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107172.930538:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107172.930585:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472421760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107172.930596:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1782107172.930619:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782107172.930671:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebfc4dc00 x1868674472421760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107172.930698:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472421760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782107173.120445:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107173.179862:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107173.179911:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107173.179997:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447210496 00000100:00100000:0.0:1782107173.180006:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447210624 00000100:00100000:3.0:1782107173.180008:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447210496 00000100:00100000:0.0:1782107173.180010:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447210624 00000100:00100000:3.0:1782107173.180057:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 275 00000100:00100000:0.0:1782107173.180061:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 176 00000100:00100000:3.0:1782107173.180067:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447210496:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107173.180078:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb3ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447210624:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107173.180143:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447210496:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107173.180150:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 275 00000100:00080000:2.0:1782107173.180266:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107173.189496:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb3ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447210624:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 9205us (9360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107173.189512:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 176 00000001:02000400:2.0:1782107173.692759:0:15340:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1j: verify EC component inherits stripe size from data component ========================================================== 01:46:12 (1782107172) 00010000:00010000:0.0:1782107174.149865:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107174.981193:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472422016:0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.981283:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107174.981329:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472422528:0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.981356:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107174.981387:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782107174.981393:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472421888:0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.981419:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107174.981440:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472422400:0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.981648:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107174.981685:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472422144:0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.981710:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107174.981728:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107174.981732:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472422272:0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.981752:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107174.981784:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472422016 00000100:00100000:1.0:1782107174.981790:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472422016 00000100:00100000:1.0:1782107174.981846:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472422400 00000100:00100000:1.0:1782107174.981862:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472422400 00000100:00100000:1.0:1782107174.981890:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472422144 00000100:00100000:1.0:1782107174.981892:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472422144 00000100:00100000:1.0:1782107174.981907:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782107174.981914:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472422016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.981968:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472422016:12345-0@lo:400:kworker.0 Request processed in 53us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107174.981994:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782107174.982012:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782107174.982019:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472422400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.982164:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472422400:12345-0@lo:400:kworker.0 Request processed in 145us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107174.982170:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782107174.982183:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782107174.982189:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472422144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.982289:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472422144:12345-0@lo:400:kworker.0 Request processed in 100us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107174.982295:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782107174.982314:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472422528 00000100:00100000:1.0:1782107174.982318:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472422528 00000100:00100000:1.0:1782107174.982341:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472422272 00000100:00100000:1.0:1782107174.982343:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472422272 00000100:00100000:1.0:1782107174.982362:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782107174.982368:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472422528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.982398:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472422528:12345-0@lo:400:kworker.0 Request processed in 31us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107174.982404:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782107174.982423:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782107174.982429:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472422272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107174.983061:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472421888 00000100:00100000:0.0:1782107174.983068:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472421888 00000100:00100000:0.0:1782107174.983100:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1782107174.983109:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe86808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472421888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107174.987181:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe86808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472421888:12345-0@lo:400:kworker.0 Request processed in 4064us (5750us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107174.987196:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:2.0:1782107174.987932:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782107174.987939:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782107174.987942:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782107174.988034:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990a9c00 x1868674472422272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107174.988051:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472422272:0@lo:400:kworker.0 00000100:00100000:2.0:1782107174.988066:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472422144:0@lo:400:kworker.0 00000100:00100000:2.0:1782107174.988104:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472421888:0@lo:400:kworker.0 00000100:00100000:2.0:1782107174.988116:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472422400:0@lo:400:kworker.0 00000100:00100000:2.0:1782107174.988127:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472422016:0@lo:400:kworker.0 00000100:00100000:2.0:1782107174.988136:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472422528:0@lo:400:kworker.0 00000100:00100000:1.0:1782107174.989115:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472422272:12345-0@lo:400:kworker.0 Request processed in 6679us (7354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107174.989128:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:0.0:1782107175.168191:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107175.402511:0:15388:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1j needs >= 6 OSTs 00010000:00010000:3.0:1782107176.193530:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107177.030219:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472422656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107177.030283:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107177.030352:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472422656 00000100:00100000:0.0:1782107177.030359:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472422656 00000100:00100000:0.0:1782107177.030412:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1782107177.030421:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472422656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107177.030467:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107177.030512:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472422656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107177.030531:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1782107177.030552:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107177.030591:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472422656:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1782107177.084593:0:15436:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1k: test we can create -c (n-2) --ec (n-2)+2 with n OSTs ========================================================== 01:46:16 (1782107176) 00010000:00010000:0.0:1782107177.216866:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107178.049004:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782107178.049045:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472422784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107178.049121:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107178.049331:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472422784 00000100:00100000:0.0:1782107178.049339:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472422784 00000100:00100000:0.0:1782107178.049407:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1782107178.049418:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec110a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472422784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107178.049470:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107178.049521:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec110a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472422784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107178.049529:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1782107178.049571:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebfc4dc00 x1868674472422784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107178.049589:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472422784:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782107178.050282:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782107178.241845:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107178.290073:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107178.290114:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107178.290298:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447210752 00000100:00100000:3.0:1782107178.290310:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447210752 00000100:00100000:3.0:1782107178.290371:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 277 00000100:00100000:3.0:1782107178.290382:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447210752:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107178.290474:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447210752:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 94us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107178.290482:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 277 00000100:00100000:1.0:1782107178.290873:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447210880 00000100:00100000:1.0:1782107178.290878:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447210880 00000100:00100000:1.0:1782107178.290938:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 180 00000100:00100000:1.0:1782107178.290947:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447210880:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107178.291011:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447210880:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 66us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107178.291018:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 180 00000100:00080000:0.0:1782107178.291080:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1782107178.526641:0:15484:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1k needs 8 OSTs 00010000:00010000:3.0:1782107179.267802:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107180.101296:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472423040:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.101363:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107180.101406:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe85a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472423552:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.101487:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107180.101578:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782107180.101585:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472422912:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.101612:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107180.101632:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472423424:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.101666:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107180.101695:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472423168:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.101716:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107180.101732:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107180.101742:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472423296:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.101761:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107180.101787:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472423040 00000100:00100000:3.0:1782107180.101794:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472423040 00000100:00100000:3.0:1782107180.101827:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472423424 00000100:00100000:3.0:1782107180.101830:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472423424 00000100:00100000:3.0:1782107180.101847:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472423168 00000100:00100000:3.0:1782107180.101850:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472423168 00000100:00100000:3.0:1782107180.101865:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782107180.101872:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472423040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.101922:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472423040:12345-0@lo:400:kworker.0 Request processed in 50us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107180.101929:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782107180.101947:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782107180.101953:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472423424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.101997:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472423424:12345-0@lo:400:kworker.0 Request processed in 45us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107180.103239:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782107180.103268:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782107180.103280:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472423168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.103343:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472423168:12345-0@lo:400:kworker.0 Request processed in 69us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107180.103349:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782107180.103372:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472423552 00000100:00100000:3.0:1782107180.103378:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472423552 00000100:00100000:3.0:1782107180.103408:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472423296 00000100:00100000:3.0:1782107180.103411:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472423296 00000100:00100000:3.0:1782107180.106055:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782107180.106089:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472423552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.106179:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472423552:12345-0@lo:400:kworker.0 Request processed in 97us (4691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107180.106187:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782107180.106205:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782107180.106212:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472423296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.106244:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472423296:12345-0@lo:400:kworker.0 Request processed in 32us (4481us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107180.106250:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782107180.106273:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472422912 00000100:00100000:3.0:1782107180.106280:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472422912 00000100:00100000:3.0:1782107180.106309:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1782107180.106316:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472422912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.106348:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472422912:12345-0@lo:400:kworker.0 Request processed in 33us (4735us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107180.106354:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1782107180.106405:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107180.106409:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107180.106412:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107180.106457:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472422912:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.106473:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472423424:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.106484:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472423040:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.106493:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe85a6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472423552:0@lo:400:kworker.0 00010000:00080000:3.0:1782107180.107683:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec1315500 x1868674472423296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107180.107715:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472423296:0@lo:400:kworker.0 00000100:00100000:3.0:1782107180.107731:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472423168:0@lo:400:kworker.0 00000001:02000400:0.0:1782107180.161216:0:15533:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 1l: test stripe creation fails when parity needs one stripe too many ========================================================== 01:46:19 (1782107179) 00010000:00010000:0.0:1782107180.288345:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107181.312530:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107181.843859:0:15581:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_1l needs 8 OSTs 00000100:00100000:1.0:1782107182.144327:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107182.144356:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472423680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107182.144440:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107182.144609:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472423680 00000100:00100000:0.0:1782107182.144618:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472423680 00000100:00100000:0.0:1782107182.144690:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782107182.144701:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472423680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107182.144754:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107182.144805:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472423680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107182.144812:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1782107182.144907:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782107182.145242:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472423680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107182.336960:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107183.168539:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472423808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107183.168613:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107183.168755:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472423808 00000100:00100000:1.0:1782107183.168765:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472423808 00000100:00100000:1.0:1782107183.168842:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782107183.168852:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472423808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107183.168893:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107183.168944:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472423808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107183.168952:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1782107183.169026:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990aad80 x1868674472423808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107183.169044:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472423808:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782107183.169601:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782107183.366883:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107183.386763:0:15629:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2a: setstripe with -N and EC =========== 01:46:22 (1782107182) 00000100:00100000:0.0:1782107183.414176:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107183.415624:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107183.416954:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447211136 00000100:00100000:1.0:1782107183.416969:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447211136 00000100:00100000:1.0:1782107183.417121:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 184 00000100:00100000:1.0:1782107183.417132:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447211136:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107183.417219:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebfc4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447211136:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 89us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107183.417226:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 184 00000100:00100000:3.0:1782107183.420548:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447211008 00000100:00100000:3.0:1782107183.420564:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447211008 00000100:00100000:3.0:1782107183.420632:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 279 00000100:00100000:3.0:1782107183.420642:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447211008:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107183.420716:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447211008:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 75us (5097us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107183.420724:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 279 00000100:00080000:0.0:1782107183.422131:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782107184.384161:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107184.920704:0:15677:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2a needs >= 8 OSTs 00000100:00100000:0.0:1782107185.217525:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472424320:0@lo:400:kworker.0 00000100:00100000:0.0:1782107185.217598:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107185.217662:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107185.217669:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472424192:0@lo:400:kworker.0 00000100:00100000:0.0:1782107185.217696:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107185.217807:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472423936:0@lo:400:kworker.0 00000100:00100000:1.0:1782107185.217839:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107185.217871:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472424448:0@lo:400:kworker.0 00000100:00100000:1.0:1782107185.217893:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107185.217910:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782107185.217915:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472424064:0@lo:400:kworker.0 00000100:00100000:1.0:1782107185.217935:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107185.217952:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472424576:0@lo:400:kworker.0 00000100:00100000:1.0:1782107185.217997:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107185.218025:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472424192 00000100:00100000:1.0:1782107185.218032:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472424192 00000100:00100000:1.0:1782107185.218079:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472424448 00000100:00100000:1.0:1782107185.218082:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472424448 00000100:00100000:1.0:1782107185.218098:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472424064 00000100:00100000:1.0:1782107185.218101:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472424064 00000100:00100000:1.0:1782107185.218116:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782107185.218124:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472424192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107185.218182:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472424192:12345-0@lo:400:kworker.0 Request processed in 59us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107185.218190:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782107185.218206:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782107185.218211:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472424448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107185.218237:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472424448:12345-0@lo:400:kworker.0 Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107185.218243:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782107185.218252:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782107185.218258:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472424064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107185.218279:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472424064:12345-0@lo:400:kworker.0 Request processed in 22us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107185.218283:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782107185.218315:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472424064:0@lo:400:kworker.0 00000100:00100000:1.0:1782107185.218324:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472424448:0@lo:400:kworker.0 00000100:00100000:0.0:1782107185.218411:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472423936 00000100:00100000:0.0:1782107185.218415:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472423936 00000100:00100000:0.0:1782107185.218451:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1782107185.218457:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe8680bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472423936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107185.218494:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe8680bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472423936:12345-0@lo:400:kworker.0 Request processed in 37us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107185.218499:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:0.0:1782107185.218524:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107185.218543:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472424192:0@lo:400:kworker.0 00000100:00100000:0.0:1782107185.218563:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebfc4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472423936:0@lo:400:kworker.0 00000100:00100000:3.0:1782107185.218810:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472424320 00000100:00100000:3.0:1782107185.218816:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472424320 00000100:00100000:3.0:1782107185.218861:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472424576 00000100:00100000:3.0:1782107185.218864:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472424576 00000100:00100000:3.0:1782107185.218886:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782107185.218892:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472424320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107185.218933:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472424320:12345-0@lo:400:kworker.0 Request processed in 41us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107185.218940:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782107185.218952:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782107185.218958:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472424576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107185.219012:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472424576:12345-0@lo:400:kworker.0 Request processed in 54us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107185.219031:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1782107185.219092:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec0d1c000 x1868674472424320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107185.219104:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472424320:0@lo:400:kworker.0 00000100:00100000:3.0:1782107185.219130:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472424576:0@lo:400:kworker.0 00000100:00080000:0.0:1782107185.219188:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782107185.219192:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782107185.408289:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107186.432239:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107186.747932:0:15726:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2b: setstripe with -N: two data mirrors, one with EC ========================================================== 01:46:25 (1782107185) 00000100:00100000:2.0:1782107187.265792:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472424704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782107187.265877:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107187.266006:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472424704 00000100:00100000:1.0:1782107187.266024:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472424704 00000100:00100000:1.0:1782107187.266098:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782107187.266109:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472424704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107187.266145:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782107187.266180:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107187.273109:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472424704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1714us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107187.273140:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782107187.273503:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472424704:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107187.457158:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107188.288373:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472424832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107188.288462:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107188.289208:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472424832 00000100:00100000:2.0:1782107188.289217:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472424832 00000100:00100000:2.0:1782107188.289271:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782107188.289281:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472424832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107188.289319:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000001:02000400:3.0:1782107188.290877:0:15774:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2b needs >= 8 OSTs 00000100:00100000:2.0:1782107188.295417:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472424832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6128us (6945us total) trans 0 rc 0/0 00010000:00080000:1.0:1782107188.295570:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990ab800 x1868674472424832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107188.295604:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472424832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107188.296784:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107188.296912:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:1.0:1782107188.480472:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107188.525484:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107188.525523:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107188.525550:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447211264 00000100:00100000:3.0:1782107188.525558:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447211264 00000100:00100000:3.0:1782107188.525605:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 281 00000100:00100000:3.0:1782107188.525615:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447211264:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107188.525691:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447211264:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107188.525698:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 281 00000100:00100000:1.0:1782107188.529822:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447211392 00000100:00100000:1.0:1782107188.529835:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447211392 00000100:00100000:1.0:1782107188.529931:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 188 00000100:00100000:1.0:1782107188.529943:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447211392:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107188.530039:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447211392:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 98us (4564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107188.530046:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 188 00000100:00080000:3.0:1782107188.530401:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782107189.510000:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107189.891491:0:15822:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2c: setstripe with -N: two data mirrors, both with EC ========================================================== 01:46:29 (1782107189) 00000100:00100000:3.0:1782107190.341567:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472424960:0@lo:400:kworker.0 00000100:00100000:3.0:1782107190.341639:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107190.341771:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472425088:0@lo:400:kworker.0 00000100:00100000:0.0:1782107190.341798:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107190.341853:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472425088 00000100:00100000:0.0:1782107190.341863:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472425088 00000100:00100000:0.0:1782107190.341914:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782107190.341923:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472425088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107190.342000:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472425088:12345-0@lo:400:kworker.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107190.342008:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782107190.342054:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472425088:0@lo:400:kworker.0 00000100:00100000:1.0:1782107190.342151:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472424960 00000100:00100000:1.0:1782107190.342155:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472424960 00000100:00100000:1.0:1782107190.342190:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1782107190.342202:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472424960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107190.344604:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472425600:0@lo:400:kworker.0 00000100:00100000:0.0:1782107190.344604:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472425216:0@lo:400:kworker.0 00000100:00100000:2.0:1782107190.344779:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107190.344779:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107190.344821:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107190.344829:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472425344:0@lo:400:kworker.0 00000100:00100000:2.0:1782107190.344831:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782107190.344841:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472425472:0@lo:400:kworker.0 00000100:00100000:0.0:1782107190.344858:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107190.344879:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107190.344904:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472425216 00000100:00100000:0.0:1782107190.344914:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472425216 00000100:00100000:2.0:1782107190.344933:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472425472 00000100:00100000:2.0:1782107190.344939:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472425472 00000100:00100000:0.0:1782107190.344992:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782107190.345002:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472425216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107190.345004:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1782107190.345017:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472425472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107190.345067:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472424960:12345-0@lo:400:kworker.0 Request processed in 2865us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107190.345074:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472425472:12345-0@lo:400:kworker.0 Request processed in 59us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107190.345074:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472425216:12345-0@lo:400:kworker.0 Request processed in 72us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107190.345080:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1782107190.345089:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782107190.345094:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1782107190.345132:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472425472:0@lo:400:kworker.0 00000100:00100000:0.0:1782107190.345139:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec110aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472425216:0@lo:400:kworker.0 00000100:00100000:1.0:1782107190.345141:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472425600 00000100:00100000:1.0:1782107190.345146:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472425600 00000100:00080000:2.0:1782107190.345158:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782107190.345163:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107190.345174:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472425344 00000100:00100000:1.0:1782107190.345177:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472425344 00000100:00100000:2.0:1782107190.345183:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782107190.345189:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472425600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107190.345204:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782107190.345210:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472425344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107190.345229:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472425600:12345-0@lo:400:kworker.0 Request processed in 40us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107190.345236:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782107190.345243:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472425344:12345-0@lo:400:kworker.0 Request processed in 34us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107190.345249:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1782107190.345254:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782107190.345258:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe991d0380 x1868674472425344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107190.345270:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472425344:0@lo:400:kworker.0 00000100:00100000:1.0:1782107190.345291:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472425600:0@lo:400:kworker.0 00000100:00100000:3.0:1782107190.345401:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472424960:0@lo:400:kworker.0 00010000:00010000:0.0:1782107190.528597:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107191.445857:0:15870:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2c needs >= 8 OSTs 00010000:00010000:1.0:1782107191.553097:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107192.387146:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782107192.387639:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472425728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782107192.387708:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107192.391706:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472425728 00000100:00100000:0.0:1782107192.391723:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472425728 00000100:00100000:0.0:1782107192.391797:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782107192.391809:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472425728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107192.391852:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107192.391956:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472425728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107192.391964:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1782107192.392014:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107192.392039:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472425728:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1782107192.507470:0:15918:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2d: setstripe with -N2: multiple identical EC mirrors ========================================================== 01:46:32 (1782107192) 00010000:00010000:2.0:1782107192.577500:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107193.416169:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107193.416192:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472425856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107193.416260:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107193.419095:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472425856 00000100:00100000:2.0:1782107193.419109:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472425856 00000100:00100000:2.0:1782107193.419173:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782107193.419184:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472425856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107193.419221:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107193.419291:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472425856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107193.419320:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1782107193.420388:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebf17f100 x1868674472425856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107193.420411:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472425856:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107193.420445:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782107193.607714:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107193.651968:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107193.652027:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107193.652066:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447211648 00000100:00100000:1.0:1782107193.652075:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447211648 00000100:00100000:1.0:1782107193.652135:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 192 00000100:00100000:1.0:1782107193.652145:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447211648:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107193.652213:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2372:x1868674447211648:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107193.652219:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 192 00000100:00080000:1.0:1782107193.652237:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107193.652590:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447211520 00000100:00100000:0.0:1782107193.652595:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447211520 00000100:00100000:0.0:1782107193.652621:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 283 00000100:00100000:0.0:1782107193.652628:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447211520:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107193.652656:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447211520:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107193.652662:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 283 00000001:02000400:2.0:1782107193.967143:0:15967:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2d needs >= 8 OSTs 00010000:00010000:3.0:1782107194.624699:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107195.026114:0:16015:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2e: setstripe with -N: mixed regular and EC mirrors ========================================================== 01:46:34 (1782107194) 00000100:00100000:1.0:1782107195.456127:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782107195.458077:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472426112:0@lo:400:kworker.0 00000100:00100000:1.0:1782107195.458154:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107195.458324:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472425984:0@lo:400:kworker.0 00000100:00100000:1.0:1782107195.458357:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107195.458604:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472425984 00000100:00100000:3.0:1782107195.458613:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472425984 00000100:00100000:3.0:1782107195.458666:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1782107195.458676:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472425984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107195.458734:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472425984:12345-0@lo:400:kworker.0 Request processed in 60us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107195.458741:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1782107195.458784:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472425984:0@lo:400:kworker.0 00000100:00100000:2.0:1782107195.459116:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472426368:0@lo:400:kworker.0 00000100:00100000:2.0:1782107195.459147:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107195.459170:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782107195.459175:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472426240:0@lo:400:kworker.0 00000100:00100000:3.0:1782107195.459269:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472426496:0@lo:400:kworker.0 00000100:00100000:3.0:1782107195.459308:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472426624:0@lo:400:kworker.0 00000100:00100000:3.0:1782107195.459329:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107195.459357:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472426368 00000100:00100000:3.0:1782107195.459361:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472426368 00000100:00100000:3.0:1782107195.459410:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472426624 00000100:00100000:3.0:1782107195.459414:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472426624 00000100:00100000:3.0:1782107195.459447:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782107195.459454:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472426368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107195.459486:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472426368:12345-0@lo:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107195.459492:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782107195.459504:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782107195.459510:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472426624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107195.459539:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472426624:12345-0@lo:400:kworker.0 Request processed in 29us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107195.459544:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1782107195.459560:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107195.459564:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107195.459588:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472426624:0@lo:400:kworker.0 00000100:00100000:2.0:1782107195.459806:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782107195.460058:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe991d2680 x1868674472426368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107195.460069:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472426368:0@lo:400:kworker.0 00000100:00100000:3.0:1782107195.460162:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107195.460203:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472426112 00000100:00100000:0.0:1782107195.460209:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472426112 00000100:00100000:0.0:1782107195.460252:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472426240 00000100:00100000:0.0:1782107195.460255:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472426240 00000100:00100000:0.0:1782107195.460297:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782107195.460305:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472426112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107195.460352:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472426112:12345-0@lo:400:kworker.0 Request processed in 48us (2198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107195.460359:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782107195.460373:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1782107195.460379:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472426240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107195.460409:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472426240:12345-0@lo:400:kworker.0 Request processed in 30us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107195.460415:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1782107195.460535:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472426240:0@lo:400:kworker.0 00000100:00080000:0.0:1782107195.460559:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107195.460629:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472426112:0@lo:400:kworker.0 00000100:00100000:0.0:1782107195.460757:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472426496 00000100:00100000:0.0:1782107195.460761:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472426496 00000100:00100000:0.0:1782107195.460820:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1782107195.460826:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472426496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107195.461044:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472426496:12345-0@lo:400:kworker.0 Request processed in 217us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107195.461051:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1782107195.461096:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107195.461141:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472426496:0@lo:400:kworker.0 00010000:00010000:3.0:1782107195.651104:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107196.204847:0:16063:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2e needs >= 8 OSTs 00010000:00010000:3.0:1782107196.672441:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107197.509547:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472426752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107197.509622:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107197.510228:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472426752 00000100:00100000:3.0:1782107197.510238:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472426752 00000100:00100000:3.0:1782107197.510335:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782107197.510346:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472426752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107197.510381:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107197.510430:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472426752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107197.510435:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782107197.510488:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472426752:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782107197.510541:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782107197.696333:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107198.292171:0:16111:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 2f: default EC layout on directory using mirror mode ========================================================== 01:46:37 (1782107197) 00000100:00100000:0.0:1782107198.532704:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107198.532730:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472426880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107198.532806:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107198.534400:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472426880 00000100:00100000:2.0:1782107198.534412:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472426880 00000100:00100000:2.0:1782107198.534488:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782107198.534499:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472426880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107198.534536:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782107198.534693:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107198.535102:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472426880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 604us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107198.535111:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1782107198.535311:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebf17ca80 x1868674472426880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107198.535327:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472426880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782107198.720968:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107198.769842:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107198.769890:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107198.770009:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447211776 00000100:00100000:0.0:1782107198.770020:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447211776 00000100:00100000:0.0:1782107198.770085:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 285 00000100:00100000:0.0:1782107198.770097:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447211776:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107198.770175:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447211776:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 81us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107198.770184:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 285 00000100:00100000:2.0:1782107198.771199:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447211904 00000100:00100000:2.0:1782107198.771206:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447211904 00000100:00100000:2.0:1782107198.771298:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 196 00000100:00100000:2.0:1782107198.771308:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447211904:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107198.771438:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447211904:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 132us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107198.771446:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 196 00000100:00080000:0.0:1782107198.772173:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782107199.749394:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107199.862528:0:16159:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_2f needs >= 8 OSTs 00000100:00100000:0.0:1782107200.587065:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472427392:0@lo:400:kworker.0 00000100:00100000:0.0:1782107200.587129:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.587184:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107200.587192:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472427264:0@lo:400:kworker.0 00000100:00100000:0.0:1782107200.587229:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107200.587271:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472427392 00000100:00100000:0.0:1782107200.587279:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472427392 00000100:00100000:0.0:1782107200.587333:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782107200.587342:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472427392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107200.587393:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472427392:12345-0@lo:400:kworker.0 Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107200.587400:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782107200.587419:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472427264 00000100:00100000:0.0:1782107200.587434:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472427264 00000100:00100000:0.0:1782107200.587461:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1782107200.587467:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472427264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107200.587495:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472427264:12345-0@lo:400:kworker.0 Request processed in 29us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107200.587501:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1782107200.587516:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782107200.587520:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782107200.587553:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472427264:0@lo:400:kworker.0 00010000:00080000:0.0:1782107200.587566:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec0d1ed80 x1868674472427392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107200.587576:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472427392:0@lo:400:kworker.0 00000100:00100000:3.0:1782107200.587867:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472427136:0@lo:400:kworker.0 00000100:00100000:3.0:1782107200.587896:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107200.587929:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472427648:0@lo:400:kworker.0 00000100:00100000:3.0:1782107200.587951:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107200.587993:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782107200.588001:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472427008:0@lo:400:kworker.0 00000100:00100000:3.0:1782107200.588028:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107200.588047:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472427520:0@lo:400:kworker.0 00000100:00100000:3.0:1782107200.588067:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107200.588088:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472427648 00000100:00100000:3.0:1782107200.588091:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472427648 00000100:00100000:3.0:1782107200.588118:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782107200.588124:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472427648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107200.588160:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472427648:12345-0@lo:400:kworker.0 Request processed in 36us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107200.588166:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782107200.588191:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472427648:0@lo:400:kworker.0 00000100:00100000:1.0:1782107200.588362:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472427136 00000100:00100000:1.0:1782107200.588367:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472427136 00000100:00100000:1.0:1782107200.588399:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472427520 00000100:00100000:1.0:1782107200.588402:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472427520 00000100:00100000:1.0:1782107200.588424:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1782107200.588431:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472427136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107200.588470:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472427136:12345-0@lo:400:kworker.0 Request processed in 40us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.588485:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1782107200.588498:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782107200.588504:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472427520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107200.588533:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472427520:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.588538:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1782107200.588556:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472427008 00000100:00100000:1.0:1782107200.588559:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472427008 00000100:00100000:1.0:1782107200.588583:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1782107200.588589:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472427008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107200.588616:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472427008:12345-0@lo:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107200.588621:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1782107200.588659:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472427008:0@lo:400:kworker.0 00000100:00100000:1.0:1782107200.588670:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472427520:0@lo:400:kworker.0 00000100:00100000:1.0:1782107200.588678:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472427136:0@lo:400:kworker.0 00000100:00080000:0.0:1782107200.591911:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782107200.591922:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782107200.768499:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107201.799030:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107202.124429:0:16208:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3a: lfs mirror create with single EC mirror ========================================================== 01:46:40 (1782107200) 00000100:00100000:1.0:1782107202.624814:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472427776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107202.624884:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107202.625084:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472427776 00000100:00100000:2.0:1782107202.625092:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472427776 00000100:00100000:2.0:1782107202.625160:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782107202.625170:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472427776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107202.625226:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107202.625274:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472427776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107202.625282:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1782107202.626299:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107202.626341:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472427776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782107202.816372:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107203.540615:0:16256:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3a needs >= 8 OSTs 00000100:00100000:1.0:1782107203.661578:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107203.661599:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472427904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107203.661665:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107203.661720:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472427904 00000100:00100000:1.0:1782107203.661728:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472427904 00000100:00100000:1.0:1782107203.661777:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782107203.661785:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472427904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107203.661828:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107203.661866:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472427904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107203.661873:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1782107203.661891:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782107203.661917:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990a9c00 x1868674472427904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107203.661934:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472427904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782107203.840322:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107203.888760:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107203.888806:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107203.888871:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447212032 00000100:00100000:3.0:1782107203.888881:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447212032 00000100:00100000:3.0:1782107203.888932:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 287 00000100:00100000:3.0:1782107203.888942:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447212032:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1782107203.889039:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447212032:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 98us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107203.889047:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 287 00000100:00100000:2.0:1782107203.889571:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447212160 00000100:00100000:2.0:1782107203.889576:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447212160 00000100:00100000:2.0:1782107203.889627:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 200 00000100:00100000:2.0:1782107203.889635:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447212160:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107203.889678:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447212160:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 44us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107203.889685:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 200 00000100:00080000:1.0:1782107203.890062:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1782107204.734225:0:16304:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3b: lfs mirror create with -N2 and EC == 01:46:44 (1782107204) 00010000:00010000:3.0:1782107204.874566:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107205.698859:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782107205.699782:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782107205.699805:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472428160:0@lo:400:kworker.0 00000100:00100000:0.0:1782107205.699874:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107205.704354:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472428160 00000100:00100000:2.0:1782107205.704371:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472428160 00000100:00100000:2.0:1782107205.704452:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1782107205.704462:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472428160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107205.704557:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472428160:12345-0@lo:400:kworker.0 Request processed in 97us (4683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107205.704564:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1782107205.704614:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472428160:0@lo:400:kworker.0 00000100:00100000:1.0:1782107205.707946:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472428032:0@lo:400:kworker.0 00000100:00100000:1.0:1782107205.708041:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107205.708450:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472428032 00000100:00100000:0.0:1782107205.708461:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472428032 00000100:00100000:0.0:1782107205.708505:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1782107205.708513:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472428032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107205.708558:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472428032:12345-0@lo:400:kworker.0 Request processed in 48us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107205.708563:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1782107205.708632:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107205.708644:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472428288:0@lo:400:kworker.0 00000100:00100000:3.0:1782107205.708692:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107205.708748:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472428416:0@lo:400:kworker.0 00000100:00100000:3.0:1782107205.708777:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107205.708815:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472428544:0@lo:400:kworker.0 00000100:00100000:0.0:1782107205.708841:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472428288 00000100:00100000:3.0:1782107205.708842:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107205.708855:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472428288 00000100:00100000:3.0:1782107205.708875:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472428544 00000100:00100000:3.0:1782107205.708880:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472428544 00000100:00100000:0.0:1782107205.708892:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782107205.708901:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472428288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107205.708915:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782107205.708923:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472428544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107205.708945:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472428288:12345-0@lo:400:kworker.0 Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107205.708951:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1782107205.708967:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472428544:12345-0@lo:400:kworker.0 Request processed in 45us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107205.708969:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472428416 00000100:00100000:0.0:1782107205.708988:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472428416 00000100:00100000:3.0:1782107205.708999:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1782107205.709012:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782107205.709017:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb405b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472428416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107205.709040:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472428544:0@lo:400:kworker.0 00000100:00100000:0.0:1782107205.709043:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb405b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472428416:12345-0@lo:400:kworker.0 Request processed in 25us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107205.709051:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782107205.709086:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107205.709103:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472428672:0@lo:400:kworker.0 00000100:00100000:3.0:1782107205.709132:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107205.709170:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472428672 00000100:00100000:3.0:1782107205.709176:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472428672 00000100:00100000:3.0:1782107205.709217:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782107205.709226:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472428672:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1782107205.709278:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebf17c700 x1868674472428416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107205.709288:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472428416:0@lo:400:kworker.0 00000100:00100000:0.0:1782107205.709298:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472428288:0@lo:400:kworker.0 00000100:00080000:1.0:1782107205.709367:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107205.709371:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782107205.709374:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107205.709397:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472428032:0@lo:400:kworker.0 00000100:00100000:3.0:1782107205.709640:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472428672:12345-0@lo:400:kworker.0 Request processed in 39us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107205.709649:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782107205.709683:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472428672:0@lo:400:kworker.0 00010000:00010000:1.0:1782107205.892512:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107206.162360:0:16352:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3b needs >= 8 OSTs 00010000:00010000:3.0:1782107206.914880:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107207.744572:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107207.744596:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472428800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107207.744660:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107207.744716:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472428800 00000100:00100000:0.0:1782107207.744724:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472428800 00000100:00100000:0.0:1782107207.744779:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782107207.744789:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472428800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107207.744822:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107207.744884:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472428800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107207.744892:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1782107207.744914:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107207.744949:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472428800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107207.939744:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107208.416061:0:16401:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3c: lfs mirror create with mixed EC and regular mirrors ========================================================== 01:46:46 (1782107206) 00000100:00100000:0.0:1782107208.768223:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472428928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107208.768321:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107208.769818:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472428928 00000100:00100000:2.0:1782107208.770337:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472428928 00000100:00100000:2.0:1782107208.770576:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782107208.770589:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472428928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107208.771059:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107208.771256:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472428928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 670us (2936us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107208.771274:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1782107208.771426:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef4df80 x1868674472428928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107208.771492:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472428928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782107208.771620:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782107208.960676:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107209.009937:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107209.010184:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107209.010295:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447212416 00000100:00100000:0.0:1782107209.010305:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447212416 00000100:00100000:0.0:1782107209.010383:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 204 00000100:00080000:3.0:1782107209.010407:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107209.010466:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447212416:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107209.010545:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447212416:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 154us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107209.010552:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 204 00000100:00100000:2.0:1782107209.016242:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447212288 00000100:00100000:2.0:1782107209.016259:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447212288 00000100:00100000:2.0:1782107209.016332:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 289 00000100:00100000:2.0:1782107209.016346:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447212288:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107209.016425:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447212288:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 83us (6241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107209.016433:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 289 00010000:00010000:0.0:1782107209.984205:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107210.115063:0:16450:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3c needs >= 8 OSTs 00000100:00100000:0.0:1782107210.816539:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472429056:0@lo:400:kworker.0 00000100:00100000:0.0:1782107210.816635:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107210.816710:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472429568:0@lo:400:kworker.0 00000100:00100000:0.0:1782107210.816740:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107210.816779:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782107210.816785:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472429184:0@lo:400:kworker.0 00000100:00100000:0.0:1782107210.816809:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107210.816824:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472429696:0@lo:400:kworker.0 00000100:00100000:0.0:1782107210.816882:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107210.816926:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472429568 00000100:00100000:0.0:1782107210.816934:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472429568 00000100:00100000:0.0:1782107210.817026:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472429184 00000100:00100000:0.0:1782107210.817029:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472429184 00000100:00100000:0.0:1782107210.817055:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1782107210.817063:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472429568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107210.817127:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472429568:12345-0@lo:400:kworker.0 Request processed in 59us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107210.817134:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1782107210.817163:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1782107210.817169:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472429184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107210.817193:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472429184:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107210.817199:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1782107210.817217:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472429696 00000100:00100000:0.0:1782107210.817220:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472429696 00000100:00100000:0.0:1782107210.817273:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782107210.817279:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472429696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107210.817305:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472429696:12345-0@lo:400:kworker.0 Request processed in 27us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107210.817310:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782107210.817410:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472429184:0@lo:400:kworker.0 00000100:00100000:0.0:1782107210.817420:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472429696:0@lo:400:kworker.0 00000100:00100000:0.0:1782107210.817427:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472429568:0@lo:400:kworker.0 00000100:00100000:1.0:1782107210.817847:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472429440:0@lo:400:kworker.0 00000100:00100000:1.0:1782107210.817900:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107210.817936:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107210.817942:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472429312:0@lo:400:kworker.0 00000100:00100000:1.0:1782107210.817968:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107210.818030:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472429440 00000100:00100000:1.0:1782107210.818049:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472429440 00000100:00100000:1.0:1782107210.818076:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1782107210.818083:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472429440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107210.818131:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472429440:12345-0@lo:400:kworker.0 Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107210.818138:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1782107210.818195:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebf17d880 x1868674472429440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107210.818207:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472429440:0@lo:400:kworker.0 00000100:00100000:1.0:1782107210.818226:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472429312 00000100:00100000:1.0:1782107210.818229:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472429312 00000100:00100000:1.0:1782107210.818268:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1782107210.818275:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472429312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107210.818312:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472429312:12345-0@lo:400:kworker.0 Request processed in 37us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107210.818332:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1782107210.818371:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472429312:0@lo:400:kworker.0 00000100:00100000:3.0:1782107210.819204:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472429056 00000100:00100000:3.0:1782107210.819209:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472429056 00000100:00100000:3.0:1782107210.819252:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1782107210.819267:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472429056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107210.819346:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472429056:12345-0@lo:400:kworker.0 Request processed in 80us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107210.819353:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:3.0:1782107210.819388:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107210.819393:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107210.819395:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107210.823590:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472429056:0@lo:400:kworker.0 00010000:00010000:3.0:1782107211.010871:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107212.036907:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107212.333004:0:16498:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3d: lfs mirror create with different EC configs per mirror ========================================================== 01:46:51 (1782107211) 00000100:00100000:1.0:1782107212.864345:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107212.864609:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472429824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107212.864824:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107212.878358:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472429824 00000100:00100000:0.0:1782107212.878373:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472429824 00000100:00100000:0.0:1782107212.878477:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782107212.878490:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472429824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107212.878538:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107212.878631:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472429824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (13808us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107212.878639:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782107212.878792:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472429824:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107212.878864:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782107213.062067:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107213.765041:0:16546:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3d needs >= 8 OSTs 00000100:00100000:1.0:1782107213.888282:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107213.888307:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472429952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107213.888384:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107213.896761:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472429952 00000100:00100000:0.0:1782107213.896779:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472429952 00000100:00100000:0.0:1782107213.896873:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782107213.896884:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472429952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107213.896922:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107213.897026:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472429952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (8641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107213.897033:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1782107213.897057:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef4ea00 x1868674472429952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107213.897080:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472429952:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782107213.901422:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782107214.080344:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107214.132199:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107214.132247:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107214.132343:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447212544 00000100:00100000:0.0:1782107214.132355:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447212544 00000100:00100000:0.0:1782107214.132413:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 291 00000100:00100000:0.0:1782107214.132423:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447212544:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107214.132497:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447212544:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 75us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107214.132505:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 291 00000100:00100000:2.0:1782107214.132734:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447212672 00000100:00100000:2.0:1782107214.132740:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447212672 00000100:00100000:2.0:1782107214.132796:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 208 00000100:00100000:2.0:1782107214.132804:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447212672:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107214.132852:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447212672:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 48us (603us total) trans 0 rc 0/0 00000100:00080000:3.0:1782107214.132897:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107214.133066:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 208 00010000:00010000:1.0:1782107215.105398:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107215.492892:0:16595:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3e: lfs mirror create with multiple EC specs in one mirror ========================================================== 01:46:54 (1782107214) 00000100:00100000:1.0:1782107215.936355:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472430464:0@lo:400:kworker.0 00000100:00100000:0.0:1782107215.936407:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472430080:0@lo:400:kworker.0 00000100:00100000:1.0:1782107215.936424:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107215.936496:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472430336:0@lo:400:kworker.0 00000100:00100000:3.0:1782107215.936542:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472430208:0@lo:400:kworker.0 00000100:00100000:1.0:1782107215.936648:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472430464 00000100:00100000:1.0:1782107215.936656:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472430464 00000100:00100000:1.0:1782107215.936714:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782107215.936724:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472430464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107215.936778:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472430464:12345-0@lo:400:kworker.0 Request processed in 55us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107215.936795:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1782107215.936837:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef4ea00 x1868674472430464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107215.937087:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472430464:0@lo:400:kworker.0 00000100:00100000:0.0:1782107215.937333:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107215.937484:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472430080 00000100:00100000:1.0:1782107215.937490:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472430080 00000100:00100000:1.0:1782107215.937527:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1782107215.937535:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472430080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107215.937717:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472430080:12345-0@lo:400:kworker.0 Request processed in 182us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107215.937725:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1782107215.937771:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472430080:0@lo:400:kworker.0 00000100:00100000:1.0:1782107215.937781:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472430592:0@lo:400:kworker.0 00000100:00100000:1.0:1782107215.937881:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107215.937920:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472430592 00000100:00100000:1.0:1782107215.937924:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472430592 00000100:00100000:1.0:1782107215.938068:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1782107215.938078:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472430592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107215.938129:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472430592:12345-0@lo:400:kworker.0 Request processed in 53us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107215.938135:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1782107215.938157:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472430592:0@lo:400:kworker.0 00000100:00080000:1.0:1782107215.938184:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782107215.938188:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782107215.942108:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107215.942542:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472430336 00000100:00100000:0.0:1782107215.942552:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472430336 00000100:00100000:0.0:1782107215.942633:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1782107215.942643:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472430336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107215.942711:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472430336:12345-0@lo:400:kworker.0 Request processed in 69us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107215.942719:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1782107215.942760:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472430336:0@lo:400:kworker.0 00000100:00080000:2.0:1782107215.942835:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107215.944040:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107215.944084:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472430720:0@lo:400:kworker.0 00000100:00100000:3.0:1782107215.944126:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107215.944238:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472430208 00000100:00100000:1.0:1782107215.944244:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472430208 00000100:00100000:1.0:1782107215.944290:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782107215.944299:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472430208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107215.944416:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472430720 00000100:00100000:0.0:1782107215.944421:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472430720 00000100:00100000:0.0:1782107215.944457:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782107215.944463:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472430720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107215.944517:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472430208:12345-0@lo:400:kworker.0 Request processed in 218us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107215.944524:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:3.0:1782107215.944808:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107215.944859:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472430720:12345-0@lo:400:kworker.0 Request processed in 388us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107215.944866:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782107215.948615:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472430208:0@lo:400:kworker.0 00000100:00100000:2.0:1782107215.948634:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472430720:0@lo:400:kworker.0 00010000:00010000:3.0:1782107216.132254:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107217.156205:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107217.230437:0:16643:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3e needs >= 8 OSTs 00000100:00100000:2.0:1782107217.986607:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782107217.986637:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472430848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782107217.986723:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107217.986861:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472430848 00000100:00100000:3.0:1782107217.986870:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472430848 00000100:00100000:3.0:1782107217.986935:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782107217.986944:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472430848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107217.987005:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107217.987055:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472430848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107217.987063:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782107217.987137:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472430848:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782107217.987650:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782107218.176231:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107219.009496:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107219.009519:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472430976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107219.009587:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107219.010125:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472430976 00000100:00100000:0.0:1782107219.010135:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472430976 00000100:00100000:0.0:1782107219.010201:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782107219.010210:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472430976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782107219.010246:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107219.010298:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472430976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107219.010306:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1782107219.010362:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebf17ca80 x1868674472430976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107219.010394:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472430976:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107219.010495:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1782107219.055550:0:16691:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3f: EC inheritance with holes ========== 01:46:57 (1782107217) 00010000:00010000:3.0:1782107219.206819:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107219.250138:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107219.250185:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107219.250435:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447212928 00000100:00100000:0.0:1782107219.250446:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447212928 00000100:00100000:0.0:1782107219.250517:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 212 00000100:00100000:0.0:1782107219.250526:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447212928:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107219.250596:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2370:x1868674447212928:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 71us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107219.250602:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 212 00000100:00100000:2.0:1782107219.250760:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447212800 00000100:00100000:2.0:1782107219.250765:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447212800 00000100:00100000:2.0:1782107219.250798:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 293 00000100:00100000:2.0:1782107219.250805:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447212800:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107219.250837:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447212800:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107219.250843:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 293 00000100:00080000:3.0:1782107219.251378:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782107220.224135:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107220.782578:0:16739:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3f needs >= 8 OSTs 00000100:00100000:0.0:1782107221.056691:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472431360:0@lo:400:kworker.0 00000100:00100000:0.0:1782107221.056765:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107221.056820:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107221.056827:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472431488:0@lo:400:kworker.0 00000100:00100000:0.0:1782107221.056854:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107221.057040:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472431104:0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057085:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107221.057109:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472431616:0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057127:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107221.057142:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782107221.057147:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472431232:0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057163:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107221.057175:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf7bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472431744:0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057191:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107221.057215:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472431360 00000100:00100000:1.0:1782107221.057222:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472431360 00000100:00100000:1.0:1782107221.057272:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472431616 00000100:00100000:1.0:1782107221.057275:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472431616 00000100:00100000:1.0:1782107221.057289:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472431232 00000100:00100000:1.0:1782107221.057291:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472431232 00000100:00100000:1.0:1782107221.057319:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1782107221.057327:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472431360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057377:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472431360:12345-0@lo:400:kworker.0 Request processed in 51us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107221.057384:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1782107221.057402:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1782107221.057408:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472431616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057441:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472431616:12345-0@lo:400:kworker.0 Request processed in 34us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107221.057447:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1782107221.057457:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1782107221.057463:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472431232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057487:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472431232:12345-0@lo:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107221.057492:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1782107221.057508:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472431104 00000100:00100000:1.0:1782107221.057511:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472431104 00000100:00100000:1.0:1782107221.057535:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1782107221.057540:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472431104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057565:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472431104:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107221.057571:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1782107221.057601:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472431488 00000100:00100000:1.0:1782107221.057605:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472431488 00000100:00100000:1.0:1782107221.057628:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472431744 00000100:00100000:1.0:1782107221.057631:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472431744 00000100:00100000:1.0:1782107221.057648:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782107221.057661:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472431488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057690:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472431488:12345-0@lo:400:kworker.0 Request processed in 31us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107221.057696:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782107221.057706:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782107221.057711:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472431744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057736:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472431744:12345-0@lo:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107221.057741:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1782107221.057756:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782107221.057759:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782107221.057762:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782107221.057790:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec0d1df80 x1868674472431488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107221.057803:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472431488:0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057813:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472431360:0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057850:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472431232:0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057859:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf7bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472431744:0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057866:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472431104:0@lo:400:kworker.0 00000100:00100000:1.0:1782107221.057874:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472431616:0@lo:400:kworker.0 00010000:00010000:1.0:1782107221.248402:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107222.274897:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107222.531775:0:16788:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 3g: EC parity mirror inherits pool from data mirror ========================================================== 01:47:01 (1782107221) 00000100:00100000:2.0:1782107223.105731:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782107223.105755:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472431872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782107223.105822:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107223.105947:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472431872 00000100:00100000:0.0:1782107223.105955:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472431872 00000100:00100000:0.0:1782107223.106052:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782107223.106070:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472431872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107223.106104:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107223.106147:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472431872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107223.106155:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782107223.106201:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472431872:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107223.106352:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782107223.297485:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107224.129990:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472432000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107224.130131:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107224.130321:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472432000 00000100:00100000:1.0:1782107224.130329:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472432000 00000100:00100000:1.0:1782107224.130385:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1782107224.130396:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472432000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107224.130431:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107224.130473:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472432000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107224.130481:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1782107224.130500:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782107224.130530:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef3d180 x1868674472432000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107224.130547:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472432000:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1782107224.153862:0:16836:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_3g needs >= 6 OSTs 00010000:00010000:1.0:1782107224.327446:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107224.368244:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107224.368290:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107224.368368:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447213184 00000100:00100000:2.0:1782107224.368378:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447213184 00000100:00100000:2.0:1782107224.368431:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 216 00000100:00100000:2.0:1782107224.368438:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447213184:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107224.368506:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2371:x1868674447213184:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107224.368524:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 216 00000100:00080000:3.0:1782107224.368964:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107224.371038:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447213056 00000100:00100000:0.0:1782107224.371049:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447213056 00000100:00100000:0.0:1782107224.371096:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 295 00000100:00100000:0.0:1782107224.371105:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447213056:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107224.371164:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447213056:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 60us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107224.371172:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 295 00010000:00010000:3.0:1782107225.354400:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107225.446433:0:16884:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4a: reject invalid EC parameters: parity > data ========================================================== 01:47:04 (1782107224) 00000100:00100000:0.0:1782107225.582253:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107225.582342:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447213312 00000100:00100000:1.0:1782107225.582353:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447213312 00000100:00100000:1.0:1782107225.583798:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:1.0:1782107225.583817:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+5:19165:x1868674447213312:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:1.0:1782107225.583839:0:7463:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107225.583864:0:7463:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608726 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.583926:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7befc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.583940:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7befc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.583953:0:7463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7befc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782107225.584163:0:7463:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782107225.584167:0:7463:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782107225.584256:0:7463:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7befc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7463 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.584283:0:7463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608726 expref: 7 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.584299:0:7463:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7befc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608726 expref: 6 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.584308:0:7463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:1.0:1782107225.584312:0:7463:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782107225.584315:0:7463:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe81407a00, rc 0) 00000100:00100000:1.0:1782107225.584374:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+6:19165:x1868674447213312:12345-192.168.202.26@tcp:101:bash.0 Request processed in 566us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107225.584382:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:0.0:1782107225.600830:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107225.608209:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447213440 00000100:00100000:1.0:1782107225.608226:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447213440 00000100:00100000:1.0:1782107225.608279:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:1.0:1782107225.608290:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:19165:x1868674447213440:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:1.0:1782107225.608308:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782107225.608325:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bf03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec60872d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608385:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608411:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608423:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608478:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608487:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608493:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608723:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608730:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608736:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608742:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe81406e00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:1.0:1782107225.608746:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608753:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608765:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:1.0:1782107225.608776:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107225.608782:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608788:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406e00/0xc2d453a189c7bf0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608799:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608805:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608811:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608816:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe81406c00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:1.0:1782107225.608819:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608824:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608832:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe4042ea3 (ffff8abe84d6ac00) 00010000:00010000:1.0:1782107225.608835:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107225.608837:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608842:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81406c00/0xc2d453a189c7bf11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe4042ea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608871:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bf03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60872d expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608893:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:1.0:1782107225.608895:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782107225.608899:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407000/0xc2d453a189c7bf03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60872d expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107225.608908:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe81407000, rc 0) 00000100:00100000:1.0:1782107225.608999:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:19165:x1868674447213440:12345-192.168.202.26@tcp:101:bash.0 Request processed in 710us (8173us total) trans 0 rc 301/301 00000100:00100000:1.0:1782107225.609007:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:2.0:1782107226.180525:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472432128:0@lo:400:kworker.0 00000100:00100000:2.0:1782107226.180606:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107226.180688:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472432128 00000100:00100000:1.0:1782107226.180696:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472432128 00000100:00100000:1.0:1782107226.180744:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1782107226.180753:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe869d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472432128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107226.185737:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe869d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472432128:12345-0@lo:400:kworker.0 Request processed in 4976us (5121us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107226.185750:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1782107226.187408:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472432128:0@lo:400:kworker.0 00000100:00100000:2.0:1782107226.187438:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782107226.187460:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472432256:0@lo:400:kworker.0 00000100:00100000:2.0:1782107226.187517:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107226.187795:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472432256 00000100:00100000:1.0:1782107226.187802:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472432256 00000100:00100000:1.0:1782107226.187848:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1782107226.187857:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472432256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107226.187912:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472432256:12345-0@lo:400:kworker.0 Request processed in 56us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107226.187919:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1782107226.188023:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472432256:0@lo:400:kworker.0 00000100:00100000:3.0:1782107226.188761:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472432512:0@lo:400:kworker.0 00000100:00100000:3.0:1782107226.188800:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107226.188824:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107226.188830:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472432384:0@lo:400:kworker.0 00000100:00100000:3.0:1782107226.188853:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107226.188879:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472432512 00000100:00100000:3.0:1782107226.188883:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472432512 00000100:00100000:3.0:1782107226.188922:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782107226.188929:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472432512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107226.188965:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472432512:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107226.188993:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782107226.189022:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472432384 00000100:00100000:3.0:1782107226.189026:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472432384 00000100:00100000:3.0:1782107226.189049:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1782107226.189056:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472432384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107226.189085:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472432384:12345-0@lo:400:kworker.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107226.189091:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:3.0:1782107226.189107:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782107226.189111:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107226.189135:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472432384:0@lo:400:kworker.0 00010000:00080000:3.0:1782107226.189146:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebf17f480 x1868674472432512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107226.189169:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472432512:0@lo:400:kworker.0 00000100:00100000:2.0:1782107226.189397:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472432640:0@lo:400:kworker.0 00000100:00100000:2.0:1782107226.189424:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107226.189460:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782107226.189465:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472432768:0@lo:400:kworker.0 00000100:00100000:2.0:1782107226.189488:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107226.189517:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472432768 00000100:00100000:2.0:1782107226.189521:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472432768 00000100:00100000:2.0:1782107226.189552:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1782107226.189559:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472432768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107226.189715:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472432640 00000100:00100000:1.0:1782107226.189720:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472432640 00000100:00100000:1.0:1782107226.189753:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1782107226.189759:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472432640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107226.189795:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472432768:12345-0@lo:400:kworker.0 Request processed in 237us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107226.189802:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1782107226.189823:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782107226.189826:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782107226.189843:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472432768:0@lo:400:kworker.0 00000100:00100000:1.0:1782107226.195068:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472432640:12345-0@lo:400:kworker.0 Request processed in 5302us (5636us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107226.195081:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1782107226.197576:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebf17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472432640:0@lo:400:kworker.0 00010000:00010000:0.0:1782107226.369115:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107227.399313:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107228.224142:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe99075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472432896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107228.224229:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107228.224447:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472432896 00000100:00100000:2.0:1782107228.224467:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472432896 00000100:00080000:3.0:1782107228.224528:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782107228.224548:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782107228.224559:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472432896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107228.224599:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107228.224768:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472432896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 211us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107228.224775:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1782107228.224844:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe99075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472432896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107228.416217:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107229.248932:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107229.248958:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472433024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107229.249057:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107229.249129:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472433024 00000100:00100000:1.0:1782107229.249137:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472433024 00000100:00100000:1.0:1782107229.249204:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782107229.249215:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472433024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107229.249252:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107229.249306:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472433024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107229.249313:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1782107229.249356:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef3ed80 x1868674472433024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107229.249375:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472433024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782107229.249514:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782107229.440421:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107229.487699:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107229.487739:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107229.487800:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447213696 00000100:00100000:2.0:1782107229.487818:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447213696 00000100:00100000:2.0:1782107229.487894:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 220 00000100:00100000:2.0:1782107229.487905:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2371:x1868674447213696:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107229.488004:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2371:x1868674447213696:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 101us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107229.488012:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 220 00000100:00080000:3.0:1782107229.488334:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107229.489095:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447213568 00000100:00100000:0.0:1782107229.489101:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447213568 00000100:00100000:0.0:1782107229.489136:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 297 00000100:00100000:0.0:1782107229.489143:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447213568:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107229.489198:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447213568:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 55us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107229.489204:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 297 00010000:00010000:1.0:1782107230.466281:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107231.296352:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472433152:0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.296432:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107231.296492:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472433664:0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.296520:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107231.296550:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782107231.296556:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472433280:0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.296577:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107231.296591:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472433792:0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.296613:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107231.296644:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472433664 00000100:00100000:3.0:1782107231.296651:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472433664 00000100:00100000:3.0:1782107231.296704:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472433280 00000100:00100000:3.0:1782107231.296708:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472433280 00000100:00100000:3.0:1782107231.296731:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782107231.296740:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472433664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.296791:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472433664:12345-0@lo:400:kworker.0 Request processed in 52us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107231.296813:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782107231.296830:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1782107231.296837:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe85a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472433280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.296865:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe85a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472433280:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107231.296870:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1782107231.296888:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472433792 00000100:00100000:3.0:1782107231.296891:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472433792 00000100:00100000:3.0:1782107231.296916:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782107231.296921:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472433792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.296944:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472433792:12345-0@lo:400:kworker.0 Request processed in 24us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107231.296950:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1782107231.296992:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107231.296997:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782107231.297033:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472433280:0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.297043:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472433792:0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.297051:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472433664:0@lo:400:kworker.0 00000100:00100000:1.0:1782107231.297143:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472433152 00000100:00100000:1.0:1782107231.297148:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472433152 00000100:00100000:1.0:1782107231.297175:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782107231.297182:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472433152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107231.297233:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472433152:12345-0@lo:400:kworker.0 Request processed in 52us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107231.297245:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782107231.297281:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472433152:0@lo:400:kworker.0 00000100:00100000:0.0:1782107231.297565:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472433408:0@lo:400:kworker.0 00000100:00100000:0.0:1782107231.297597:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107231.297625:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782107231.297638:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472433536:0@lo:400:kworker.0 00000100:00100000:0.0:1782107231.297663:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107231.297732:0:6576:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472433536 00000100:00100000:1.0:1782107231.297735:0:6576:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472433536 00000100:00100000:1.0:1782107231.297779:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1782107231.297786:0:6576:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472433536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107231.297820:0:6576:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472433536:12345-0@lo:400:kworker.0 Request processed in 36us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107231.297826:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1782107231.297876:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782107231.297896:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef3ca80 x1868674472433536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107231.297906:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472433536:0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.298472:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472433408 00000100:00100000:3.0:1782107231.298477:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472433408 00000100:00100000:3.0:1782107231.298519:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1782107231.298526:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472433408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107231.298563:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472433408:12345-0@lo:400:kworker.0 Request processed in 39us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107231.298569:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1782107231.298626:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107231.298647:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472433408:0@lo:400:kworker.0 00010000:00010000:3.0:1782107231.490544:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107232.272595:0:17079:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4b: reject invalid EC parameters: data count < 2 ========================================================== 01:47:11 (1782107231) 00010000:00010000:3.0:1782107232.512505:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107232.533298:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107232.533434:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447213824 00000100:00100000:3.0:1782107232.533443:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447213824 00000100:00100000:3.0:1782107232.533506:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00100000:3.0:1782107232.533516:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:19739:x1868674447213824:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1782107232.533545:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782107232.533565:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7bf18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608734 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.533631:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.533645:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.533654:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.533668:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.533674:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.533681:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534238:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534259:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534272:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534278:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f5200 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107232.534283:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534290:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534302:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:3.0:1782107232.534305:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107232.534310:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534316:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f5200/0xc2d453a189c7bf1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534326:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534332:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534337:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534342:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec16f4a00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107232.534344:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534360:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534367:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91f44901 (ffff8abe86b54a00) 00010000:00010000:3.0:1782107232.534370:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107232.534372:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534378:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4a00/0xc2d453a189c7bf26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91f44901 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534408:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7bf18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608734 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534417:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:3.0:1782107232.534420:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107232.534423:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec16f4600/0xc2d453a189c7bf18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608734 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107232.534431:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec16f4600, rc 0) 00000100:00100000:3.0:1782107232.534496:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:19739:x1868674447213824:12345-192.168.202.26@tcp:101:bash.0 Request processed in 982us (1206us total) trans 0 rc 301/301 00000100:00100000:3.0:1782107232.534503:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00080000:0.0:1782107232.535455:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107233.347681:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107233.347715:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe99077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472433920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107233.347796:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107233.348071:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472433920 00000100:00100000:0.0:1782107233.348080:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472433920 00000100:00100000:0.0:1782107233.348156:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782107233.348166:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472433920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107233.348203:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107233.348268:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472433920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107233.348276:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782107233.348321:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe99077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472433920:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107233.348396:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782107233.548326:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107234.382477:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782107234.382499:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe991d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472434048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107234.382564:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107234.382622:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472434048 00000100:00100000:2.0:1782107234.382628:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472434048 00000100:00100000:2.0:1782107234.382680:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782107234.382689:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472434048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107234.382725:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107234.382766:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472434048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107234.382773:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1782107234.382793:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782107234.382832:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe991d3480 x1868674472434048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107234.382857:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe991d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472434048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782107234.565327:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107234.612519:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107234.612569:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107234.612671:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447213952 00000100:00100000:1.0:1782107234.612680:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447213952 00000100:00100000:1.0:1782107234.612733:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 299 00000100:00100000:1.0:1782107234.612743:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447213952:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107234.612811:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2370:x1868674447213952:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107234.612818:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 299 00000100:00100000:2.0:1782107234.613007:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447214080 00000100:00100000:2.0:1782107234.613012:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447214080 00000100:00100000:2.0:1782107234.613060:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 224 00000100:00100000:2.0:1782107234.613081:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2370:x1868674447214080:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107234.613120:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2370:x1868674447214080:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 54us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107234.613126:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 224 00000100:00080000:3.0:1782107234.613271:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782107235.584356:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107236.416440:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472434560:0@lo:400:kworker.0 00000100:00100000:1.0:1782107236.416506:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107236.416562:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107236.416568:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472434432:0@lo:400:kworker.0 00000100:00100000:1.0:1782107236.416598:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107236.417507:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472434304:0@lo:400:kworker.0 00000100:00100000:2.0:1782107236.417543:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107236.417576:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472434816:0@lo:400:kworker.0 00000100:00100000:2.0:1782107236.417596:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107236.417616:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782107236.417621:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472434176:0@lo:400:kworker.0 00000100:00100000:2.0:1782107236.417644:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107236.417659:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472434688:0@lo:400:kworker.0 00000100:00100000:2.0:1782107236.417687:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107236.417717:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472434432 00000100:00100000:2.0:1782107236.417734:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472434432 00000100:00100000:2.0:1782107236.417779:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472434304 00000100:00100000:2.0:1782107236.417781:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472434304 00000100:00100000:2.0:1782107236.417810:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472434688 00000100:00100000:2.0:1782107236.417812:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472434688 00000100:00100000:2.0:1782107236.417828:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1782107236.417843:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472434432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107236.417893:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472434432:12345-0@lo:400:kworker.0 Request processed in 50us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107236.417899:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1782107236.417926:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1782107236.417932:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472434304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107236.417960:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472434304:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107236.417966:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1782107236.418003:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1782107236.418010:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472434688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107236.418035:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472434688:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107236.418041:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1782107236.418075:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472434432:0@lo:400:kworker.0 00000100:00100000:2.0:1782107236.418098:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472434688:0@lo:400:kworker.0 00000100:00100000:2.0:1782107236.418106:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472434304:0@lo:400:kworker.0 00000100:00100000:3.0:1782107236.418923:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472434560 00000100:00100000:3.0:1782107236.418930:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472434560 00000100:00100000:3.0:1782107236.418995:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472434816 00000100:00100000:3.0:1782107236.418999:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472434816 00000100:00100000:3.0:1782107236.419026:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1782107236.419034:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472434560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107236.419081:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472434560:12345-0@lo:400:kworker.0 Request processed in 49us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107236.419087:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1782107236.419099:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782107236.419104:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe991d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472434816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107236.419146:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe991d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472434816:12345-0@lo:400:kworker.0 Request processed in 42us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107236.419152:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782107236.419175:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472434176 00000100:00100000:3.0:1782107236.419178:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472434176 00000100:00100000:3.0:1782107236.419201:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1782107236.419206:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107236.419234:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472434176:12345-0@lo:400:kworker.0 Request processed in 27us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107236.419239:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:3.0:1782107236.419262:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107236.419266:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107236.419268:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782107236.419296:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef3df80 x1868674472434560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107236.419309:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472434560:0@lo:400:kworker.0 00000100:00100000:3.0:1782107236.419345:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472434176:0@lo:400:kworker.0 00000100:00100000:3.0:1782107236.419356:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472434816:0@lo:400:kworker.0 00010000:00010000:3.0:1782107236.615894:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107237.653173:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107238.464272:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782107238.464294:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe99077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472434944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782107238.464359:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107238.464497:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472434944 00000100:00100000:1.0:1782107238.464505:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472434944 00000100:00100000:1.0:1782107238.464570:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782107238.464581:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472434944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782107238.464614:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107238.464659:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472434944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107238.464666:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782107238.464706:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe99077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472434944:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782107238.464856:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782107238.657522:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107239.500733:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782107239.500756:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472435072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782107239.500819:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107239.500893:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472435072 00000100:00100000:1.0:1782107239.500901:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472435072 00000100:00100000:1.0:1782107239.500955:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782107239.500964:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472435072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107239.501019:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107239.501060:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472435072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107239.501068:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1782107239.501098:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782107239.501128:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec0d1d180 x1868674472435072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107239.501144:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472435072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782107239.680166:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107239.750670:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107239.750714:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107239.750807:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447214208 00000100:00100000:1.0:1782107239.750827:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447214208 00000100:00100000:1.0:1782107239.750881:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 301 00000100:00100000:1.0:1782107239.750901:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447214208:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107239.750967:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447214208:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107239.750995:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 301 00000100:00100000:2.0:1782107239.751412:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447214336 00000100:00100000:2.0:1782107239.751417:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447214336 00000100:00100000:2.0:1782107239.751478:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 228 00000100:00100000:2.0:1782107239.751488:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2372:x1868674447214336:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107239.751525:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2372:x1868674447214336:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 40us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107239.751544:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 228 00000100:00080000:1.0:1782107239.757018:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782107240.706862:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107241.537899:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782107241.547886:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472435328:0@lo:400:kworker.0 00000100:00100000:0.0:1782107241.547966:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107241.548321:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472435200:0@lo:400:kworker.0 00000100:00100000:0.0:1782107241.548367:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107241.549152:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472435200 00000100:00100000:1.0:1782107241.549172:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472435200 00000100:00100000:1.0:1782107241.549225:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1782107241.549234:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472435200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107241.549300:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472435200:12345-0@lo:400:kworker.0 Request processed in 67us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107241.549306:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1782107241.549355:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472435200:0@lo:400:kworker.0 00000100:00100000:3.0:1782107241.549825:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472435328 00000100:00100000:3.0:1782107241.549836:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472435328 00000100:00100000:3.0:1782107241.549884:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1782107241.549892:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472435328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107241.549952:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472435328:12345-0@lo:400:kworker.0 Request processed in 61us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107241.549959:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1782107241.550336:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472435328:0@lo:400:kworker.0 00000100:00100000:1.0:1782107241.557384:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472435456:0@lo:400:kworker.0 00000100:00100000:1.0:1782107241.557467:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107241.557580:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472435456 00000100:00100000:3.0:1782107241.557589:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472435456 00000100:00100000:3.0:1782107241.557668:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1782107241.557678:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472435456:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782107241.559954:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107241.561424:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472435584:0@lo:400:kworker.0 00000100:00100000:0.0:1782107241.561499:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107241.561586:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472435584 00000100:00100000:0.0:1782107241.561594:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472435584 00000100:00100000:0.0:1782107241.561656:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782107241.561665:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472435584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107241.561723:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472435584:12345-0@lo:400:kworker.0 Request processed in 48us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107241.561730:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1782107241.561749:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782107241.561775:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abebef24700 x1868674472435584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107241.561789:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472435584:0@lo:400:kworker.0 00000100:00100000:3.0:1782107241.568193:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472435456:12345-0@lo:400:kworker.0 Request processed in 10506us (10715us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107241.568208:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782107241.576328:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472435456:0@lo:400:kworker.0 00000100:00100000:0.0:1782107241.580430:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472435840:0@lo:400:kworker.0 00000100:00100000:0.0:1782107241.580521:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107241.580582:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782107241.580590:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472435712:0@lo:400:kworker.0 00000100:00100000:0.0:1782107241.580617:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107241.580792:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472435712 00000100:00100000:3.0:1782107241.580800:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472435712 00000100:00100000:2.0:1782107241.580904:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472435840 00000100:00100000:2.0:1782107241.580908:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472435840 00000100:00100000:3.0:1782107241.580992:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1782107241.581003:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472435712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107241.581084:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472435712:12345-0@lo:400:kworker.0 Request processed in 83us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107241.581091:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1782107241.581129:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472435712:0@lo:400:kworker.0 00000100:00080000:0.0:1782107241.589082:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782107241.589094:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107241.590414:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782107241.590430:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe99077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472435840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107241.590788:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe99077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472435840:12345-0@lo:400:kworker.0 Request processed in 358us (10261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107241.590799:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1782107241.596697:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472435840:0@lo:400:kworker.0 00010000:00010000:0.0:1782107241.741181:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107242.752139:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782107243.287308:0:17274:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4c: reject invalid EC parameters: parity = 0 ========================================================== 01:47:21 (1782107241) 00000100:00100000:2.0:1782107243.503698:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107243.506597:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447214464 00000100:00100000:0.0:1782107243.506613:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447214464 00000100:00100000:2.0:1782107243.506764:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:2.0:1782107243.506775:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:20315:x1868674447214464:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1782107243.506795:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107243.506817:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec60873b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.506893:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.506908:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.506921:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.506935:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.506953:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.506960:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507231:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507240:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507246:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507253:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348e00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107243.507257:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507264:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507276:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:2.0:1782107243.507280:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107243.507285:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507291:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507301:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507312:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507317:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507322:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107243.507325:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507330:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507337:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xefd6f96f (ffff8abe898b2800) 00010000:00010000:2.0:1782107243.507339:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107243.507341:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507347:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xefd6f96f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507377:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60873b expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507387:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:2.0:1782107243.507389:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107243.507392:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec60873b expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107243.507401:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1349c00, rc 0) 00000100:00100000:2.0:1782107243.507651:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:20315:x1868674447214464:12345-192.168.202.26@tcp:101:bash.0 Request processed in 878us (3961us total) trans 0 rc 301/301 00000100:00100000:2.0:1782107243.507660:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00080000:0.0:1782107243.507810:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107243.589942:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472435968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107243.590060:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107243.590528:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472435968 00000100:00100000:2.0:1782107243.590537:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472435968 00000100:00100000:2.0:1782107243.590604:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782107243.590616:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472435968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107243.590657:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107243.590709:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472435968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107243.590717:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1782107243.596015:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782107243.596084:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472435968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782107243.777045:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107244.609196:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782107244.609222:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472436096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107244.609296:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107244.609574:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472436096 00000100:00100000:1.0:1782107244.609584:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472436096 00000100:00100000:1.0:1782107244.609676:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782107244.609686:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472436096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107244.609721:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107244.609782:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472436096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107244.609789:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1782107244.610089:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782107244.610125:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec0d1df80 x1868674472436096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107244.610145:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472436096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782107244.800231:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107244.848968:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107244.849570:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107244.850666:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447214720 00000100:00100000:1.0:1782107244.850684:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447214720 00000100:00100000:1.0:1782107244.850752:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 232 00000100:00100000:1.0:1782107244.850763:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebf17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2371:x1868674447214720:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107244.850870:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebf17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2371:x1868674447214720:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 108us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107244.850878:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 232 00000100:00100000:0.0:1782107244.859551:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447214592 00000100:00100000:0.0:1782107244.859568:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447214592 00000100:00100000:0.0:1782107244.859641:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 303 00000100:00100000:0.0:1782107244.859652:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447214592:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107244.859870:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447214592:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 219us (10910us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107244.859878:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 303 00010000:00010000:0.0:1782107245.830118:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107246.663172:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472436224:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.663248:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107246.663297:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472436736:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.663333:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107246.663372:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782107246.663378:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472436352:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.663400:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107246.663428:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472436864:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.663451:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107246.663478:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472436480:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.663501:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107246.663518:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782107246.663524:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472436608:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.663545:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107246.663574:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472436736 00000100:00100000:2.0:1782107246.663581:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472436736 00000100:00100000:2.0:1782107246.663627:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472436352 00000100:00100000:2.0:1782107246.663630:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472436352 00000100:00100000:2.0:1782107246.663655:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472436480 00000100:00100000:2.0:1782107246.663658:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472436480 00000100:00100000:2.0:1782107246.663676:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782107246.663684:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472436736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.663733:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472436736:12345-0@lo:400:kworker.0 Request processed in 50us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107246.663740:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782107246.663759:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1782107246.663765:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472436352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.663789:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1868674472436352:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107246.663795:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1782107246.663829:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782107246.663843:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472436480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.663874:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472436480:12345-0@lo:400:kworker.0 Request processed in 33us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107246.663879:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782107246.663899:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472436864 00000100:00100000:2.0:1782107246.663902:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472436864 00000100:00100000:2.0:1782107246.663927:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472436608 00000100:00100000:2.0:1782107246.663930:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472436608 00000100:00100000:2.0:1782107246.663950:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782107246.663955:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472436864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.664012:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1868674472436864:12345-0@lo:400:kworker.0 Request processed in 56us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107246.664018:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782107246.664027:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782107246.664033:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472436608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.664073:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472436608:12345-0@lo:400:kworker.0 Request processed in 40us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107246.664078:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1782107246.664098:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782107246.664101:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782107246.664104:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782107246.664134:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990a9180 x1868674472436608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107246.664146:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472436608:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.664156:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472436480:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.664182:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3324:1868674472436352:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.664201:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3324:1868674472436864:0@lo:400:kworker.0 00000100:00100000:2.0:1782107246.664210:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472436736:0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.665249:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472436224 00000100:00100000:1.0:1782107246.665256:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472436224 00000100:00100000:1.0:1782107246.665293:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1782107246.665301:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472436224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107246.665359:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472436224:12345-0@lo:400:kworker.0 Request processed in 59us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107246.665365:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1782107246.665916:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472436224:0@lo:400:kworker.0 00010000:00010000:2.0:1782107246.848694:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107247.872224:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107248.707437:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472436992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107248.707507:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107248.707936:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472436992 00000100:00100000:0.0:1782107248.707944:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472436992 00000100:00100000:0.0:1782107248.708040:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782107248.708050:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472436992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107248.708085:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107248.708132:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472436992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107248.708139:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1782107248.708261:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107248.708340:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472436992:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782107248.899533:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107249.737295:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472437120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107249.737366:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107249.737932:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472437120 00000100:00100000:1.0:1782107249.737942:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472437120 00000100:00100000:1.0:1782107249.738052:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1782107249.738063:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472437120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782107249.738101:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782107249.738157:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472437120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107249.738170:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1782107249.738213:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec1030000 x1868674472437120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107249.738232:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472437120:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782107249.741070:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782107249.924665:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107249.980755:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107249.980884:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107249.980937:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447214976 00000100:00100000:2.0:1782107249.980948:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447214976 00000100:00100000:2.0:1782107249.981059:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 236 00000100:00100000:2.0:1782107249.981069:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2372:x1868674447214976:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1782107249.981143:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2372:x1868674447214976:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107249.981149:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 236 00000100:00080000:3.0:1782107249.986135:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107249.987805:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447214848 00000100:00100000:1.0:1782107249.987819:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447214848 00000100:00100000:1.0:1782107249.988252:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 305 00000100:00100000:1.0:1782107249.988263:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447214848:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107249.988514:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447214848:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 251us (7766us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107249.988522:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 305 00010000:00010000:0.0:1782107250.944235:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107251.778069:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472437504:0@lo:400:kworker.0 00000100:00100000:2.0:1782107251.778135:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107251.778343:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472437376:0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.778381:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107251.778409:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472437888:0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.778432:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107251.778459:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782107251.778465:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472437248:0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.778492:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107251.778529:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abebef4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472437760:0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.779033:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107251.779067:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472437632:0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.779093:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107251.779128:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472437504 00000100:00100000:1.0:1782107251.779136:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472437504 00000100:00080000:3.0:1782107251.779348:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782107251.779682:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472437376 00000100:00100000:2.0:1782107251.779687:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472437376 00000100:00100000:2.0:1782107251.779726:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472437760 00000100:00100000:2.0:1782107251.779730:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472437760 00000100:00100000:2.0:1782107251.779750:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1782107251.779757:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472437376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.779992:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1782107251.780002:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472437760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.780061:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472437760:12345-0@lo:400:kworker.0 Request processed in 62us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107251.780069:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1782107251.780084:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1782107251.780090:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472437504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.780125:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472437504:12345-0@lo:400:kworker.0 Request processed in 35us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107251.780131:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1782107251.780149:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472437888 00000100:00100000:1.0:1782107251.780152:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472437888 00000100:00100000:1.0:1782107251.780178:0:6578:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472437632 00000100:00100000:2.0:1782107251.780487:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472437376:12345-0@lo:400:kworker.0 Request processed in 729us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107251.780494:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:3.0:1782107251.780965:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782107251.780983:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107251.781351:0:6578:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472437632 00000100:00100000:1.0:1782107251.782035:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782107251.782045:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472437888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.782101:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472437888:12345-0@lo:400:kworker.0 Request processed in 59us (3667us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107251.782108:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782107251.782122:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782107251.782128:0:6578:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472437632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.782159:0:6578:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472437632:12345-0@lo:400:kworker.0 Request processed in 32us (3065us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107251.782165:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1782107251.783335:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472437248 00000100:00100000:1.0:1782107251.783344:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472437248 00000100:00100000:1.0:1782107251.783378:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1782107251.783394:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472437248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.783445:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472437248:12345-0@lo:400:kworker.0 Request processed in 53us (4951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107251.783451:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1782107251.783518:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472437504:0@lo:400:kworker.0 00010000:00080000:1.0:1782107251.783634:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec0d1df80 x1868674472437632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107251.783646:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec0d1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472437632:0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.783668:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472437248:0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.783679:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472437760:0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.783690:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abebef3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472437376:0@lo:400:kworker.0 00000100:00100000:1.0:1782107251.783700:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472437888:0@lo:400:kworker.0 00000100:00080000:3.0:1782107251.791174:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782107252.023614:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107253.057879:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107253.827905:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472438016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107253.827998:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107253.828230:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472438016 00000100:00100000:3.0:1782107253.828248:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472438016 00000100:00100000:3.0:1782107253.828657:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782107253.828668:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472438016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782107253.828706:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782107253.828840:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472438016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107253.828866:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1782107253.829034:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107253.830158:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472438016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782107254.088191:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107254.850219:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782107254.850243:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472438144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782107254.850312:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107254.850506:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472438144 00000100:00100000:2.0:1782107254.850515:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472438144 00000100:00080000:3.0:1782107254.850614:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782107254.850701:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782107254.850713:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472438144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107254.850765:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107254.850887:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472438144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107254.850896:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1782107254.850963:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990a9180 x1868674472438144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107254.851006:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472438144:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1782107254.995904:0:17470:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4d: reject malformed EC specifications ========================================================== 01:47:33 (1782107253) 00000100:00100000:3.0:1782107255.102393:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107255.102429:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107255.102519:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447215232 00000100:00100000:1.0:1782107255.102528:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447215232 00000100:00100000:1.0:1782107255.102590:0:7463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 240 00000100:00100000:1.0:1782107255.102601:0:7463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2372:x1868674447215232:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107255.102666:0:7463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2372:x1868674447215232:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107255.102674:0:7463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 240 00000100:00100000:0.0:1782107255.102905:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447215104 00000100:00100000:0.0:1782107255.102910:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447215104 00000100:00100000:0.0:1782107255.102942:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 307 00000100:00100000:0.0:1782107255.102949:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447215104:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107255.102994:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88852592-b9c0-40cb-a875-489a88776a1c+9:2372:x1868674447215104:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 46us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107255.103008:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 307 00000100:00080000:3.0:1782107255.103111:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782107255.107457:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107255.239062:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107255.239188:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447215360 00000100:00100000:2.0:1782107255.239199:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447215360 00000100:00100000:2.0:1782107255.239259:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:2.0:1782107255.239269:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:20890:x1868674447215360:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1782107255.239290:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107255.239312:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608742 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107255.239391:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107255.239404:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107255.239415:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107255.239431:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107255.239438:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107255.239462:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240389:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240401:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240407:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240413:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348c00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107255.240417:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240424:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240449:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:3.0:1782107255.240453:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107255.240457:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240463:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348c00/0xc2d453a189c7bf49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240476:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240482:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240487:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240501:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348e00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:3.0:1782107255.240504:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240510:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240516:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe13ef5f2 (ffff8abe898b2700) 00010000:00010000:3.0:1782107255.240518:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107255.240521:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240526:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348e00/0xc2d453a189c7bf50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe13ef5f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240570:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608742 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240579:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:3.0:1782107255.240582:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782107255.240585:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608742 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107255.240594:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1349600, rc 0) 00000100:00100000:3.0:1782107255.240663:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:20890:x1868674447215360:12345-192.168.202.26@tcp:101:bash.0 Request processed in 1395us (1609us total) trans 0 rc 301/301 00000100:00100000:3.0:1782107255.240671:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 68 00010000:00010000:3.0:1782107256.130060:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782107256.900666:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472438400:0@lo:400:kworker.0 00000100:00100000:1.0:1782107256.900759:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107256.900822:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd810b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472438912:0@lo:400:kworker.0 00000100:00100000:1.0:1782107256.900856:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107256.900889:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782107256.900895:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472438272:0@lo:400:kworker.0 00000100:00100000:1.0:1782107256.900925:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107256.900945:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472438784:0@lo:400:kworker.0 00000100:00100000:1.0:1782107256.900964:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107256.901133:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472438656:0@lo:400:kworker.0 00000100:00100000:1.0:1782107256.901232:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107256.901252:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782107256.901259:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472438528:0@lo:400:kworker.0 00000100:00100000:1.0:1782107256.901283:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107256.901310:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472438400 00000100:00100000:1.0:1782107256.901317:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472438400 00000100:00100000:1.0:1782107256.901354:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472438784 00000100:00100000:1.0:1782107256.901357:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472438784 00000100:00100000:1.0:1782107256.901375:0:7463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472438528 00000100:00100000:1.0:1782107256.901378:0:7463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472438528 00000100:00100000:0.0:1782107256.901485:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472438912 00000100:00100000:0.0:1782107256.901489:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472438912 00000100:00100000:0.0:1782107256.901515:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472438656 00000100:00100000:0.0:1782107256.901517:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472438656 00000100:00100000:0.0:1782107256.901553:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782107256.901563:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472438912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.901614:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472438912:12345-0@lo:400:kworker.0 Request processed in 53us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107256.901622:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782107256.901637:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782107256.901644:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472438656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.901671:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472438656:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107256.901677:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782107256.901696:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782107256.901702:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472438400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.901742:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472438400:12345-0@lo:400:kworker.0 Request processed in 28us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107256.901748:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782107256.901761:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782107256.901768:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472438784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.901793:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1868674472438784:12345-0@lo:400:kworker.0 Request processed in 26us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107256.901812:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782107256.901824:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782107256.901829:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472438528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.901854:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3327:x1868674472438528:12345-0@lo:400:kworker.0 Request processed in 25us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107256.901859:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782107256.901877:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472438272 00000100:00100000:0.0:1782107256.901880:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472438272 00000100:00100000:0.0:1782107256.901903:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1782107256.901908:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472438272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.901935:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3325:x1868674472438272:12345-0@lo:400:kworker.0 Request processed in 26us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107256.901940:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:0.0:1782107256.902019:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782107256.902032:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782107256.902035:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782107256.902077:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3325:1868674472438272:0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.902090:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3325:1868674472438784:0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.902098:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472438400:0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.902105:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd810b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472438912:0@lo:400:kworker.0 00000100:00100000:0.0:1782107256.902146:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3327:1868674472438528:0@lo:400:kworker.0 00010000:00080000:0.0:1782107256.905211:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abeb3ed0a80 x1868674472438656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782107256.905252:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472438656:0@lo:400:kworker.0 00010000:00010000:0.0:1782107257.162674:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107258.177097:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107258.957220:0:3327:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782107258.957249:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abd810b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782107258.957326:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107258.957392:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472439040 00000100:00100000:0.0:1782107258.957400:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472439040 00000100:00100000:0.0:1782107258.957458:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782107258.957467:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd810b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472439040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782107258.957504:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782107258.957547:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd810b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472439040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107258.957553:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1782107258.957572:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782107258.957623:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abd810b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472439040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782107259.202879:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782107259.969770:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472439168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782107259.969844:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107259.970560:0:6579:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472439168 00000100:00100000:2.0:1782107259.970570:0:6579:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472439168 00000100:00100000:2.0:1782107259.970646:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782107259.970656:0:6579:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd810b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472439168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107259.970694:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107259.970801:0:6579:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd810b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472439168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107259.970808:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1782107259.970936:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990a9180 x1868674472439168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107259.970956:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472439168:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782107259.972287:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782107260.217200:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1782107260.217246:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107260.217328:0:5799:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447215488 00000100:00100000:1.0:1782107260.217338:0:5799:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447215488 00000100:00100000:1.0:1782107260.217395:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 309 00000100:00100000:1.0:1782107260.217404:0:5799:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447215488:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107260.217479:0:5799:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88852592-b9c0-40cb-a875-489a88776a1c+9:2371:x1868674447215488:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107260.217498:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 309 00000100:00100000:0.0:1782107260.217608:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447215616 00000100:00100000:0.0:1782107260.217612:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447215616 00000100:00100000:0.0:1782107260.217658:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 244 00000100:00100000:0.0:1782107260.217665:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2371:x1868674447215616:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1782107260.217694:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:2371:x1868674447215616:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107260.217720:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 244 00000100:00080000:1.0:1782107260.219723:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782107260.227378:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107261.248218:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107262.016480:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472439296:0@lo:400:kworker.0 00000100:00100000:1.0:1782107262.016525:0:3327:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472439680:0@lo:400:kworker.0 00000100:00100000:0.0:1782107262.016616:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472439424:0@lo:400:kworker.0 00000100:00100000:2.0:1782107262.017839:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472439552:0@lo:400:kworker.0 00000100:00100000:3.0:1782107262.018319:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782107262.018353:0:3327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107262.018397:0:3324:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472439808:0@lo:400:kworker.0 00000100:00100000:1.0:1782107262.018425:0:6577:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472439680 00000100:00100000:3.0:1782107262.018433:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107262.018467:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472439808 00000100:00100000:3.0:1782107262.018472:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472439808 00000100:00100000:3.0:1782107262.018527:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1782107262.018549:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472439808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107262.018600:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1868674472439808:12345-0@lo:400:kworker.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107262.018608:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1782107262.018632:0:6577:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472439680 00000100:00100000:3.0:1782107262.018647:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3324:1868674472439808:0@lo:400:kworker.0 00000100:00100000:1.0:1782107262.018677:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1782107262.018711:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782107262.018766:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107262.018771:0:6577:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472439680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107262.018787:0:5802:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472439296 00000100:00100000:3.0:1782107262.018793:0:5802:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472439296 00000100:00100000:1.0:1782107262.018818:0:6577:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3327:x1868674472439680:12345-0@lo:400:kworker.0 Request processed in 133us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107262.018826:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1782107262.018827:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782107262.018838:0:5802:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472439296:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1782107262.018872:0:3327:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abec1032d80 x1868674472439680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782107278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782107262.018886:0:3327:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3327:1868674472439680:0@lo:400:kworker.0 00000100:00100000:3.0:1782107262.018892:0:5802:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1+18:3324:x1868674472439296:12345-0@lo:400:kworker.0 Request processed in 54us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107262.018901:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1782107262.018938:0:3324:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1033b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7fa642a-4fe4-4b59-baa9-5fefc6a93dc1:3324:1868674472439296:0@lo:400:kworker.0 00000100:00100000:0.0:1782107262.019138:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782107262.019335:0:3325:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abec1033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472439936:0@lo:400:kworker.0 00000100:00100000:0.0:1782107262.019381:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107262.020889:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782107262.021560:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472439424 00000100:00100000:3.0:1782107262.021570:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472439424 00000100:00100000:3.0:1782107262.021627:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472439552 00000100:00100000:3.0:1782107262.021630:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472439552 00000100:00100000:3.0:1782107262.021671:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1782107262.021680:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abd810b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472439424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107262.021830:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abd810b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1868674472439424:12345-0@lo:400:kworker.0 Request processed in 151us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107262.021838:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1782107262.021854:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1782107262.021861:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe990ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472439552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782107262.021909:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe990ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3326:x1868674472439552:12345-0@lo:400:kworker.0 Request processed in 49us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1782107262.021915:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1782107262.021936:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107262.022271:0:8608:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472439936 00000100:00100000:1.0:1782107262.022277:0:8608:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472439936 00000100:00100000:1.0:1782107262.022330:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1782107262.022333:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107262.022340:0:8608:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb3ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472439936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782107262.022382:0:8608:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb3ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1868674472439936:12345-0@lo:400:kworker.0 Request processed in 45us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107262.022389:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782107262.023134:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3325:1868674472439424:0@lo:400:kworker.0 00000100:00100000:0.0:1782107262.023147:0:3325:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3325:1868674472439936:0@lo:400:kworker.0 00000100:00100000:2.0:1782107262.023926:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abec1032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3326:1868674472439552:0@lo:400:kworker.0 00010000:00010000:1.0:1782107262.272260:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782107262.813667:0:17665:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 4e: auto-create [0,EOF] component when --ec without -E ========================================================== 01:47:41 (1782107261) 00000100:00100000:0.0:1782107262.941146:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107262.941181:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447215744 00000100:00100000:0.0:1782107262.941190:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447215744 00000100:00100000:0.0:1782107262.941249:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:0.0:1782107262.941260:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb3ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:21614:x1868674447215744:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1782107262.941282:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107262.941302:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e000/0xc2d453a189c7bf57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608749 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.941363:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.941378:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.941389:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.941416:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.941423:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.941429:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.944943:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.944962:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.944985:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.944992:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439f200 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107262.945108:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945118:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945138:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:0.0:1782107262.945142:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107262.945147:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945154:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439f200/0xc2d453a189c7bf5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945193:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945199:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945205:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945211:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439fc00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107262.945214:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945220:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945228:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35a08a1b (ffff8abe89048100) 00010000:00010000:0.0:1782107262.945230:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107262.945233:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945239:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945291:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e000/0xc2d453a189c7bf57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608749 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945301:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:0.0:1782107262.945304:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107262.945314:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e000/0xc2d453a189c7bf57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608749 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.945325:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439e000, rc 0) 00000100:00100000:0.0:1782107262.945399:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb3ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:21614:x1868674447215744:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 4139us (4262us total) trans 0 rc 301/301 00000100:00100000:0.0:1782107262.945407:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00080000:0.0:1782107262.945448:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107262.968791:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107262.968840:0:5809:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447216000 00000100:00100000:2.0:1782107262.968851:0:5809:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447216000 00000100:00100000:2.0:1782107262.968912:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:2.0:1782107262.968923:0:5809:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec0d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+6:21614:x1868674447216000:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1782107262.968945:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782107262.968947:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782107262.968988:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe81407a00/0xc2d453a189c7befc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608726 expref: 6 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.969006:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe84d6a700) 00010000:00010000:2.0:1782107262.969017:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782107262.969040:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7bf6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608750 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.969640:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.969656:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.969667:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.969695:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.969703:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.969710:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.971961:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.971999:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.972010:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782107262.972021:0:5809:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:2.0:1782107262.972048:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.972066:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.972073:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.972080:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1349c00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:2.0:1782107262.972084:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.972091:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.972103:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe898b2100) 00010000:00010000:2.0:1782107262.972107:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782107262.972112:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.972118:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349c00/0xc2d453a189c7bf73 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782107262.972129:0:5809:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000aed56acb reply state 000000004f9609c9 transno 4294967324 ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782107262.972138:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782107262.972172:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349400/0xc2d453a189c7bf6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608750 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.972191:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608750 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782107262.972209:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8abe898b2b00) 00010000:00010000:2.0:1782107262.972211:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782107262.972214:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abec1349600, rc 0) 00000100:00100000:2.0:1782107262.974186:0:5809:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec0d1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+8:21614:x1868674447216000:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 5256us (5391us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1782107262.974199:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:0.0:1782107262.984435:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107262.984487:0:5808:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447216256 00000100:00100000:0.0:1782107262.984497:0:5808:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447216256 00000100:00100000:0.0:1782107262.984546:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:0.0:1782107262.984557:0:5808:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb3ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+8:21614:x1868674447216256:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1782107262.984584:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782107262.984608:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e000/0xc2d453a189c7bf8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3a14c714ec608757 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.984725:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.984741:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608750 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.984751:0:5808:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.984783:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608750 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.984807:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608750 expref: 9 pid: 5809 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107262.984822:0:5808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abeb3ed0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1868674472440064:192.168.202.26@tcp:104: 00000100:00100000:0.0:1782107262.984908:0:5808:0:(client.c:2692:ptlrpc_set_wait()) set ffff8abebef0a780 going to sleep for 11 seconds 00010000:00010000:0.0:1782107262.986106:0:3311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.986119:0:3311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.986127:0:3311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.986134:0:3311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abec1348400 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107262.986138:0:3311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.986146:0:3311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.986161:0:3311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35a08a1b (ffff8abe898b2400) 00010000:00010000:0.0:1782107262.986165:0:3311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782107262.986169:0:3311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.986175:0:3311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1348400/0xc2d453a189c7bf7a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35a08a1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107262.990989:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107262.991019:0:5794:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447216384 00000100:00100000:0.0:1782107262.991028:0:5794:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447216384 00010000:00010000:0.0:1782107262.991067:0:5794:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608750 expref: 9 pid: 5809 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107262.991101:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:0.0:1782107262.991110:0:5794:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abeb3ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+9:2372:x1868674447216384:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782107262.991123:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782107262.991129:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608750 expref: 9 pid: 5809 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.991142:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608750 expref: 9 pid: 5809 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.991163:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8abe898b2b00) 00010000:00010000:0.0:1782107262.991168:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.991177:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.991185:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.991220:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782107262.991273:0:5794:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb3ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7809e99e-e82d-45c5-af74-069d8f4d001a+9:2372:x1868674447216384:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 164us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107262.991288:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 34 00010000:00010000:0.0:1782107262.991402:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abec1349600/0xc2d453a189c7bf81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608750 expref: 8 pid: 5809 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107262.991416:0:5808:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abeb3ed0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1868674472440064:192.168.202.26@tcp:104: 00010000:00010000:0.0:1782107262.992044:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.992056:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.992062:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782107262.992081:0:5808:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:0.0:1782107262.993168:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.993180:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.993188:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.993532:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8abe8439fc00 already unused, calling callback (ffffffffc1e4c4f0) 00010000:00010000:0.0:1782107262.993538:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.993547:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.993576:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8abe898b2b00) 00010000:00010000:0.0:1782107262.993579:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782107262.993585:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.993591:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439fc00/0xc2d453a189c7bf96 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.993642:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e000/0xc2d453a189c7bf8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608757 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.993653:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8abe89048100) 00010000:00010000:0.0:1782107262.993655:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782107262.993660:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8abe8439e000/0xc2d453a189c7bf8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0x3a14c714ec608757 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107262.993672:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8abe8439e000, rc 0) 00000100:00100000:0.0:1782107262.993801:0:5808:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abeb3ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7809e99e-e82d-45c5-af74-069d8f4d001a+6:21614:x1868674447216256:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 9245us (9374us total) trans 0 rc 301/301 00000100:00100000:0.0:1782107262.993811:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:3.0:1782107262.999496:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1782107263.002288:0:5810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447216640 00000100:00100000:1.0:1782107263.002319:0:5810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447216640 00000100:00100000:0.0:1782107263.002650:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:0.0:1782107263.002661:0:5810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abec1317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+6:21614:x1868674447216640:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:0.0:1782107263.002917:0:5810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abec1317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+7:21614:x1868674447216640:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 257us (3430us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782107263.002925:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 11 00010000:00010000:0.0:1782107263.298099:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782107263.692908:0:5829:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000100:00100000:1.0:1782107264.075008:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472440192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782107264.075077:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107264.075359:0:7540:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472440192 00000100:00100000:2.0:1782107264.075367:0:7540:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472440192 00000100:00100000:2.0:1782107264.075432:0:7540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782107264.075442:0:7540:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abebef3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472440192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782107264.075483:0:7540:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107264.075525:0:7540:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abebef3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472440192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107264.075532:0:7540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1782107264.076089:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782107264.076123:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472440192:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782107264.322629:0:5796:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782107264.636135:0:17715:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_4e: @@@@@@ FAIL: setstripe failed 00000100:00100000:2.0:1782107265.088391:0:3326:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782107265.088415:0:3326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472440320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107265.088527:0:3326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782107265.088592:0:6580:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674472440320 00000100:00100000:2.0:1782107265.088599:0:6580:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674472440320 00000100:00100000:2.0:1782107265.088651:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782107265.088671:0:6580:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe84399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472440320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782107265.088709:0:6580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782107265.088757:0:6580:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe84399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3326:x1868674472440320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782107265.088765:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1782107265.088769:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782107265.088824:0:3326:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8abe990a9180 x1868674472440320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782107281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107265.088841:0:3326:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8abe990a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3326:1868674472440320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782107265.325102:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1782107265.325159:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1782107265.325367:0:5801:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447216768 00000100:00100000:0.0:1782107265.325377:0:5801:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447216768 00000100:00100000:0.0:1782107265.325428:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 311 00000100:00100000:0.0:1782107265.325437:0:5801:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe910ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447216768:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107265.325498:0:5807:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674447216896 00000100:00100000:1.0:1782107265.325504:0:5807:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674447216896 00000100:00100000:0.0:1782107265.325508:0:5801:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe910ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88852592-b9c0-40cb-a875-489a88776a1c+9:2373:x1868674447216768:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 69us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107265.325518:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 311 00000100:00080000:0.0:1782107265.325551:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782107265.325556:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 248 00000100:00100000:1.0:1782107265.325566:0:5807:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8abe84399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447216896:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1782107265.325604:0:5807:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8abe84399180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7809e99e-e82d-45c5-af74-069d8f4d001a+5:2373:x1868674447216896:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 40us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107265.325610:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 248 00010000:00010000:1.0:1782107265.344447:0:8257:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782107266.368666:0:5795:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 2727 lines, 2727 kept, 0 dropped, 0 bad.