00010000:00010000:3.0F:1782480998.364171:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1782480998.721066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.721130:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.721165:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.721200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.721228:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.721248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.721279:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.721307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.721334:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.721368:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281300992 00000100:00100000:1.0:1782480998.721378:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281300992 00000100:00100000:1.0:1782480998.721426:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281301504 00000100:00100000:1.0:1782480998.721430:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281301504 00000100:00100000:1.0:1782480998.721457:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281300864 00000100:00100000:1.0:1782480998.721461:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281300864 00000100:00100000:1.0:1782480998.721475:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281301376 00000100:00100000:1.0:1782480998.721477:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281301376 00000100:00100000:1.0:1782480998.721495:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:1.0:1782480998.721505:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:2407:x1869066281300992:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782480998.721591:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:2407:x1869066281300992:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 86us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480998.721599:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:1.0:1782480998.721617:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:1.0:1782480998.721624:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2407:x1869066281301504:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782480998.721650:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2407:x1869066281301504:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480998.721656:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:1.0:1782480998.721669:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:1.0:1782480998.721675:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+25:2407:x1869066281300864:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782480998.721749:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+25:2407:x1869066281300864:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 73us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480998.721756:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:1.0:1782480998.721770:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:1.0:1782480998.721778:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+6:2407:x1869066281301376:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782480998.721801:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+6:2407:x1869066281301376:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480998.721807:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:1.0:1782480998.721826:0:18604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281301248 00000100:00100000:1.0:1782480998.721829:0:18604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281301248 00000100:00100000:1.0:1782480998.721851:0:18604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281301760 00000100:00100000:1.0:1782480998.721854:0:18604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281301760 00000100:00100000:1.0:1782480998.721865:0:18604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281301120 00000100:00100000:1.0:1782480998.721868:0:18604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281301120 00000100:00100000:1.0:1782480998.721880:0:18604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281301632 00000100:00100000:1.0:1782480998.721882:0:18604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281301632 00000100:00100000:1.0:1782480998.721895:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:1.0:1782480998.721901:0:18604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c447ea9-c05e-4f74-a91c-16472b83b6c2+8:2407:x1869066281301248:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782480998.721927:0:18604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c447ea9-c05e-4f74-a91c-16472b83b6c2+8:2407:x1869066281301248:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 26us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480998.721933:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:1.0:1782480998.721945:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:1.0:1782480998.721951:0:18604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2407:x1869066281301760:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782480998.721972:0:18604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2407:x1869066281301760:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 22us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480998.721988:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:1.0:1782480998.722002:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:1.0:1782480998.722009:0:18604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:2407:x1869066281301120:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782480998.722032:0:18604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:2407:x1869066281301120:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480998.722038:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:1.0:1782480998.722048:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:1.0:1782480998.722054:0:18604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2407:x1869066281301632:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782480998.722076:0:18604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2407:x1869066281301632:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 23us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480998.722083:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00080000:3.0:1782480998.722732:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480998.722739:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480998.722742:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480998.722744:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782480998.722979:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782480998.723050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0F:1782480998.723294:0:17088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281300736 00000100:00100000:2.0:1782480998.723308:0:17088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281300736 00000100:00100000:2.0:1782480998.723355:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 164 00000100:00100000:2.0:1782480998.723364:0:17088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c837ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577539e-a996-4b7d-ae92-f0069d2fe94c+13:2407:x1869066281300736:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782480998.723414:0:17088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c837ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577539e-a996-4b7d-ae92-f0069d2fe94c+13:2407:x1869066281300736:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 50us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480998.723421:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 164 00000100:00100000:2.0:1782480998.723469:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281302016 00000100:00100000:2.0:1782480998.723473:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281302016 00000100:00100000:2.0:1782480998.723500:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:2.0:1782480998.723507:0:19137:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+8:2407:x1869066281302016:12345-192.168.204.11@tcp:16:kworker.0 00000100:00100000:2.0:1782480998.723938:0:19137:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+8:2407:x1869066281302016:12345-192.168.204.11@tcp:16:kworker.0 Request processed in 430us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480998.723946:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:3.0:1782480998.724146:0:18607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281301888 00000100:00100000:3.0:1782480998.724150:0:18607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281301888 00002000:00100000:3.0:1782480998.724176:0:18607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9f5b875bc380 x1869066281301888/t0(0) o4->9c447ea9-c05e-4f74-a91c-16472b83b6c2@192.168.204.11@tcp:754/0 lens 504/0 e 0 to 0 dl 1782481009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1782480998.724187:0:18607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f5b875bc380 with x1869066281301888 ext(0->8) 00002000:00010000:3.0:1782480998.724192:0:18607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f5b875bc380 00000100:00100000:3.0:1782480998.724224:0:18607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1782480998.724232:0:18607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+8:2407:x1869066281301888:12345-192.168.204.11@tcp:4:bash.0 00000100:00100000:3.0:1782480998.725507:0:18607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+10:2407:x1869066281301888:12345-192.168.204.11@tcp:4:bash.0 Request processed in 1204us (2385us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1782480998.725518:0:18607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00002000:00100000:3.0:1782480998.725599:0:18607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9f5b875bc380 x1869066281301888/t8589934599(0) o4->9c447ea9-c05e-4f74-a91c-16472b83b6c2@192.168.204.11@tcp:754/0 lens 504/448 e 0 to 0 dl 1782481009 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1782480998.725610:0:18607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9f5b875bc380 with x1869066281301888 ext(0->8) 00002000:00010000:3.0:1782480998.725616:0:18607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f5b875bc380 00000100:00100000:2.0:1782480999.388577:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480999.388603:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb598df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301292800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782480999.388628:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301292928:0@lo:400:kworker.0 00010000:00010000:1.0:1782480999.389484:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480999.391761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480999.391825:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480999.391837:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301293056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480999.391875:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480999.391911:0:18605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301293056 00000100:00100000:3.0:1782480999.391917:0:18605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301293056 00000100:00100000:3.0:1782480999.391976:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782480999.391985:0:18605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869066301293056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480999.392007:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:3.0:1782480999.392052:0:18605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869066301293056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.392059:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1782480999.392078:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480999.392215:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301293056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480999.392293:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301293440:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392320:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480999.392363:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301293568:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392387:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480999.392449:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480999.392453:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301293952:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.392474:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301293184:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392476:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480999.392496:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480999.392511:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301293696:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392515:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1869066301294080:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480999.392533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480999.392549:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782480999.392554:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301293312:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.392572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480999.392584:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1869066301294464:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.392585:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301293824:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480999.392602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480999.392625:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301294208:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392626:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301293440 00000100:00100000:3.0:1782480999.392630:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301293440 00000100:00100000:2.0:1782480999.392645:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480999.392649:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301293952 00000100:00100000:3.0:1782480999.392652:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301293952 00000100:00100000:2.0:1782480999.392654:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480999.392659:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1869066301294336:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392663:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301294080 00000100:00100000:3.0:1782480999.392665:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301294080 00000100:00100000:2.0:1782480999.392676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480999.392683:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301294464 00000100:00100000:3.0:1782480999.392685:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301294464 00000100:00100000:2.0:1782480999.392712:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301293568 00000100:00100000:2.0:1782480999.392716:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301293568 00000100:00100000:3.0:1782480999.392729:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301294208 00000100:00100000:3.0:1782480999.392732:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301294208 00000100:00100000:2.0:1782480999.392732:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301293184 00000100:00100000:2.0:1782480999.392734:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301293184 00000100:00100000:3.0:1782480999.392742:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301294336 00000100:00100000:3.0:1782480999.392744:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301294336 00000100:00100000:2.0:1782480999.392745:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782480999.392750:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301293568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392756:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782480999.392760:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301293440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.392785:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301293568:12345-0@lo:400:kworker.0 Request processed in 34us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.392786:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301293440:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.392792:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782480999.392792:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782480999.392805:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782480999.392805:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782480999.392810:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869066301293952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.392811:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301293184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392835:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869066301293952:12345-0@lo:400:kworker.0 Request processed in 25us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.392841:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782480999.392848:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301293184:12345-0@lo:400:kworker.0 Request processed in 38us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.392852:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782480999.392854:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782480999.392858:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869066301294080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.392868:0:18603:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301293696 00000100:00100000:2.0:1782480999.392871:0:18603:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301293696 00000100:00100000:3.0:1782480999.392882:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869066301294080:12345-0@lo:400:kworker.0 Request processed in 24us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.392887:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782480999.392894:0:18603:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301293312 00000100:00100000:2.0:1782480999.392896:0:18603:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301293312 00000100:00100000:3.0:1782480999.392897:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782480999.392901:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869066301294464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.392911:0:18603:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301293824 00000100:00100000:2.0:1782480999.392913:0:18603:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301293824 00000100:00100000:3.0:1782480999.392926:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869066301294464:12345-0@lo:400:kworker.0 Request processed in 24us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480999.392926:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782480999.392932:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782480999.392932:0:18603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301293696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.392941:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782480999.392946:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301294208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.392958:0:18603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301293696:12345-0@lo:400:kworker.0 Request processed in 27us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.392977:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301294208:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.392983:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782480999.392994:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782480999.393000:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869066301294336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.393022:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869066301294336:12345-0@lo:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.393028:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1782480999.393043:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480999.393043:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1782480999.393046:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480999.393048:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782480999.393050:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480999.393054:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782480999.393060:0:18603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301293312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.393067:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1869066301294080:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.393078:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301293568:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.393087:0:18603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301293312:12345-0@lo:400:kworker.0 Request processed in 28us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480999.393092:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782480999.393102:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1782480999.393105:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b87973b80 x1869066301294464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480999.393107:0:18603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301293824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.393115:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1869066301294464:0@lo:400:kworker.0 00000100:00100000:3.0:1782480999.393124:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301293952:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.393132:0:18603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301293824:12345-0@lo:400:kworker.0 Request processed in 25us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480999.393133:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301293440:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.393137:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782480999.393161:0:18605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301292800 00000100:00100000:2.0:1782480999.393164:0:18605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301292800 00000100:00100000:2.0:1782480999.393183:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480999.393187:0:18605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301292800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782480999.393198:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:2.0:1782480999.393222:0:18605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301292800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480999.393227:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480999.393252:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1869066301294336:0@lo:400:kworker.0 00010000:00080000:2.0:1782480999.393262:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b87970e00 x1869066301294208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480999.393282:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301294208:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.393292:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301293312:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.393309:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301293824:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.393317:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301293184:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.393325:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87972a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301293696:0@lo:400:kworker.0 00000100:00100000:2.0:1782480999.393337:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb598df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301292800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0F:1782480999.396346:0:17086:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301292928 00000100:00100000:0.0:1782480999.396376:0:17086:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301292928 00000100:00100000:0.0:1782480999.396443:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782480999.396454:0:17086:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c837ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e024ba8a-c811-4940-9393-bca6a08f819f+24:3649:x1869066301292928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480999.396547:0:17086:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c837ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e024ba8a-c811-4940-9393-bca6a08f819f+24:3649:x1869066301292928:12345-0@lo:400:kworker.0 Request processed in 95us (4790us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480999.396554:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782480999.396614:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301292928:0@lo:400:kworker.0 00000100:00100000:0.0:1782480999.397845:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b875bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301294592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480999.397894:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480999.399580:0:18605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301294592 00000100:00100000:2.0:1782480999.399595:0:18605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301294592 00000100:00100000:2.0:1782480999.399660:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480999.399670:0:18605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301294592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480999.399720:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782480999.405476:0:18605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301294592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5797us (7571us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480999.405487:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b875bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301294592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480999.405493:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000040:00080000:0.0:1782481000.030022:0:17130:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782481000.030031:0:17130:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782481000.030065:0:17130:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1782481000.030073:0:17130:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:3.0:1782481000.416647:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1782481000.416665:0:19416:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1782481000.420092:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:0.0:1782481000.420123:0:17074:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f5b87a3e600 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:0.0:1782481000.420128:0:17074:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f5c88a25600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f5b87a3e480 00000020:00080000:0.0:1782481000.420131:0:17074:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9f5c88a25e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f5b819ce000 00010000:00010000:1.0:1782481000.420211:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74400/0x65dae4c042ee4279 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481000.420232:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74400/0x65dae4c042ee4279 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481000.420239:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74400/0x65dae4c042ee4279 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481000.420244:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d74400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1782481000.420257:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74400/0x65dae4c042ee4279 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481000.420280:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74400/0x65dae4c042ee4279 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481000.420296:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f5c8a1f7000) 00010000:00010000:1.0:1782481000.420299:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481000.420303:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74400/0x65dae4c042ee4279 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481000.420309:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74400/0x65dae4c042ee4279 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17095 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782481000.420332:0:17135:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:1.0:1782481000.420397:0:17135:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1782481000.422404:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481000.996092:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481000.996319:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281302144 00000100:00100000:2.0:1782481000.996330:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281302144 00000100:00100000:2.0:1782481000.996409:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 74 00000100:00100000:2.0:1782481000.996421:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+12:15587:x1869066281302144:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782481000.996533:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+12:15587:x1869066281302144:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 Request processed in 115us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481000.996541:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 74 00000100:00080000:3.0:1782481000.996596:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782481001.011097:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481001.011289:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281302272 00000100:00100000:2.0:1782481001.011299:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281302272 00000100:00100000:2.0:1782481001.011371:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00100000:2.0:1782481001.011384:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:15587:x1869066281302272:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782481001.011493:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:15587:x1869066281302272:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 Request processed in 111us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481001.011514:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00080000:3.0:1782481001.011905:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782481001.014039:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481001.014109:0:17097:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281302528 00000100:00100000:2.0:1782481001.014131:0:17097:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281302528 00000100:00100000:2.0:1782481001.014184:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:2.0:1782481001.014194:0:17097:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7930050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+12:15587:x1869066281302528:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782481001.014426:0:17097:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7930050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+13:15587:x1869066281302528:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 232us (394us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1782481001.014434:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00010000:00010000:3.0:1782481001.436183:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481002.460877:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782481002.460901:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301294720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782481002.460981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782481002.461032:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481002.461203:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301294720 00000100:00100000:0.0:1782481002.461222:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301294720 00000100:00100000:0.0:1782481002.461285:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782481002.461294:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301294720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782481002.461328:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1782481002.461372:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301294720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481002.461395:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782481002.461544:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301294720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782481002.462158:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301294848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782481002.462193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481002.462342:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301294848 00000100:00100000:3.0:1782481002.462348:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301294848 00000100:00100000:3.0:1782481002.462405:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782481002.462414:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301294848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782481002.462436:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782481002.462488:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301294848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481002.462495:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782481002.462529:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301294848:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782481002.463587:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782481002.972098:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301294976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782481002.972172:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481002.972411:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301294976 00000100:00100000:0.0:1782481002.972418:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301294976 00000100:00100000:0.0:1782481002.972471:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782481002.972480:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b875bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301294976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782481002.972590:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782481002.972645:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b875bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301294976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481002.972652:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782481002.972737:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301294976:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782481003.484006:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782481003.677077:0:17854:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782481003.847901:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481003.847949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481003.847961:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281302784 00000100:00100000:3.0:1782481003.847973:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281302784 00000100:00100000:0.0:1782481003.847974:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481003.848005:0:17095:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281302912 00000100:00100000:0.0:1782481003.848010:0:17095:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281302912 00000100:00100000:3.0:1782481003.848048:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 69 00000100:00100000:3.0:1782481003.848061:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+13:2407:x1869066281302784:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782481003.848085:0:17089:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281302656 00000100:00100000:1.0:1782481003.848090:0:17089:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281302656 00000100:00100000:1.0:1782481003.848126:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 166 00000100:00100000:3.0:1782481003.848140:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+13:2407:x1869066281302784:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481003.848146:0:17089:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c8a183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577539e-a996-4b7d-ae92-f0069d2fe94c+13:2407:x1869066281302656:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782481003.848192:0:17089:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c8a183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577539e-a996-4b7d-ae92-f0069d2fe94c+13:2407:x1869066281302656:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 52us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481003.848200:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 166 00000100:00100000:0.0:1782481003.852447:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 70 00000100:00100000:0.0:1782481003.852470:0:17095:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:2407:x1869066281302912:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1782481003.852516:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 69 00000100:00100000:0.0:1782481003.852551:0:17095:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:2407:x1869066281302912:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 89us (4574us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481003.852560:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 70 00000100:00080000:0.0:1782481003.852623:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782481003.852629:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782481003.852660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481003.852716:0:18603:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281303040 00000100:00100000:3.0:1782481003.852724:0:18603:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281303040 00000100:00100000:3.0:1782481003.852769:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:3.0:1782481003.852778:0:18603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:2403:x1869066281303040:12345-192.168.204.11@tcp:9:kworker.0 00000020:00000080:3.0:1782481003.852800:0:18603:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3f31 00000100:00080000:3.0:1782481003.852829:0:18603:0:(import.c:65:import_set_state_nolock()) ffff9f5c90280800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782481003.852889:0:18603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1782481003.853049:0:18603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87973b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c447ea9-c05e-4f74-a91c-16472b83b6c2+2:2403:x1869066281303040:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 272us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481003.853057:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 29 00010000:00010000:3.0:1782481003.853103:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782481003.854485:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782481003.854790:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481003.854820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481003.854844:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281303296 00000100:00100000:3.0:1782481003.854850:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281303296 00000100:00100000:3.0:1782481003.854897:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 71 00000100:00100000:3.0:1782481003.854906:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+6:2406:x1869066281303296:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1782481003.854962:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+6:2406:x1869066281303296:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481003.854970:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 71 00000100:00100000:0.0:1782481003.855051:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281303168 00000100:00100000:0.0:1782481003.855056:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281303168 00000100:00100000:0.0:1782481003.855097:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:0.0:1782481003.855113:0:19137:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+6:2406:x1869066281303168:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1782481003.855141:0:19137:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+6:2406:x1869066281303168:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 31us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481003.855147:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00080000:0.0:1782481003.855263:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782481003.855267:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782481003.856956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481003.857035:0:17095:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281303424 00000100:00100000:3.0:1782481003.857043:0:17095:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281303424 00000100:00100000:3.0:1782481003.857102:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00100000:3.0:1782481003.857112:0:17095:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2406:x1869066281303424:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1782481003.857191:0:17095:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2406:x1869066281303424:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 72us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481003.857198:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00080000:0.0:1782481003.859290:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782481003.860101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481003.860657:0:18604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281303552 00000100:00100000:3.0:1782481003.860667:0:18604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281303552 00000100:00100000:3.0:1782481003.860746:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:3.0:1782481003.860756:0:18604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2403:x1869066281303552:12345-192.168.204.11@tcp:9:kworker.0 00000020:00000080:3.0:1782481003.860789:0:18604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3f70 00000100:00080000:3.0:1782481003.860798:0:18604:0:(import.c:65:import_set_state_nolock()) ffff9f5c90284800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1782481003.860892:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782481003.860987:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1782481003.861013:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1782481003.861332:0:18604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+2:2403:x1869066281303552:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 575us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481003.861341:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:3.0:1782481003.862332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481003.862409:0:19539:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281303680 00000100:00100000:0.0:1782481003.862416:0:19539:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281303680 00000100:00100000:0.0:1782481003.862469:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:0.0:1782481003.862478:0:19539:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2403:x1869066281303680:12345-192.168.204.11@tcp:9:kworker.0 00000100:00080000:1.0:1782481003.862488:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1782481003.862499:0:19539:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3f77 00000100:00080000:0.0:1782481003.862515:0:19539:0:(import.c:65:import_set_state_nolock()) ffff9f5c90283000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782481003.862560:0:19539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1782481003.862666:0:19539:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+2:2403:x1869066281303680:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 189us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481003.862673:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 31 00010000:00010000:1.0:1782481003.862688:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481004.508009:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b875bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e024ba8a-c811-4940-9393-bca6a08f819f:3650:1869066301295104:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508084:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508129:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b875bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301295616:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508155:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508188:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb5920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869066301296128:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508217:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508232:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb5920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1869066301296640:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508253:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508276:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782481004.508283:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b875bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301295488:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508308:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508324:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb5920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301296000:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508340:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508353:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb5923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1869066301296512:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508398:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b875bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301295232:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508435:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b875bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301295744:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508461:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508476:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb5923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1869066301296256:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508508:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782481004.508514:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b875bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301295360:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508530:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508543:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb5920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301295872:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508585:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb5921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301296384:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508619:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481004.508652:0:17088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301295104 00000100:00100000:1.0:1782481004.508659:0:17088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301295104 00000100:00100000:1.0:1782481004.508721:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782481004.508730:0:17088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c8a182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e024ba8a-c811-4940-9393-bca6a08f819f+24:3650:x1869066301295104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508778:0:17088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c8a182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e024ba8a-c811-4940-9393-bca6a08f819f+24:3650:x1869066301295104:12345-0@lo:400:kworker.0 Request processed in 49us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.508785:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1782481004.508815:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301295616 00000100:00100000:1.0:1782481004.508818:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301295616 00000100:00100000:1.0:1782481004.508836:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301296128 00000100:00100000:1.0:1782481004.508839:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301296128 00000100:00100000:1.0:1782481004.508848:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301296640 00000100:00100000:1.0:1782481004.508850:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301296640 00000100:00100000:1.0:1782481004.508874:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301296512 00000100:00100000:1.0:1782481004.508877:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301296512 00000100:00100000:1.0:1782481004.508892:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301296256 00000100:00100000:1.0:1782481004.508894:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301296256 00000100:00100000:1.0:1782481004.508908:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301296384 00000100:00100000:1.0:1782481004.508916:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301296384 00000100:00100000:1.0:1782481004.508933:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782481004.508940:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301295616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.508971:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301295616:12345-0@lo:400:kworker.0 Request processed in 32us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.508977:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782481004.508990:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782481004.508996:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869066301296128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509022:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869066301296128:12345-0@lo:400:kworker.0 Request processed in 27us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509028:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782481004.509039:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782481004.509044:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869066301296640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509068:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869066301296640:12345-0@lo:400:kworker.0 Request processed in 24us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509073:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782481004.509084:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782481004.509090:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869066301296512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509120:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869066301296512:12345-0@lo:400:kworker.0 Request processed in 31us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509127:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782481004.509138:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782481004.509145:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869066301296256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509191:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869066301296256:12345-0@lo:400:kworker.0 Request processed in 47us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509207:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782481004.509221:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782481004.509227:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301296384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509258:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301296384:12345-0@lo:400:kworker.0 Request processed in 32us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509264:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782481004.509290:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301295488 00000100:00100000:1.0:1782481004.509293:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301295488 00000100:00100000:1.0:1782481004.509318:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301296000 00000100:00100000:1.0:1782481004.509321:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301296000 00000100:00100000:1.0:1782481004.509336:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301295360 00000100:00100000:1.0:1782481004.509339:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301295360 00000100:00100000:1.0:1782481004.509350:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301295872 00000100:00100000:1.0:1782481004.509352:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301295872 00000100:00100000:1.0:1782481004.509363:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782481004.509370:0:19137:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301295488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509397:0:19137:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301295488:12345-0@lo:400:kworker.0 Request processed in 28us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509402:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782481004.509411:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782481004.509416:0:19137:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301296000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509439:0:19137:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301296000:12345-0@lo:400:kworker.0 Request processed in 23us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509445:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782481004.509454:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782481004.509459:0:19137:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301295360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509497:0:19137:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301295360:12345-0@lo:400:kworker.0 Request processed in 38us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509504:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782481004.509517:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782481004.509524:0:19137:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301295872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509544:0:19137:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301295872:12345-0@lo:400:kworker.0 Request processed in 22us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509550:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782481004.509574:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301295232 00000100:00100000:1.0:1782481004.509578:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301295232 00000100:00100000:1.0:1782481004.509594:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301295744 00000100:00100000:1.0:1782481004.509596:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301295744 00000100:00100000:1.0:1782481004.509606:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782481004.509612:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301295232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509641:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301295232:12345-0@lo:400:kworker.0 Request processed in 29us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509647:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782481004.509657:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782481004.509662:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301295744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509719:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301295744:12345-0@lo:400:kworker.0 Request processed in 56us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481004.509725:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1782481004.509754:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782481004.509758:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782481004.509760:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782481004.509762:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782481004.509791:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b875bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301295360:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509810:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb5920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301295872:0@lo:400:kworker.0 00010000:00080000:1.0:1782481004.509821:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb5921500 x1869066301296384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481004.509832:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb5921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301296384:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509841:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b875bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301295232:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509849:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b875bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301295744:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509857:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb5923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1869066301296256:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509890:0:3650:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1782481004.509895:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f5cb598c000, transno 8589934596 00000004:00080000:1.0:1782481004.509906:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1782481004.509920:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b875bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301295488:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509931:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb5920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301296000:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509940:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb5923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1869066301296512:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509948:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b875bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e024ba8a-c811-4940-9393-bca6a08f819f:3650:1869066301295104:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509956:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b875bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301295616:0@lo:400:kworker.0 00000100:00100000:1.0:1782481004.509966:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb5920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869066301296128:0@lo:400:kworker.0 00010000:00080000:1.0:1782481004.509975:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb5920700 x1869066301296640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481004.509985:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb5920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1869066301296640:0@lo:400:kworker.0 00000100:00100000:2.0:1782481004.510919:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782481004.510934:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb598c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301296768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782481004.510983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481004.511018:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301296768 00000100:00100000:2.0:1782481004.511024:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301296768 00000100:00100000:2.0:1782481004.511061:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782481004.511070:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301296768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782481004.511096:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1782481004.511138:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301296768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481004.511145:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782481004.511199:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb598c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301296768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782481004.511411:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481004.511495:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782481004.511504:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb598c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301296896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782481004.511541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481004.511565:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301296896 00000100:00100000:2.0:1782481004.511570:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301296896 00000100:00100000:2.0:1782481004.511595:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782481004.511602:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301296896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782481004.511621:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782481004.511657:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301296896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481004.511663:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782481004.511800:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301297024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782481004.511819:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb598c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301296896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782481004.511855:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481004.511999:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301297024 00000100:00100000:2.0:1782481004.512003:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301297024 00000100:00100000:2.0:1782481004.512035:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782481004.512042:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301297024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782481004.512054:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1782481004.512093:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301297024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481004.512102:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782481004.512777:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301297024:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1782481004.523553:0:20471:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 09:36:43 (1782481003) 00010000:00010000:0.0:1782481005.538731:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481006.558395:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782481006.559074:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:0.0:1782481006.559087:0:17074:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:1.0:1782481006.559452:0:17135:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:1.0:1782481006.559465:0:17135:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00100000:2.0:1782481007.579932:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782481007.580324:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481007.580393:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301297280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782481007.580461:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481007.580663:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301297280 00000100:00100000:0.0:1782481007.580670:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301297280 00000100:00100000:0.0:1782481007.580744:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782481007.580776:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301297280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782481007.580814:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1782481007.580883:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301297280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481007.580891:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782481007.581145:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301297280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782481007.581467:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301297152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782481007.581505:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481007.581603:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301297152 00000100:00100000:0.0:1782481007.581608:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301297152 00000100:00100000:0.0:1782481007.581714:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782481007.581724:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301297152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782481007.581751:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782481007.581809:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301297152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481007.581816:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782481007.581890:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301297152:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782481007.581948:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782481008.091984:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782481008.092007:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301297408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782481008.092085:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.092197:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301297408 00000100:00100000:0.0:1782481008.092205:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301297408 00000100:00100000:0.0:1782481008.092263:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782481008.092273:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301297408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782481008.092308:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782481008.092361:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301297408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481008.092369:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782481008.092498:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301297408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782481008.218779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481008.218827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481008.218923:0:17132:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281303936 00000100:00100000:2.0:1782481008.218933:0:17132:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281303936 00000100:00100000:2.0:1782481008.218992:0:17132:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281303808 00000100:00100000:2.0:1782481008.218995:0:17132:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281303808 00000100:00100000:2.0:1782481008.219027:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1782481008.219035:0:17132:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577539e-a996-4b7d-ae92-f0069d2fe94c+14:2407:x1869066281303936:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481008.219065:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481008.219086:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5cc2153600/0x65dae4c042ee3f15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df474 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481008.219114:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481008.219164:0:17132:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577539e-a996-4b7d-ae92-f0069d2fe94c+13:2407:x1869066281303936:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 129us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481008.219171:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1782481008.219190:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:2.0:1782481008.219196:0:17132:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577539e-a996-4b7d-ae92-f0069d2fe94c+12:2407:x1869066281303808:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481008.219203:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481008.219212:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5cb79aac00/0x65dae4c042ee3f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df443 expref: 12 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481008.219221:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481008.219239:0:17132:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577539e-a996-4b7d-ae92-f0069d2fe94c+11:2407:x1869066281303808:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 44us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481008.219246:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:3.0:1782481008.221544:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481008.221678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481008.221858:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281304192 00000100:00100000:0.0:1782481008.221869:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281304192 00000100:00100000:0.0:1782481008.221942:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00080000:1.0:1782481008.221948:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782481008.221956:0:19137:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+6:2403:x1869066281304192:12345-192.168.204.11@tcp:9:umount.0 00000020:00000080:0.0:1782481008.221992:0:19137:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3f38 00000020:00010000:0.0:1782481008.222012:0:19137:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f5b87806800: total 0 00000100:00080000:0.0:1782481008.222017:0:19137:0:(import.c:65:import_set_state_nolock()) ffff9f5b87805800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782481008.222068:0:19137:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000020:00010000:1.0:1782481008.222073:0:18249:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f5b87806800: total 0 00010000:00010000:1.0:1782481008.222079:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481008.222150:0:18249:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f5b87806800, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1782481008.222189:0:18249:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1782481008.222193:0:18249:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1782481008.222220:0:18249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dbaa997/0x65dae4c042ee42a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df60a expref: 4 pid: 19539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481008.222226:0:19137:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+4:2403:x1869066281304192:12345-192.168.204.11@tcp:9:umount.0 Request processed in 271us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481008.222244:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 32 00010000:00010000:1.0:1782481008.222259:0:18249:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f5b87806800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1782481008.222275:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481008.222278:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481008.222280:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481008.222446:0:17132:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281304320 00000100:00100000:2.0:1782481008.222451:0:17132:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281304320 00000100:00100000:2.0:1782481008.222493:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:2.0:1782481008.222501:0:17132:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577539e-a996-4b7d-ae92-f0069d2fe94c+11:2404:x1869066281304320:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481008.222512:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481008.222522:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca7d74e00/0x65dae4c042ee3f9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df52a expref: 11 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481008.222533:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481008.222574:0:17132:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577539e-a996-4b7d-ae92-f0069d2fe94c+10:2404:x1869066281304320:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 73us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481008.222581:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:3.0:1782481008.232866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481008.232958:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281305216 00000100:00100000:1.0:1782481008.232968:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281305216 00000100:00100000:1.0:1782481008.233050:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:1.0:1782481008.233059:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+12:2403:x1869066281305216:12345-192.168.204.11@tcp:39:umount.0 00000020:00000080:1.0:1782481008.233092:0:17094:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3f23 00000020:00010000:1.0:1782481008.233120:0:17094:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f5cb1d1a800: total 0 00000100:00080000:1.0:1782481008.233125:0:17094:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1d1d800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1782481008.233129:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:1.0:1782481008.233177:0:17094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000020:00010000:3.0:1782481008.233189:0:17083:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f5cb1d1a800: total 0 00010000:00010000:3.0:1782481008.233247:0:17083:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f5cb1d1a800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1782481008.233282:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f5cb5ce7a00) 00010000:00010000:3.0:1782481008.233287:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782481008.233296:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75600/0x65dae4c042ee42b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df611 expref: 11 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.233320:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f5c8a1f7c00) 00010000:00010000:3.0:1782481008.233330:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782481008.233337:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cc2153000/0x65dae4c042ee3fee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df531 expref: 10 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.233359:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f5cb5ce7a00) 00010000:00010000:3.0:1782481008.233365:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1782481008.233365:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c447ea9-c05e-4f74-a91c-16472b83b6c2+9:2403:x1869066281305216:12345-192.168.204.11@tcp:39:umount.0 Request processed in 304us (506us total) trans 8589934636 rc 0/0 00010000:00010000:3.0:1782481008.233372:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cc2152e00/0x65dae4c042ee41f4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df5d2 expref: 9 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481008.233379:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 76 00010000:00010000:3.0:1782481008.233473:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f5cb5ce7b00) 00010000:00010000:3.0:1782481008.233477:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782481008.233482:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5600/0x65dae4c042ee40ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df570 expref: 7 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.233501:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f5c8a1f7100) 00010000:00010000:3.0:1782481008.233503:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782481008.233507:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cc2153e00/0x65dae4c042ee400a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df538 expref: 6 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.233520:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5cb5ce7d00) 00010000:00010000:3.0:1782481008.233523:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782481008.233526:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8ed28e00/0x65dae4c042ee4049 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df546 expref: 5 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.233542:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f5c8a1f7000) 00010000:00010000:3.0:1782481008.233544:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782481008.233549:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde800/0x65dae4c042ee424f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df5e7 expref: 4 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.233572:0:17083:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f5cb1d1a800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1782481008.233587:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481008.233590:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481008.233592:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481008.245532:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481008.246244:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281305344 00000100:00100000:1.0:1782481008.246256:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281305344 00000100:00100000:1.0:1782481008.246348:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:1.0:1782481008.246360:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+5:2403:x1869066281305344:12345-192.168.204.11@tcp:39:umount.0 00000020:00000080:1.0:1782481008.246393:0:20235:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3f2a 00000100:00080000:1.0:1782481008.246408:0:20235:0:(import.c:65:import_set_state_nolock()) ffff9f5cb654f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782481008.246439:0:20235:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1782481008.246669:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c447ea9-c05e-4f74-a91c-16472b83b6c2+3:2403:x1869066281305344:12345-192.168.204.11@tcp:39:umount.0 Request processed in 311us (1159us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782481008.246677:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00080000:2.0:1782481008.247283:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782481008.247612:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481008.606536:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481008.960921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481008.960965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481008.961065:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281305472 00000100:00100000:1.0:1782481008.961075:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281305472 00000100:00100000:1.0:1782481008.961177:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281305600 00000100:00100000:1.0:1782481008.961181:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281305600 00000100:00100000:1.0:1782481008.961207:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 79 00000100:00100000:1.0:1782481008.961217:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+6:2406:x1869066281305472:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782481008.961288:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+6:2406:x1869066281305472:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 74us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481008.961295:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 79 00000100:00100000:1.0:1782481008.961311:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 80 00000100:00100000:1.0:1782481008.961318:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2406:x1869066281305600:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1782481008.961357:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2406:x1869066281305600:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 40us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481008.961364:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 80 00000100:00080000:2.0:1782481008.961950:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782481008.961956:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782481009.628518:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481009.628615:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb598e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301297536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782481009.628682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481009.628788:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782481009.628795:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301297664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782481009.628820:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.629241:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782481009.629251:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301297792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782481009.629278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.629364:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301298176:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.629392:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.629407:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1869066301298688:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.629442:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.629463:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782481009.629469:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301298048:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.629519:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.629542:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869066301298560:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.629561:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.629577:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1869066301299072:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.629594:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.629633:0:17096:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301298176 00000100:00100000:0.0:1782481009.629640:0:17096:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301298176 00000100:00100000:0.0:1782481009.629676:0:17096:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301298688 00000100:00100000:0.0:1782481009.629686:0:17096:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301298688 00000100:00100000:0.0:1782481009.629730:0:17096:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301298560 00000100:00100000:0.0:1782481009.629733:0:17096:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301298560 00000100:00100000:0.0:1782481009.629746:0:17096:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301299072 00000100:00100000:0.0:1782481009.629748:0:17096:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301299072 00000100:00100000:0.0:1782481009.630083:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782481009.630092:0:17096:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301298176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630147:0:17096:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301298176:12345-0@lo:400:kworker.0 Request processed in 56us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481009.630154:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782481009.630172:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782481009.630178:0:17096:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869066301298688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630204:0:17096:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1869066301298688:12345-0@lo:400:kworker.0 Request processed in 27us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481009.630210:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782481009.630221:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782481009.630226:0:17096:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869066301298560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630250:0:17096:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869066301298560:12345-0@lo:400:kworker.0 Request processed in 24us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481009.630255:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782481009.630265:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782481009.630271:0:17096:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869066301299072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630295:0:17096:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1869066301299072:12345-0@lo:400:kworker.0 Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481009.630301:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782481009.630325:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e024ba8a-c811-4940-9393-bca6a08f819f:3648:1869066301297920:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630363:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.630388:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301298432:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.630428:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1869066301298944:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630448:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.630466:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782481009.630471:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301298304:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.630505:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1869066301298816:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630522:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.630542:0:17086:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301297920 00000100:00100000:0.0:1782481009.630546:0:17086:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301297920 00000100:00100000:0.0:1782481009.630572:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1782481009.630579:0:17086:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c8a183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e024ba8a-c811-4940-9393-bca6a08f819f+24:3648:x1869066301297920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630610:0:17086:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c8a183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e024ba8a-c811-4940-9393-bca6a08f819f+24:3648:x1869066301297920:12345-0@lo:400:kworker.0 Request processed in 32us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481009.630616:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1782481009.630641:0:17095:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301298944 00000100:00100000:0.0:1782481009.630645:0:17095:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301298944 00000100:00100000:0.0:1782481009.630662:0:17095:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301298816 00000100:00100000:0.0:1782481009.630665:0:17095:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301298816 00000100:00100000:0.0:1782481009.630678:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782481009.630683:0:17095:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869066301298944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630734:0:17095:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869066301298944:12345-0@lo:400:kworker.0 Request processed in 51us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481009.630741:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782481009.630786:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782481009.630793:0:17095:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869066301298816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.630821:0:17095:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869066301298816:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481009.630827:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782481009.631078:0:18604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301298432 00000100:00100000:1.0:1782481009.631083:0:18604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301298432 00000100:00100000:1.0:1782481009.631116:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782481009.631123:0:18604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301298432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.631156:0:18604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301298432:12345-0@lo:400:kworker.0 Request processed in 33us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481009.631162:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782481009.631222:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301297536 00000100:00100000:1.0:1782481009.631226:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301297536 00000100:00100000:1.0:1782481009.631244:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301297664 00000100:00100000:1.0:1782481009.631247:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301297664 00000100:00100000:1.0:1782481009.631259:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301297792 00000100:00100000:1.0:1782481009.631261:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301297792 00000100:00100000:1.0:1782481009.631275:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782481009.631281:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301297536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782481009.631301:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782481009.631332:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87972a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301297536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481009.631338:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782481009.631348:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782481009.631353:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301297664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782481009.631400:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1782481009.631427:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301297664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481009.631441:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782481009.631453:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782481009.631459:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301297792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782481009.631468:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1782481009.631493:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301297792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (2214us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481009.631497:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782481009.631535:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301297664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782481009.631551:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb598e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301297536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782481009.631597:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301298048 00000100:00100000:1.0:1782481009.631601:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301298048 00000100:00100000:1.0:1782481009.631618:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301298304 00000100:00100000:1.0:1782481009.631620:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301298304 00000100:00100000:1.0:1782481009.631633:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782481009.631638:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301298048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.631670:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301298048:12345-0@lo:400:kworker.0 Request processed in 32us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481009.631676:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782481009.631687:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782481009.631717:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301298304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.631744:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301298304:12345-0@lo:400:kworker.0 Request processed in 52us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481009.631750:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782481009.631781:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301298304:0@lo:400:kworker.0 00010000:00080000:1.0:1782481009.631805:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb63adc00 x1869066301298816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481009.631815:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1869066301298816:0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.631825:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e024ba8a-c811-4940-9393-bca6a08f819f:3648:1869066301297920:0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.631835:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301298432:0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.631844:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1869066301298944:0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.633097:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301297792:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1782481009.633295:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782481009.633301:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782481009.633304:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782481009.633306:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1782481009.633414:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c447ea9-c05e-4f74-a91c-16472b83b6c2 00000020:00000080:3.0:1782481009.633419:0:19416:0:(genops.c:906:class_export_put()) final put ffff9f5b87806800/9c447ea9-c05e-4f74-a91c-16472b83b6c2 00000100:00100000:0.0:1782481009.633508:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869066301298560:0@lo:400:kworker.0 00010000:00080000:0.0:1782481009.633536:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb63aed80 x1869066301299072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481009.633547:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1869066301299072:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.633559:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301298176:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.633570:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1869066301298688:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.633591:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301298048:0@lo:400:kworker.0 00000001:00100000:3.0:1782481009.633633:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae528aa1-eae9-49ff-a679-4421f2ee4d3a 00000020:00000080:3.0:1782481009.633637:0:19416:0:(genops.c:906:class_export_put()) final put ffff9f5c90285800/ae528aa1-eae9-49ff-a679-4421f2ee4d3a 00000001:00100000:1.0:1782481009.633681:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae528aa1-eae9-49ff-a679-4421f2ee4d3a 00000020:00000080:1.0:1782481009.633684:0:18598:0:(genops.c:906:class_export_put()) final put ffff9f5c90281800/ae528aa1-eae9-49ff-a679-4421f2ee4d3a 00000020:00000080:2.0:1782481009.638744:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b87806800/9c447ea9-c05e-4f74-a91c-16472b83b6c2 for lustre-OST0001 00000020:00000080:2.0:1782481009.638826:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b87805800 for lustre-OST0001 00000020:00000080:0.0:1782481009.647644:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c90285800/ae528aa1-eae9-49ff-a679-4421f2ee4d3a for lustre-OST0001 00000020:00000080:0.0:1782481009.647734:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c90283000 for lustre-OST0001 00000001:00100000:1.0:1782481009.649205:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c447ea9-c05e-4f74-a91c-16472b83b6c2 00000020:00000080:1.0:1782481009.649214:0:18598:0:(genops.c:906:class_export_put()) final put ffff9f5c90286000/9c447ea9-c05e-4f74-a91c-16472b83b6c2 00000020:00000080:3.0:1782481009.652585:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c90281800/ae528aa1-eae9-49ff-a679-4421f2ee4d3a for lustre-OST0000 00000020:00000080:3.0:1782481009.652688:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c90284800 for lustre-OST0000 00000020:00000080:3.0:1782481009.654201:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c90286000/9c447ea9-c05e-4f74-a91c-16472b83b6c2 for lustre-OST0000 00000020:00000080:3.0:1782481009.654240:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c90280800 for lustre-OST0000 00000100:00100000:3.0:1782481010.041899:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481010.041941:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481010.041990:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481010.042030:0:17081:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281305728 00000100:00100000:1.0:1782481010.042040:0:17081:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281305728 00000100:00100000:1.0:1782481010.042115:0:17081:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281305984 00000100:00100000:1.0:1782481010.042118:0:17081:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281305984 00000100:00100000:1.0:1782481010.042132:0:17081:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281305856 00000100:00100000:1.0:1782481010.042135:0:17081:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281305856 00000100:00100000:1.0:1782481010.042150:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1782481010.042159:0:17081:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577539e-a996-4b7d-ae92-f0069d2fe94c+12:2406:x1869066281305728:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782481010.042175:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481010.042196:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca7d75e00/0x65dae4c042ee3f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df4b3 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481010.042208:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00010000:00010000:1.0:1782481010.042215:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481010.042222:0:17132:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577539e-a996-4b7d-ae92-f0069d2fe94c+11:2406:x1869066281305984:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481010.042233:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481010.042255:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee3f93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df523 expref: 11 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481010.042265:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481010.042287:0:17081:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577539e-a996-4b7d-ae92-f0069d2fe94c+10:2406:x1869066281305728:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 126us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481010.042296:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:2.0:1782481010.042302:0:17132:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577539e-a996-4b7d-ae92-f0069d2fe94c+10:2406:x1869066281305984:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 81us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481010.042311:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:1.0:1782481010.047484:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1782481010.047514:0:17081:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577539e-a996-4b7d-ae92-f0069d2fe94c+8:2406:x1869066281305856:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782481010.047536:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481010.047560:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca7d74c00/0x65dae4c042ee3f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df4e4 expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481010.047577:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481010.047633:0:17081:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577539e-a996-4b7d-ae92-f0069d2fe94c+7:2406:x1869066281305856:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 134us (5641us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481010.047641:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1782481010.048270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481010.048312:0:17095:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281306240 00000100:00100000:1.0:1782481010.048319:0:17095:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281306240 00000100:00100000:1.0:1782481010.048371:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:1.0:1782481010.048379:0:17095:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+6:2403:x1869066281306240:12345-192.168.204.11@tcp:39:umount.0 00000100:00080000:2.0:1782481010.048398:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1782481010.048415:0:17095:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3f62 00000020:00010000:1.0:1782481010.048426:0:17095:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f5b883fe800: total 0 00000100:00080000:1.0:1782481010.048431:0:17095:0:(import.c:65:import_set_state_nolock()) ffff9f5b883fe000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782481010.048464:0:17095:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:1.0:1782481010.048579:0:17095:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2403:x1869066281306240:12345-192.168.204.11@tcp:39:umount.0 Request processed in 200us (311us total) trans 8589934637 rc 0/0 00000100:00100000:1.0:1782481010.048587:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 78 00000020:00010000:2.0:1782481010.052446:0:17082:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f5b883fe800: total 0 00010000:00010000:2.0:1782481010.052524:0:17082:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f5b883fe800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782481010.052562:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5cb5ce7d00) 00010000:00010000:2.0:1782481010.052567:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782481010.052579:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5b880f6200/0x65dae4c042ee4057 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df54d expref: 4 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481010.052622:0:17082:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f5b883fe800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1782481010.052637:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481010.052639:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481010.052641:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481010.066644:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481010.066855:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281306368 00000100:00100000:2.0:1782481010.066930:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281306368 00000100:00100000:2.0:1782481010.067000:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 79 00000100:00100000:2.0:1782481010.067011:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+5:2403:x1869066281306368:12345-192.168.204.11@tcp:39:umount.0 00000020:00000080:2.0:1782481010.067149:0:20235:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3f69 00000100:00080000:2.0:1782481010.067159:0:20235:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e60800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1782481010.067235:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:2.0:1782481010.067360:0:20235:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1782481010.067526:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae528aa1-eae9-49ff-a679-4421f2ee4d3a+3:2403:x1869066281306368:12345-192.168.204.11@tcp:39:umount.0 Request processed in 516us (891us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1782481010.067535:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 79 00010000:00010000:1.0:1782481010.073583:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481010.099175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481010.099329:0:17089:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281306624 00000100:00100000:1.0:1782481010.099339:0:17089:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281306624 00000100:00100000:1.0:1782481010.099401:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 169 00000100:00100000:1.0:1782481010.099411:0:17089:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c8a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577539e-a996-4b7d-ae92-f0069d2fe94c+7:2403:x1869066281306624:12345-192.168.204.11@tcp:251:umount.0 00000020:00000080:1.0:1782481010.099458:0:17089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3f00 00000020:00010000:1.0:1782481010.099479:0:17089:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f5c90281000: total 0 00000100:00080000:1.0:1782481010.099484:0:17089:0:(import.c:65:import_set_state_nolock()) ffff9f5c90286800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782481010.099596:0:17089:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c8a182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577539e-a996-4b7d-ae92-f0069d2fe94c+3:2403:x1869066281306624:12345-192.168.204.11@tcp:251:umount.0 Request processed in 185us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481010.099604:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 169 00000020:00010000:3.0:1782481010.101349:0:17083:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f5c90281000: total 0 00010000:00010000:3.0:1782481010.101358:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481010.101416:0:17083:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f5c90281000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782481010.101964:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca7d75400/0x65dae4c042ee3f07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df43c expref: 2 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481010.102002:0:17083:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f5c90281000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1782481010.102019:0:17083:0:(genops.c:906:class_export_put()) final put ffff9f5c90281000/b577539e-a996-4b7d-ae92-f0069d2fe94c 00010000:00010000:3.0:1782481010.102296:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481010.102299:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481010.102302:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782481010.102328:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c90281000/b577539e-a996-4b7d-ae92-f0069d2fe94c for MGS 00000020:00000080:0.0:1782481010.102425:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c90286800 for MGS 00000040:00080000:0.0:1782481010.268244:0:17130:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782481010.268254:0:17130:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782481010.268272:0:17130:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1782481010.268281:0:17130:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1782481010.652132:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481011.681564:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782481011.998128:0:20666:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1782481012.003840:0:20666:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1782481012.003903:0:20666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481012.003938:0:20666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481012.003946:0:20666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481012.003953:0:20666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481012.003974:0:20666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782481012.003981:0:20666:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1782481012.004006:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782481012.004030:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782481012.004037:0:20666:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782481012.004063:0:20666:0:(import.c:65:import_set_state_nolock()) ffff9f5c86e70800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1782481012.004152:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481012.004160:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.004168:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111c800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481012.004172:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.004181:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481012.004183:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869066301299200:0@lo:39:umount.0 10000000:00010000:3.0:1782481012.004194:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481012.004201:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782481012.004204:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782481012.004207:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1782481012.004232:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.004239:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782481012.004252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782481012.004268:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481012.004281:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e024ba8a-c811-4940-9393-bca6a08f819f:3650:1869066301299328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481012.004287:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee3ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3aca expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.004298:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481012.004300:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481012.004302:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481012.004315:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481012.004332:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301299200 00000100:00100000:3.0:1782481012.004338:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301299200 00000100:00100000:3.0:1782481012.004392:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782481012.004402:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb598e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869066301299200:12345-0@lo:39:umount.0 00000020:00000080:3.0:1782481012.004429:0:17094:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3af4 00000100:00080000:3.0:1782481012.004436:0:17094:0:(import.c:65:import_set_state_nolock()) ffff9f5c8857f800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1782481012.004546:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb598e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1869066301299200:12345-0@lo:39:umount.0 Request processed in 144us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481012.004554:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:3.0:1782481012.004565:0:17094:0:(genops.c:906:class_export_put()) final put ffff9f5c8857a000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1782481012.004599:0:17081:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301299328 00000100:00100000:3.0:1782481012.004602:0:17081:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301299328 00000100:00100000:3.0:1782481012.004628:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481012.004633:0:17081:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e024ba8a-c811-4940-9393-bca6a08f819f+24:3650:x1869066301299328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481012.004643:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481012.004658:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5cb79aae00/0x65dae4c042ee3aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3ac3 expref: 24 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.004669:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1782481012.004718:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8857a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1782481012.004725:0:17081:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e024ba8a-c811-4940-9393-bca6a08f819f+23:3650:x1869066301299328:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481012.004742:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481012.004837:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e024ba8a-c811-4940-9393-bca6a08f819f:3650:1869066301299328:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1782481012.004847:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c8857f800 for lustre-MDT0000 00000100:00080000:3.0:1782481012.004883:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c86e70800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782481012.004902:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869066301299200:0@lo:39:umount.0 00000100:00080000:2.0:1782481012.005179:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782481012.005183:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782481012.005188:0:20666:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782481012.007154:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481012.007679:0:20666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007871:0:20666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007879:0:20666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007885:0:20666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007903:0:20666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481012.007909:0:20666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007916:0:20666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007922:0:20666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007928:0:20666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007939:0:20666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782481012.007946:0:20666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007951:0:20666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007966:0:20666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007972:0:20666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007981:0:20666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1782481012.007986:0:20666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007992:0:20666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.007999:0:20666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.008005:0:20666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481012.008011:0:20666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1782481012.008014:0:20666:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1782481012.008051:0:20666:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1782481012.008055:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1782481012.008059:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481012.008065:0:20666:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1782481012.008072:0:20666:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f5b86b8f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782481012.008155:0:20666:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f5b86b8c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782481012.008159:0:20666:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f5cb1db7800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782481012.008170:0:20666:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9f5c88579000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782481012.008176:0:20666:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9f5b883fe800 ae528aa1-eae9-49ff-a679-4421f2ee4d3a 192.168.204.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1782481012.008180:0:20666:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9f5cb1d1a800 9c447ea9-c05e-4f74-a91c-16472b83b6c2 192.168.204.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934635 stale:0 00000020:00080000:2.0:1782481012.008185:0:20666:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9f5b87a20000) has exports, disconnecting them 00000020:00080000:2.0:1782481012.008189:0:20666:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f5b86b8f000), last request at 1782481009 00000020:00000080:2.0:1782481012.008195:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3d2b 00000100:00080000:2.0:1782481012.008212:0:20666:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e85000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782481012.008257:0:20666:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5b86b8f000): rc 0 00000020:00000080:2.0:1782481012.008260:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b86b8f000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1782481012.008266:0:18249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00080000:2.0:1782481012.008274:0:20666:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f5b86b8c000), last request at 1782481009 00010000:00010000:3.0:1782481012.008275:0:18249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782481012.008279:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3c91 00000100:00080000:2.0:1782481012.008286:0:20666:0:(import.c:65:import_set_state_nolock()) ffff9f5b86b8d000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1782481012.008288:0:18249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fdde600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481012.008293:0:18249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008302:0:18249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481012.008310:0:18249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481012.008316:0:18249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782481012.008319:0:18249:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1782481012.008321:0:18249:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1782481012.008355:0:18249:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008362:0:18249:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481012.008389:0:18249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008406:0:18249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde600/0x65dae4c042ee3a14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3a1b expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008417:0:18249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782481012.008420:0:18249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008425:0:18249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111dc00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481012.008428:0:18249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008435:0:18249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481012.008442:0:18249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481012.008448:0:18249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1782481012.008450:0:18249:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1782481012.008452:0:18249:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1782481012.008467:0:18249:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008474:0:18249:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481012.008480:0:18249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008490:0:18249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111dc00/0x65dae4c042ee3d5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3d63 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782481012.008499:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86b8f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:3.0:1782481012.008514:0:18249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481012.008518:0:18249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008524:0:18249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8ed29800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481012.008527:0:18249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008534:0:18249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782481012.008542:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1e85000 for lustre-MDT0000 10000000:00010000:3.0:1782481012.008551:0:18249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481012.008556:0:18249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782481012.008557:0:18249:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782481012.008559:0:18249:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782481012.008575:0:18249:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008580:0:18249:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481012.008597:0:18249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008603:0:18249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c8ed29800/0x65dae4c042ee3fcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3fd2 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481012.008607:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e024ba8a-c811-4940-9393-bca6a08f819f:3647:1869066301299456:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782481012.008613:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481012.008617:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481012.008619:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481012.008619:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.008625:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481012.008626:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fdde400 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1782481012.008629:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481012.008636:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481012.008648:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481012.008653:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1782481012.008656:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1782481012.008658:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:1.0:1782481012.008679:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1782481012.008688:0:20666:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5b86b8c000): rc 0 00000020:00000080:2.0:1782481012.008691:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b86b8c000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:1.0:1782481012.008773:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782481012.008782:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e024ba8a-c811-4940-9393-bca6a08f819f:3647:1869066301299584:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1782481012.008791:0:20666:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f5cb1db7800), last request at 1782480941 00000020:00000080:2.0:1782481012.008795:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3be2 00000100:00080000:2.0:1782481012.008800:0:20666:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1db0000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782481012.008803:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1782481012.008829:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86b8c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1782481012.008871:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b86b8d000 for lustre-MDT0000 00000100:00100000:1.0:1782481012.008887:0:17079:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301299456 00000100:00100000:1.0:1782481012.008892:0:17079:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301299456 00000100:00100000:3.0:1782481012.008908:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301299712:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1782481012.008917:0:20666:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5cb1db7800): rc 0 00000020:00000080:2.0:1782481012.008920:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5cb1db7800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1782481012.008927:0:20666:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f5c88579000), last request at 1782480941 00000020:00000080:2.0:1782481012.008931:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b87 00000100:00100000:1.0:1782481012.008932:0:17079:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301299584 00000100:00080000:2.0:1782481012.008935:0:20666:0:(import.c:65:import_set_state_nolock()) ffff9f5cb654d000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782481012.008935:0:17079:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301299584 00000020:00000080:2.0:1782481012.008943:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1db7800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1782481012.008944:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1782481012.008977:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1db0000 for lustre-MDT0000 00010000:00010000:0.0:1782481012.008994:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1782481012.008998:0:20666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00010000:00010000:0.0:1782481012.009006:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782481012.009033:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481012.009041:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde400/0x65dae4c042ee3a06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3a0d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481012.009051:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481012.009053:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481012.009055:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1782481012.009156:0:20666:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5c88579000): rc 0 00000004:00000080:2.0:1782481012.009162:0:20666:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbdd141463ae0 00000100:00080000:2.0:1782481012.009180:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782481012.009184:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782481012.010369:0:20666:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1782481012.010453:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782481012.010464:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301299840:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1782481012.010494:0:20666:0:(import.c:65:import_set_state_nolock()) ffff9f5b865d9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1782481012.010513:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481012.010580:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb598c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301299968:0@lo:39:umount.0 00000100:00100000:0.0:1782481012.010613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782481012.010909:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782481012.010913:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1782481012.010928:0:20666:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1782481012.010980:0:20666:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1782481012.010992:0:20666:0:(import.c:65:import_set_state_nolock()) ffff9f5c88529800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1782481012.011000:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782481012.011002:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1782481012.011009:0:20666:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1782481012.011073:0:20666:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1782481012.011162:0:20666:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5cd7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1782481012.011200:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9f5b87a20000) has no exports 00000100:00100000:1.0:1782481012.011277:0:17079:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301299712 00000100:00100000:1.0:1782481012.011284:0:17079:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301299712 00010000:00010000:3.0:1782481012.011407:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481012.011413:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481012.011462:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301299968 00000100:00100000:3.0:1782481012.011468:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301299968 00000100:00100000:3.0:1782481012.011518:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782481012.011527:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869066301299968:12345-0@lo:39:umount.0 00000020:00000080:3.0:1782481012.011641:0:17100:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3c0c 00000100:00080000:3.0:1782481012.011649:0:17100:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1d18000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782481012.011733:0:17100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1782481012.011927:0:17079:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301299840 00000100:00100000:1.0:1782481012.011932:0:17079:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301299840 00010000:00010000:2.0:1782481012.011936:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481012.011949:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782481012.011955:0:17079:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e024ba8a-c811-4940-9393-bca6a08f819f+26:3647:x1869066301299456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481012.011966:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481012.011997:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee3a1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3a14 expref: 26 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481012.012012:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481012.012071:0:17079:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e024ba8a-c811-4940-9393-bca6a08f819f+25:3647:x1869066301299456:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481012.012079:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782481012.012148:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e024ba8a-c811-4940-9393-bca6a08f819f:3647:1869066301299456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782481012.012170:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782481012.012178:0:17079:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e024ba8a-c811-4940-9393-bca6a08f819f+24:3647:x1869066301299584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481012.012185:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481012.012194:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5cb79aba00/0x65dae4c042ee3d63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3d5c expref: 24 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481012.012205:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481012.012209:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3646:x1869066301299968:12345-0@lo:39:umount.0 Request processed in 680us (1592us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1782481012.012218:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782481012.012240:0:17079:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e024ba8a-c811-4940-9393-bca6a08f819f+23:3647:x1869066301299584:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481012.012248:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782481012.012291:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e024ba8a-c811-4940-9393-bca6a08f819f:3647:1869066301299584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481012.012329:0:17132:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e024ba8a-c811-4940-9393-bca6a08f819f+23:3649:x1869066301299712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481012.012339:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481012.012349:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5cb79ab600/0x65dae4c042ee3fd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3fcb expref: 23 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481012.012359:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782481012.012377:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb598f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301300096:0@lo:9:umount.0 00000100:00100000:3.0:1782481012.012430:0:17132:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e024ba8a-c811-4940-9393-bca6a08f819f+22:3649:x1869066301299712:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (3485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481012.012463:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301299712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782481012.012730:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481012.012754:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb598fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301300224:0@lo:9:umount.0 00000100:00100000:0.0:1782481012.012776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782481012.012808:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b865d9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782481012.012815:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb598c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301299968:0@lo:39:umount.0 00000100:00100000:2.0:1782481012.012826:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301300096 00000100:00100000:2.0:1782481012.012831:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301300096 00000100:00080000:0.0:1782481012.012848:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782481012.012867:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301300224 00000100:00100000:2.0:1782481012.012870:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301300224 00000100:00100000:0.0:1782481012.012876:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782481012.012884:0:18603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869066301300096:12345-0@lo:9:umount.0 00000100:00100000:2.0:1782481012.012893:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000020:00000080:0.0:1782481012.012902:0:18603:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3d6a 00000100:00100000:2.0:1782481012.012905:0:19137:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1869066301300224:12345-0@lo:9:umount.0 00000100:00080000:0.0:1782481012.012908:0:18603:0:(import.c:65:import_set_state_nolock()) ffff9f5b86653000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1782481012.012916:0:19137:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3d71 00000100:00080000:2.0:1782481012.012921:0:19137:0:(import.c:65:import_set_state_nolock()) ffff9f5b87807000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782481012.012945:0:18603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000001:00000004:2.0:1782481012.012946:0:19137:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1782481012.013049:0:18603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3646:x1869066301300096:12345-0@lo:9:umount.0 Request processed in 166us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481012.013057:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782481012.013058:0:19137:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3646:x1869066301300224:12345-0@lo:9:umount.0 Request processed in 153us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481012.013064:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1782481012.013075:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782481012.013090:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c88529800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782481012.013107:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782481012.013109:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782481012.013112:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb598f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301300096:0@lo:9:umount.0 00000100:00080000:0.0:1782481012.013123:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5cd7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782481012.013130:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782481012.013132:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782481012.013134:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb598fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301300224:0@lo:9:umount.0 00000100:00100000:1.0:1782481012.013404:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782481012.013412:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782481012.013425:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782481012.013434:0:17079:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e024ba8a-c811-4940-9393-bca6a08f819f+20:3649:x1869066301299840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481012.013444:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481012.013447:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481012.013453:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481012.013458:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111c600/0x65dae4c042ee3a0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3a06 expref: 20 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481012.013471:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481012.013512:0:17079:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e024ba8a-c811-4940-9393-bca6a08f819f+19:3649:x1869066301299840:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481012.013518:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782481012.013637:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301299840:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1782481012.023355:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9f5b87a20000) has no exports 00000020:00000080:1.0:1782481012.070660:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a61 00000020:00000080:1.0:1782481012.070676:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5cb5cd0000/lustre-QMT0000_UUID 00000020:01000000:1.0:1782481012.070838:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1782481012.070923:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb5cd0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1782481012.070950:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481012.070960:0:20666:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782481012.070964:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9f5b86ba99c0) has no exports 00000020:00000080:2.0:1782481012.071364:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a5a 00000020:00000080:2.0:1782481012.071369:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5cb792d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782481012.071429:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb792d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782481012.071496:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782481012.071504:0:20666:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1782481012.071507:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5cb8c9a000/lustre-QMT0000_UUID 00000020:00000080:2.0:1782481012.071509:0:20666:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb8c9a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1782481012.071513:0:20666:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1782481012.700366:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481012.700580:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301300352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782481012.700728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481012.701409:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301300352 00000100:00100000:2.0:1782481012.701421:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301300352 00000100:00100000:2.0:1782481012.701519:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782481012.701531:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301300352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782481012.701564:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782481012.701632:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301300352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481012.701639:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782481012.701742:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301300352:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782481012.702097:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782481012.707269:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301300480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782481012.707366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481012.707456:0:17099:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301300480 00000100:00100000:3.0:1782481012.707466:0:17099:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301300480 00000100:00100000:3.0:1782481012.707516:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782481012.707524:0:17099:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1869066301300480:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1782481012.707532:0:17099:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1782481012.707643:0:17099:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1869066301300480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (275us total) trans 0 rc -107/-107 00000100:00100000:3.0:1782481012.707650:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:02020000:0.0:1782481012.711709:0:3648:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1782481012.717919:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782481012.717928:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5c37800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1782481012.717933:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1782481012.752724:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5c37800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782481012.752760:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 557 00000100:00080000:0.0:1782481012.752772:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f5cb5c37800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1782481012.752827:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ecca80 x1869066301300608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782481012.753313:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301300608:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1782481012.753385:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481012.756503:0:17099:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301300608 00000100:00100000:0.0:1782481012.756521:0:17099:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301300608 00000100:00100000:0.0:1782481012.756942:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782481012.756952:0:17099:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1869066301300608:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1782481012.756973:0:17099:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1782481012.764498:0:17099:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1869066301300608:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 7536us (11102us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782481012.764512:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1782481012.764749:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5c37800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481012.764756:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782481012.764760:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301300608:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1782481013.724002:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782481013.916523:0:17854:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1782481014.241206:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782481014.241217:0:17074:0:(genops.c:906:class_export_put()) final put ffff9f5c88579000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782481014.241520:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c88579000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1782481014.241605:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb654d000 for lustre-MDT0000 00000001:00100000:1.0:1782481014.241734:0:17828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1782481014.241777:0:17828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1782481014.241781:0:17828:0:(genops.c:906:class_export_put()) final put ffff9f5cb1fed800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1782481014.241800:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae528aa1-eae9-49ff-a679-4421f2ee4d3a 00000001:00100000:1.0:1782481014.241804:0:17828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ae528aa1-eae9-49ff-a679-4421f2ee4d3a 00000001:00080000:0.0:1782481014.241809:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:0.0:1782481014.241812:0:17074:0:(genops.c:906:class_export_put()) final put ffff9f5b883fe800/ae528aa1-eae9-49ff-a679-4421f2ee4d3a 00000001:00100000:0.0:1782481014.241819:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c447ea9-c05e-4f74-a91c-16472b83b6c2 00000001:00080000:0.0:1782481014.241822:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:0.0:1782481014.241824:0:17074:0:(genops.c:906:class_export_put()) final put ffff9f5cb1d1a800/9c447ea9-c05e-4f74-a91c-16472b83b6c2 00000020:00000080:3.0:1782481014.241896:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1fed800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1782481014.241937:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b883fe800/ae528aa1-eae9-49ff-a679-4421f2ee4d3a for lustre-MDT0000 00000001:00080000:1.0:1782481014.242059:0:17828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1782481014.242061:0:17828:0:(genops.c:906:class_export_put()) final put ffff9f5b883fd000/ae528aa1-eae9-49ff-a679-4421f2ee4d3a 00000001:00100000:1.0:1782481014.242347:0:17828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9c447ea9-c05e-4f74-a91c-16472b83b6c2 00000001:00080000:1.0:1782481014.242352:0:17828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1782481014.242355:0:17828:0:(genops.c:906:class_export_put()) final put ffff9f5c88ad3000/9c447ea9-c05e-4f74-a91c-16472b83b6c2 00000020:00000080:3.0:1782481014.242419:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1d1a800/9c447ea9-c05e-4f74-a91c-16472b83b6c2 for lustre-MDT0000 00000020:00000080:3.0:1782481014.242651:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1d18000 for lustre-MDT0001 00000020:00000080:3.0:1782481014.242656:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b883fe000 for lustre-MDT0000 00000020:00000080:3.0:1782481014.242660:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b883fd000/ae528aa1-eae9-49ff-a679-4421f2ee4d3a for lustre-MDT0001 00000020:00000080:3.0:1782481014.245007:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c88ad3000/9c447ea9-c05e-4f74-a91c-16472b83b6c2 for lustre-MDT0001 00000020:00000080:3.0:1782481014.245146:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1d1d800 for lustre-MDT0000 00000020:00000080:3.0:1782481014.245152:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1e60800 for lustre-MDT0001 00000020:00000080:3.0:1782481014.245155:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb654f800 for lustre-MDT0001 00000100:00100000:3.0:1782481014.751338:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301300736:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1782481014.751359:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782481014.751366:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782481014.751370:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5c37800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481014.751417:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 629 00000100:00080000:2.0:1782481014.751423:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782481014.751430:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f5cb5c37800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481014.751452:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb598f480 x1869066301300992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782481014.751560:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481014.751565:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c885b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301301120:0@lo:400:kworker.0 00000100:00100000:2.0:1782481014.751607:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481014.751612:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b880c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301301376:0@lo:400:kworker.0 00000100:00100000:2.0:1782481014.751642:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb79adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301301632:0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.751687:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481014.751734:0:19539:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301301120 00000100:00100000:2.0:1782481014.751741:0:19539:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301301120 00000100:00100000:3.0:1782481014.751745:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1869066301301888:0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.751783:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481014.751803:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782481014.751807:0:19539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782481014.751810:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb598fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301300864:0@lo:400:kworker.0 00000100:00100000:2.0:1782481014.751821:0:19539:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301301120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.751853:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481014.751879:0:19539:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301301120:12345-0@lo:400:kworker.0 Request processed in 59us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481014.751888:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb79ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301301504:0@lo:400:kworker.0 00000100:00100000:2.0:1782481014.751888:0:19539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782481014.751919:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481014.751919:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301301376 00000100:00100000:2.0:1782481014.751925:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301301376 00010000:00010000:3.0:1782481014.751951:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481014.751955:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301301888 00000100:00100000:2.0:1782481014.751959:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301301888 00000100:00100000:3.0:1782481014.751977:0:17096:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301301504 00000100:00100000:3.0:1782481014.751983:0:17096:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301301504 00000100:00100000:2.0:1782481014.751993:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782481014.752002:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869066301301888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.752019:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782481014.752025:0:17096:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869066301301376:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1782481014.752032:0:17096:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1782481014.752044:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869066301301888:12345-0@lo:400:kworker.0 Request processed in 42us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481014.752059:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1782481014.752069:0:17096:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1869066301301376:12345-0@lo:400:kworker.0 Request processed in 41us (381us total) trans 0 rc -107/-107 00000100:00100000:3.0:1782481014.752077:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782481014.752128:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb598f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301300992:0@lo:38:kworker.0 00000100:00100000:0.0:1782481014.752164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481014.752168:0:17088:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301300864 00000100:00100000:1.0:1782481014.752174:0:17088:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301300864 00000100:00080000:0.0:1782481014.752198:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782481014.752205:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782481014.752208:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782481014.752216:0:17088:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c8a181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e024ba8a-c811-4940-9393-bca6a08f819f+19:3649:x1869066301300864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481014.752246:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782481014.752251:0:17088:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c8a181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e024ba8a-c811-4940-9393-bca6a08f819f+19:3649:x1869066301300864:12345-0@lo:400:kworker.0 Request processed in 34us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481014.752257:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1869066301301504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481014.752263:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000020:00080000:2.0:1782481014.752267:0:20235:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1782481014.752298:0:17100:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301300992 00000100:00100000:1.0:1782481014.752302:0:17100:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301300992 00000100:00100000:2.0:1782481014.752304:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1869066301301504:12345-0@lo:400:kworker.0 Request processed in 48us (385us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782481014.752312:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782481014.752325:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782481014.752331:0:17100:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1869066301300992:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1782481014.752340:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301300736 00000100:00100000:2.0:1782481014.752346:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301300736 00010000:02000000:1.0:1782481014.752352:0:17100:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1782481014.752381:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782481014.752388:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301300736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782481014.752409:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1782481014.752440:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301300736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481014.752447:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782481014.752471:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b880c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301301248:0@lo:400:kworker.0 00000100:00100000:2.0:1782481014.752496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481014.752517:0:19137:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301301248 00000100:00100000:2.0:1782481014.752521:0:19137:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301301248 00000100:00100000:2.0:1782481014.752544:0:19137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782481014.752550:0:19137:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301301248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481014.752577:0:19137:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301301248:12345-0@lo:400:kworker.0 Request processed in 27us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481014.752582:0:19137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782481014.752616:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b880c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301301248:0@lo:400:kworker.0 00000100:00100000:2.0:1782481014.752623:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1869066301301760:0@lo:400:kworker.0 00000100:00100000:2.0:1782481014.752655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481014.752673:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301301760 00000100:00100000:2.0:1782481014.752677:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301301760 00000100:00100000:2.0:1782481014.752719:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782481014.752724:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1869066301301760:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1782481014.752728:0:20235:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1782481014.752750:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1869066301301760:12345-0@lo:400:kworker.0 Request processed in 25us (94us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782481014.752756:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1782481014.752781:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782481014.752785:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fe9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1782481014.752788:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1782481014.756669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481014.756791:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c885b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301301120:0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.756841:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb598fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301300864:0@lo:400:kworker.0 00000100:00080000:3.0:1782481014.756855:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1782481014.756861:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fec000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1782481014.756865:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1782481014.756887:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782481014.756892:0:3649:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 572 00000100:00080000:3.0:1782481014.756900:0:3649:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f5cb1fec000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481014.756962:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5c885b9880 x1869066301302016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782481014.757010:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb79ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301301504:0@lo:400:kworker.0 00000100:00080000:3.0:1782481014.757025:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1782481014.757029:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e83000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1782481014.757032:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1782481014.757035:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e83000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782481014.757038:0:3649:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 557 00000100:00080000:3.0:1782481014.757042:0:3649:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f5cb1e83000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481014.757056:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b88815c00 x1869066301302144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782481014.757066:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b880c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301301376:0@lo:400:kworker.0 00010000:00080000:3.0:1782481014.757078:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a37480 x1869066301301888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481014.757086:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1869066301301888:0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.757108:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301300736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782481014.757155:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301301632 00000100:00100000:3.0:1782481014.757161:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301301632 00000100:00100000:3.0:1782481014.757206:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782481014.757221:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301301632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.759538:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301301632:12345-0@lo:400:kworker.0 Request processed in 2310us (2870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481014.759553:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1782481014.759624:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb79adf80 x1869066301301632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481014.759637:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb79adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301301632:0@lo:400:kworker.0 00000100:00080000:3.0:1782481014.759688:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782481014.759709:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782481014.759724:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c885b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1869066301302016:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1782481014.759762:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481014.759786:0:17095:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301302016 00000100:00100000:3.0:1782481014.759789:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869066301302144:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1782481014.759806:0:17095:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301302016 00000100:00100000:3.0:1782481014.759811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481014.759840:0:17096:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301302144 00000100:00100000:3.0:1782481014.759845:0:17096:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301302144 00000100:00100000:3.0:1782481014.759874:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782481014.759884:0:17096:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1869066301302016:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1782481014.759885:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782481014.759896:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301302144:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1782481014.759905:0:17096:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:0.0:1782481014.759908:0:17094:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1782481014.759957:0:17096:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1869066301302016:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 74us (194us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782481014.759961:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301302144:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 64us (147us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782481014.759979:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782481014.759987:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1782481014.760011:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481014.760018:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782481014.760022:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c885b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1869066301302016:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1782481014.760035:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e83000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1782481014.760042:0:17100:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1869066301300992:12345-0@lo:38:kworker.0 Request processed in 7708us (7876us total) trans 0 rc -19/-19 00000100:00080000:3.0:1782481014.760048:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782481014.760054:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869066301302144:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1782481014.760059:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1782481014.760073:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5c37800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481014.760078:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782481014.760081:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb598f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301300992:0@lo:38:kworker.0 00000100:00080000:2.0:1782481014.794015:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fe9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481014.794031:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 587 00000100:00080000:2.0:1782481014.794042:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f5cb1fe9000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481014.794087:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb7a31c00 x1869066301302272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782481014.794121:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1869066301301760:0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.796144:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1869066301302272:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1782481014.797153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481014.797419:0:17096:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301302272 00000100:00100000:0.0:1782481014.797427:0:17096:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301302272 00000100:00100000:0.0:1782481014.797474:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782481014.797481:0:17096:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1869066301302272:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1782481014.797500:0:17096:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1782481014.797566:0:17096:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1869066301302272:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 83us (415us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782481014.797574:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1782481014.797667:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782481014.797673:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782481014.797677:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1869066301302272:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1782481015.773098:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481016.795986:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782481017.311392:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782481017.311402:0:18598:0:(genops.c:906:class_export_put()) final put ffff9f5b86655800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782481017.311481:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86655800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1782481017.311529:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b86653000 for lustre-OST0000 00000001:00100000:3.0:1782481017.312044:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782481017.312049:0:19416:0:(genops.c:906:class_export_put()) final put ffff9f5b87801000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782481017.312111:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b87801000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1782481017.312155:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b87807000 for lustre-OST0001 00000100:00100000:1.0:1782481017.820261:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301302400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782481017.820334:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481017.820474:0:18606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301302400 00000100:00100000:2.0:1782481017.820482:0:18606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301302400 00000100:00080000:3.0:1782481017.821005:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782481017.821018:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481017.821306:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782481017.821319:0:18606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301302400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782481017.821365:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782481017.821430:0:18606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301302400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481017.821446:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782481017.821531:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301302400:0@lo:13:osp-pre-0-1.0 00000020:01000000:2.0:1782481018.139832:0:20666:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5cb6324180 - data ffff9f5ca69b70d8/ffff9f5c88a2d400 00000020:01000000:2.0:1782481018.139968:0:20666:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5c9a720480 - data ffff9f5ca6ae50d8/ffff9f5c88a0b800 00000001:00000004:2.0:1782481018.161679:0:20666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1782481018.201255:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782481018.201264:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782481018.201278:0:20666:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9f5cb598c000 x1869066301299968/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1782481022 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481018.201300:0:20666:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1782481018.206286:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782481018.206295:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1782481018.206312:0:20666:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782481018.206315:0:20666:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1782481018.211289:0:17118:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1782481018.211298:0:17118:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1782481018.211314:0:17118:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1782481018.212018:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782481018.212023:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1782481018.212041:0:20666:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782481018.212044:0:20666:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1782481018.212334:0:17120:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1782481018.212338:0:17120:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1782481018.212347:0:17120:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1782481018.213929:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a29 00000020:00000080:2.0:1782481018.213949:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b85b57800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782481018.214171:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b85b57800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782481018.218272:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a3e 00000020:00000080:2.0:1782481018.218287:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b880ba800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782481018.218301:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1782481018.218306:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481018.218315:0:20666:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782481018.218319:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9f5b87a219c0) has no exports 00000004:01000000:2.0:1782481018.218487:0:20666:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1782481018.218508:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3aa0 00000020:00000080:2.0:1782481018.218514:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5cb5f5b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782481018.218518:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1782481018.218522:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481018.218527:0:20666:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782481018.218529:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9f5b86ba8000) has no exports 00000020:00000080:2.0:1782481018.218536:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a99 00000020:00000080:2.0:1782481018.218539:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b880bd000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1782481018.218938:0:20666:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1782481018.219407:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782481018.219412:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1782481018.219420:0:20666:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782481018.219422:0:20666:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782481018.219512:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782481018.219520:0:20666:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782481018.219526:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a8b 00000020:00000080:2.0:1782481018.219531:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5c8fc04800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782481018.219536:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1782481018.219541:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481018.219545:0:20666:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782481018.219548:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9f5b87a23380) has no exports 00000020:00000080:2.0:1782481018.219552:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a84 00000020:00000080:2.0:1782481018.219555:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5c9a380800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782481018.220056:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b880ba800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1782481018.220067:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb5f5b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1782481018.220072:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b880bd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782481018.220087:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb5cd7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1782481018.220093:0:8:0:(genops.c:906:class_export_put()) final put ffff9f5c8fc04000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782481018.220095:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8fc04000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1782481018.220099:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782481018.220176:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8fc04800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1782481018.220181:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c9a380800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1782481018.222186:0:20666:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1782481018.222207:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782481018.222211:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1782481018.222218:0:20666:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782481018.222221:0:20666:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782481018.222275:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782481018.222283:0:20666:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1782481018.222301:0:20666:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1782481018.222309:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a76 00000020:00000080:1.0:1782481018.222317:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5cb8c9c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1782481018.222323:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1782481018.222328:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782481018.222332:0:20666:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782481018.222336:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9f5c83fb8000) has no exports 00000020:00000080:1.0:1782481018.222344:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a6f 00000020:00000080:1.0:1782481018.222347:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5cb5cd3000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782481018.223329:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c88529800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1782481018.223341:0:8:0:(genops.c:906:class_export_put()) final put ffff9f5cb8c9e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782481018.223344:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb8c9e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1782481018.223350:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782481018.223432:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb8c9c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1782481018.223437:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb5cd3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1782481018.223769:0:20666:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1782481018.223773:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1782481018.223777:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782481018.223783:0:20666:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782481018.223840:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481018.223850:0:20666:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782481018.223874:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481018.223878:0:20666:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782481018.223881:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b85b52800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782481018.223883:0:20666:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b85b52800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1782481018.223887:0:20666:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782481018.223968:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a45 00000020:00000080:0.0:1782481018.223974:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b880b8800/lustre-MDD0000_UUID 00000020:01000000:0.0:1782481018.223978:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1782481018.223982:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782481018.223986:0:20666:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782481018.223989:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9f5b87a24d40) has no exports 00000020:00000080:0.0:1782481018.224008:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481018.224011:0:20666:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1782481018.224014:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3a4c 00000020:00000080:0.0:1782481018.224018:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b880bf000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1782481018.224025:0:20666:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5b879ad800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1782481018.224028:0:20666:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5b879ad800 3 00000020:01000004:0.0:1782481018.224031:0:20666:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f5b879ad800 from lustre-MDT0000 00000020:00000080:0.0:1782481018.224048:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481018.224051:0:20666:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1782481018.224053:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b85b54000/lustre-MDT0000_UUID 00000020:00000080:0.0:1782481018.224055:0:20666:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b85b54000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1782481018.224061:0:20666:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1782481018.224101:0:20666:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1782481018.224105:0:20666:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1782481018.224108:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1782481018.224110:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782481018.224113:0:20666:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782481018.224119:0:20666:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9f5b8790c000 e024ba8a-c811-4940-9393-bca6a08f819f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782481018.224125:0:20666:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9f5c83fbcd40) has exports, disconnecting them 00000020:00080000:0.0:1782481018.224135:0:20666:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f5b8790c000), last request at 1782480927 00000020:00000080:0.0:1782481018.224148:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee39f1 00000020:00010000:0.0:1782481018.224152:0:20666:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9f5b8790c000: total 2 00000100:00080000:0.0:1782481018.224155:0:20666:0:(import.c:65:import_set_state_nolock()) ffff9f5b87908000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1782481018.224165:0:20666:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5b8790c000): rc 0 00000020:00080000:0.0:1782481018.224169:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9f5c83fbcd40) has no exports 00000100:00100000:0.0:1782481018.224250:0:17086:0:(service.c:3182:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f5b868c4c00:17086] 0 exiting: rc = 1 00000020:00010000:2.0:1782481018.224478:0:17082:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9f5b8790c000: total 2 00010000:00010000:2.0:1782481018.224521:0:17082:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9f5b8790c000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1782481018.224548:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca7d74a00/0x65dae4c042ee3fa8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3fa1 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224564:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5cb79ab200/0x65dae4c042ee3bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3bc6 expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224575:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c8fdde200/0x65dae4c042ee3b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3b17 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224596:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5cb79aa000/0x65dae4c042ee39ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee39f8 expref: 11 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224607:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5b880f6c00/0x65dae4c042ee3cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3ce5 expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224618:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c8fdde000/0x65dae4c042ee3b10 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3b09 expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224627:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5b880f7800/0x65dae4c042ee3c7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3c75 expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224637:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca7d75a00/0x65dae4c042ee3fb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3faf expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224646:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5b880f6800/0x65dae4c042ee3b2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3b25 expref: 6 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224655:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c8ed28a00/0x65dae4c042ee3fc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3fbd expref: 5 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224666:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5b880f7c00/0x65dae4c042ee3d16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3d0f expref: 4 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224675:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5b880f6a00/0x65dae4c042ee3d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3d4e expref: 3 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224687:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5b880f6600/0x65dae4c042ee3c52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x65dae4c042ee3c4b expref: 2 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.224745:0:17082:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9f5b8790c000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1782481018.224760:0:17082:0:(genops.c:906:class_export_put()) final put ffff9f5b8790c000/e024ba8a-c811-4940-9393-bca6a08f819f 00010000:00010000:2.0:1782481018.224765:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481018.224767:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481018.224769:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782481018.224777:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b865d9000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1782481018.224782:0:8:0:(genops.c:906:class_export_put()) final put ffff9f5cb8c9f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782481018.224785:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb8c9f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1782481018.224793:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782481018.224827:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b880b8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1782481018.224830:0:8:0:(genops.c:906:class_export_put()) final put ffff9f5b880be000/lustre-MDD0000_UUID 00000020:00000080:2.0:1782481018.224832:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b880be000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1782481018.224835:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1782481018.224856:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b880bf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782481018.224860:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b8790c000/e024ba8a-c811-4940-9393-bca6a08f819f for MGS 00000020:00000080:2.0:1782481018.224885:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b87908000 for MGS 00000100:00100000:0.0:1782481018.229228:0:17088:0:(service.c:3182:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f5b868c7a00:17088] 1 exiting: rc = 0 00000100:00100000:0.0:1782481018.231455:0:17089:0:(service.c:3182:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f5b868c7e00:17089] 2 exiting: rc = 0 00000100:00100000:2.0:1782481018.235776:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235787:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235794:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235800:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235805:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235811:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235816:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235822:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235827:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235832:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235837:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235842:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235847:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235867:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235872:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235878:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235884:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235888:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235893:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235909:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235916:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235920:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235925:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235931:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.235936:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236439:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236451:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236457:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236462:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236468:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236473:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236479:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236484:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236489:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236493:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236498:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236504:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236509:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236515:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236520:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236525:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236530:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236536:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236542:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236547:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236553:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236558:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236563:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236579:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236585:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236591:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236596:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236601:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236606:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236611:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236616:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236621:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236626:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236631:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236638:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236645:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236654:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236659:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481018.236961:0:20666:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1782481018.240644:0:20666:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5cb6445300 - data ffff9f5c8f3f9d80/ffff9f5cb1e3d800 00000020:01000000:2.0:1782481018.240793:0:20666:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5c9a720f60 - data ffff9f5ca685a798/ffff9f5c911b1400 00000020:00000080:2.0:1782481018.241306:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee39d5 00000020:00000080:2.0:1782481018.241314:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5c91139800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782481018.241330:0:20666:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5b879ad800 from MGS, refs=2 00000020:01000004:2.0:1782481018.241334:0:20666:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5b879ad800 2 00000020:01000004:2.0:1782481018.241337:0:20666:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f5b879ad800 from MGS 00000020:00000080:2.0:1782481018.241362:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782481018.241368:0:20666:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1782481018.241371:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5c9113c800/MGS 00000020:00000080:2.0:1782481018.241374:0:20666:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c9113c800/MGS for MGS 00000020:01000000:2.0:1782481018.241380:0:20666:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1782481018.241455:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1782481018.241460:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481018.241464:0:20666:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782481018.241471:0:20666:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f5c8852a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782481018.241476:0:20666:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9f5c88574d40) has exports, disconnecting them 00000020:00080000:2.0:1782481018.241491:0:20666:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f5c8852a000), last request at 1782480928 00000020:00000080:2.0:1782481018.241495:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3ad8 00000020:00080000:2.0:1782481018.241506:0:20666:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5c8852a000): rc 0 00000020:00000080:2.0:1782481018.241510:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5c8852a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1782481018.242300:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c91139800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782481018.242316:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8852a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1782481018.243855:0:20666:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1782481018.243863:0:20666:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782481018.243868:0:20666:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782481018.243875:0:20666:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782481018.243917:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c86e70800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1782481018.244213:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481018.244222:0:20666:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1782481018.244227:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5c8852e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1782481018.244230:0:20666:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8852e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1782481018.244237:0:20666:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1782481018.244323:0:20666:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5b879ad800 1 00000020:00000080:0.0:1782481018.244328:0:20666:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee39c7 00000020:00000080:0.0:1782481018.244334:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5c9113d800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1782481018.244343:0:20666:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1782481018.244351:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c9113d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782481018.244362:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782481018.244365:0:20666:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782481018.244369:0:20666:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9f5b86a299c0) has no exports 00000020:00000080:1.0:1782481018.432805:0:20666:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782481018.432817:0:20666:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1782481018.432823:0:20666:0:(genops.c:906:class_export_put()) final put ffff9f5b879a9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782481018.432828:0:20666:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b879a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1782481018.432839:0:20666:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1782481018.433091:0:20666:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9f5b879ac800 00000020:02000400:1.0:1782481018.433162:0:20666:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1782481018.845922:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481019.867906:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301302528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782481019.867977:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481019.868047:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782481019.868053:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e024ba8a-c811-4940-9393-bca6a08f819f:3647:1869066301302656:0@lo:400:kworker.0 00000400:00000100:3.0:1782481019.868075:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869066301302656 offset 0 length 224: 4 00000100:00100000:3.0:1782481019.868115:0:18605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301302528 00000100:00100000:3.0:1782481019.868122:0:18605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301302528 00000100:00080000:1.0:1782481019.868175:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782481019.868181:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782481019.868192:0:18605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301302528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782481019.868228:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1782481019.868278:0:18605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301302528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481019.868297:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782481019.868362:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301302528:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782481019.868660:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782481019.868819:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782481019.868825:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782481019.868828:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5c37800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481019.868834:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 631 00000100:00080000:2.0:1782481019.868838:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782481019.868843:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f5cb5c37800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481019.868881:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b87b06a00 x1869066301302784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782481019.868919:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301302784:0@lo:38:kworker.0 00000100:00100000:1.0:1782481019.868957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481019.869077:0:17099:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301302784 00000100:00100000:0.0:1782481019.869083:0:17099:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301302784 00000100:00080000:2.0:1782481019.869104:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782481019.869109:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782481019.869112:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e83000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1782481019.869117:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1782481019.869120:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 631 00000100:00080000:2.0:1782481019.869124:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1782481019.869126:0:17099:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1869066301302784:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1782481019.869131:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f5cb1e83000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481019.869148:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bed80 x1869066301303040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00020000:0.0:1782481019.869150:0:17099:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1782481019.869170:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782481019.869176:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782481019.869178:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481019.869181:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 631 00000100:00100000:3.0:1782481019.869182:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301302912:0@lo:400:kworker.0 00000100:00080000:2.0:1782481019.869183:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782481019.869195:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f5cb1fec000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481019.869209:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bd500 x1869066301303168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782481019.869224:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782481019.869229:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782481019.869232:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782481019.869234:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fe9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481019.869238:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 631 00000100:00080000:2.0:1782481019.869240:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782481019.869243:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f5cb1fe9000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481019.869256:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bc380 x1869066301303424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782481019.869256:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1869066301303296:0@lo:400:kworker.0 00000100:00100000:1.0:1782481019.869299:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481019.869302:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782481019.869313:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1869066301303552:0@lo:400:kworker.0 00000100:00100000:2.0:1782481019.869346:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481019.869541:0:18602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301302912 00000100:00100000:3.0:1782481019.869545:0:18602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301302912 00000100:00100000:3.0:1782481019.869595:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782481019.869602:0:18602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301302912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.869644:0:18602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301302912:12345-0@lo:400:kworker.0 Request processed in 42us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481019.869651:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1782481019.869673:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782481019.869713:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301302912:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.869750:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869066301303040:0@lo:38:kworker.0 00000100:00100000:1.0:1782481019.873215:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301303296 00000100:00100000:1.0:1782481019.873230:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301303296 00000100:00100000:1.0:1782481019.873326:0:20235:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301303552 00000100:00100000:1.0:1782481019.873330:0:20235:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301303552 00000100:00100000:1.0:1782481019.873354:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782481019.873364:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869066301303296:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782481019.873553:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782481019.873647:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869066301303296:12345-0@lo:400:kworker.0 Request processed in 284us (4347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481019.873654:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782481019.873673:0:20235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782481019.873680:0:20235:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869066301303552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481019.873732:0:20235:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869066301303552:12345-0@lo:400:kworker.0 Request processed in 53us (4386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481019.873738:0:20235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1782481019.873809:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f5b882bc000 x1869066301303296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481019.873824:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1869066301303296:0@lo:400:kworker.0 00010000:00080000:2.0:1782481019.873858:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f5b882bea00 x1869066301303552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481019.873878:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1869066301303552:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.874328:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481019.874366:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1869066301303168:0@lo:38:kworker.0 00000100:00100000:3.0:1782481019.874405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481019.874431:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1869066301303424:0@lo:38:kworker.0 00000100:00100000:3.0:1782481019.874452:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481019.874740:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301303040 00000100:00100000:2.0:1782481019.874746:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301303040 00000100:00100000:2.0:1782481019.874766:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301303168 00000100:00100000:2.0:1782481019.874768:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301303168 00000100:00100000:2.0:1782481019.874788:0:17094:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301303424 00000100:00100000:2.0:1782481019.874790:0:17094:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301303424 00000100:00100000:2.0:1782481019.874801:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782481019.874807:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301303040:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1782481019.874824:0:17094:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1782481019.874877:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301303040:12345-0@lo:38:kworker.0 Request processed in 59us (540us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782481019.874884:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782481019.874897:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782481019.874902:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301303168:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1782481019.874911:0:17094:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1782481019.874933:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301303168:12345-0@lo:38:kworker.0 Request processed in 30us (528us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782481019.874939:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782481019.874950:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782481019.874954:0:17094:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301303424:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1782481019.874962:0:17094:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1782481019.874984:0:17094:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301303424:12345-0@lo:38:kworker.0 Request processed in 28us (530us total) trans 0 rc -19/-19 00000100:00100000:2.0:1782481019.874988:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1782481019.875061:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e83000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481019.875066:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782481019.875070:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869066301303040:0@lo:38:kworker.0 00000100:00080000:3.0:1782481019.875077:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481019.875080:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782481019.875213:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1869066301303168:0@lo:38:kworker.0 00000100:00080000:3.0:1782481019.875931:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481019.875938:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782481019.875941:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1869066301303424:0@lo:38:kworker.0 00000100:00100000:0.0:1782481019.892541:0:17099:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1869066301302784:12345-0@lo:38:kworker.0 Request processed in 23407us (23574us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782481019.892557:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1782481019.892774:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5c37800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782481019.892781:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1782481019.892785:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301302784:0@lo:38:kworker.0 00010000:00010000:2.0:1782481020.893760:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782481021.640468:0:20867:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782481021.669576:0:20867:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1782481021.669637:0:20867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.669653:0:20867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.669660:0:20867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.669666:0:20867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.669990:0:20867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782481021.669999:0:20867:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782481021.670028:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782481021.670032:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782481021.670038:0:20867:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782481021.670044:0:20867:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e83000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1782481021.670049:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782481021.670050:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782481021.670053:0:20867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782481021.671425:0:20867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.671441:0:20867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.671448:0:20867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.671455:0:20867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481021.672061:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481021.672070:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481021.672079:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111d600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481021.672083:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481021.672090:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481021.672098:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481021.672105:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782481021.672107:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782481021.672110:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1782481021.672401:0:20867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481021.672525:0:20867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672535:0:20867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672542:0:20867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672548:0:20867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672573:0:20867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782481021.672580:0:20867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672587:0:20867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672593:0:20867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672618:0:20867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672625:0:20867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1782481021.672631:0:20867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672638:0:20867:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672644:0:20867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672650:0:20867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.672658:0:20867:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1782481021.672660:0:20867:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1782481021.672714:0:20867:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1782481021.672718:0:20867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1782481021.672723:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782481021.672729:0:20867:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1782481021.672736:0:20867:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9f5c88ad3800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782481021.672742:0:20867:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9f5cb654b000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782481021.672747:0:20867:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9f5c88573380) has exports, disconnecting them 00000020:00080000:0.0:1782481021.672751:0:20867:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f5c88ad3800), last request at 1782481019 00000020:00000080:0.0:1782481021.672757:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3d40 00000100:00080000:0.0:1782481021.672774:0:20867:0:(import.c:65:import_set_state_nolock()) ffff9f5c88ad2800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1782481021.672960:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782481021.672966:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.672974:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aaa00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1782481021.672977:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.672991:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782481021.672997:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481021.673003:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782481021.673005:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1782481021.673007:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1782481021.673036:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.673042:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782481021.673064:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.673071:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aaa00/0x65dae4c042ee3b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3b2c expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.673084:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782481021.673088:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.673093:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111c400 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1782481021.673096:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.673102:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782481021.673120:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481021.673124:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1782481021.673126:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1782481021.673128:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1782481021.673142:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.673148:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1782481021.673206:0:20867:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5c88ad3800): rc 0 00000020:00000080:0.0:1782481021.673209:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5c88ad3800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1782481021.673218:0:20867:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f5cb654b000), last request at 1782481019 00000020:00000080:0.0:1782481021.673221:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3ca6 00000100:00080000:0.0:1782481021.673228:0:20867:0:(import.c:65:import_set_state_nolock()) ffff9f5b883fb000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1782481021.673235:0:20867:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5cb654b000): rc 0 00000020:00000080:0.0:1782481021.673237:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5cb654b000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1782481021.673244:0:20867:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbdd140d17ae0 00000100:00080000:0.0:1782481021.673273:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782481021.673282:0:20867:0:(client.c:3600:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9f5cb1ddad80 x1869066301300480/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1782481028 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481021.673292:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782481021.674375:0:20867:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782481021.674382:0:20867:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5c37800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1782481021.674529:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782481021.674533:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1782481021.674544:0:20867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1782481021.674601:0:20867:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1782481021.674620:0:20867:0:(import.c:65:import_set_state_nolock()) ffff9f5b869e9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1782481021.674635:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782481021.674637:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1782481021.674646:0:20867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1782481021.674729:0:20867:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1782481021.674739:0:20867:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1d19000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1782481021.674773:0:20867:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9f5c88573380) has no exports 00010000:00010000:3.0:1782481021.674971:0:18249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1782481021.675005:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e024ba8a-c811-4940-9393-bca6a08f819f:3648:1869066301303680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481021.675075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481021.675119:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301300480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782481021.675156:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301303808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481021.675196:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1782481021.675224:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c88ad3800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:0.0:1782481021.675464:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301303936:0@lo:9:umount.0 00000100:00100000:0.0:1782481021.675496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481021.675515:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301304064:0@lo:9:umount.0 00000100:00100000:0.0:1782481021.675546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782481021.675729:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481021.675740:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782481021.675829:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.675849:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c400/0x65dae4c042ee3d4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3d55 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.675867:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481021.675872:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.675879:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5b880f7000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1782481021.675882:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.675891:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782481021.675898:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481021.675914:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1782481021.675917:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1782481021.675920:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1782481021.675941:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.675947:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782481021.675959:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.675966:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7000/0x65dae4c042ee3b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3b1e expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.675978:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481021.675979:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481021.675981:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481021.676191:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481021.676209:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d600/0x65dae4c042ee3bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x65dae4c042ee3bcd expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481021.676220:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481021.676221:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481021.676223:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481021.676235:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e024ba8a-c811-4940-9393-bca6a08f819f:3650:1869066301304192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782481021.676436:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481021.676517:0:17079:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301303680 00000100:00100000:1.0:1782481021.676525:0:17079:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301303680 00000100:00100000:1.0:1782481021.676565:0:17079:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301303808 00000100:00100000:1.0:1782481021.676568:0:17079:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301303808 00000100:00100000:1.0:1782481021.676588:0:17079:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301304192 00000100:00100000:1.0:1782481021.676590:0:17079:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301304192 00000100:00100000:1.0:1782481021.676603:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782481021.676609:0:17079:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1869066301303680:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1782481021.676616:0:17079:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481021 with bad export cookie 7339430057161406961 00000100:00100000:2.0:1782481021.678339:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782481021.678350:0:17081:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88814a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3649:x1869066301303808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1782481021.678357:0:17081:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481021 with bad export cookie 7339430057161406961 00000100:00100000:2.0:1782481021.678440:0:17081:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88814a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3649:x1869066301303808:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (3242us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782481021.678447:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782481021.678473:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782481021.678478:0:17081:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1869066301304192:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1782481021.678483:0:17081:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782481021 with bad export cookie 7339430057161406961 00000100:00100000:2.0:1782481021.678516:0:17081:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1869066301304192:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (2079us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782481021.678522:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1782481021.678559:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782481021.678563:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f5c83769000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1782481021.678567:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:3.0:1782481021.681238:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb654b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1782481021.681283:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c88ad2800 for lustre-MDT0001 00000020:00000080:3.0:1782481021.681289:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b883fb000 for lustre-MDT0001 00000100:00100000:3.0:1782481021.681419:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782481021.681671:0:18603:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301303936 00000100:00100000:0.0:1782481021.681680:0:18603:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301303936 00000100:00100000:0.0:1782481021.681754:0:18603:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301304064 00000100:00100000:0.0:1782481021.681758:0:18603:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301304064 00000100:00100000:0.0:1782481021.681791:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782481021.681812:0:18603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869066301303936:12345-0@lo:9:umount.0 00000020:00000080:0.0:1782481021.681853:0:18603:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3cd0 00000100:00080000:0.0:1782481021.681862:0:18603:0:(import.c:65:import_set_state_nolock()) ffff9f5c8852d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782481021.681902:0:18603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1782481021.682058:0:18603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3646:x1869066301303936:12345-0@lo:9:umount.0 Request processed in 260us (6561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481021.682066:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782481021.682083:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782481021.682089:0:18603:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869066301304064:12345-0@lo:9:umount.0 00000020:00000080:0.0:1782481021.682101:0:18603:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3d78 00000100:00080000:0.0:1782481021.682106:0:18603:0:(import.c:65:import_set_state_nolock()) ffff9f5b87807800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782481021.682127:0:18603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1782481021.684759:0:17079:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1869066301303680:12345-0@lo:103:ldlm_bl.0 Request processed in 8142us (9677us total) trans 0 rc -107/-107 00000100:00100000:1.0:1782481021.684770:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782481021.685131:0:18603:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3646:x1869066301304064:12345-0@lo:9:umount.0 Request processed in 3011us (9553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481021.685139:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1782481021.685208:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b869e9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782481021.685235:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782481021.685237:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782481021.685241:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301303936:0@lo:9:umount.0 00000100:00080000:0.0:1782481021.685396:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1d19000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782481021.685409:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782481021.685411:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782481021.685428:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301304064:0@lo:9:umount.0 00010000:00010000:0.0:1782481021.685465:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782481021.687819:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782481021.687857:0:17090:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782481021.687918:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:0.0:1782481021.696927:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782481021.698898:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.111@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1782481021.698904:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1782481021.698931:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb7a31c00 x1869066301302656/t0(0) o400->MGC192.168.204.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782481035 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481021.698956:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1dd9500 x1869066301303680/t0(0) o103->MGC192.168.204.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782481037 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481021.698966:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1ddbb80 x1869066301303808/t0(0) o103->MGC192.168.204.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782481037 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481021.698976:0:3649:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5b882bea00 x1869066301304192/t0(0) o103->MGC192.168.204.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782481037 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1782481021.698986:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1782481021.698989:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1782481021.698990:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1782481021.699156:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481021.699182:0:18249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.699193:0:18249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d75c00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1782481021.699198:0:18249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.699209:0:18249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481021.699216:0:18249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481021.699223:0:18249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782481021.699226:0:18249:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782481021.699229:0:18249:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782481021.699246:0:18249:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f5c83769000 00010000:00010000:0.0:1782481021.699373:0:18249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.699384:0:18249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee3fbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3fc4 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481021.699398:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481021.699399:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481021.699402:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481021.699409:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481021.699418:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481021.699461:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e024ba8a-c811-4940-9393-bca6a08f819f:3647:1869066301302656:0@lo:400:kworker.0 00000100:00100000:3.0:1782481021.700297:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e024ba8a-c811-4940-9393-bca6a08f819f:0:1869066301304320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481021.700336:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e024ba8a-c811-4940-9393-bca6a08f819f:3648:1869066301303680:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1782481021.702788:0:3650:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f5c83769000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1782481021.702818:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e024ba8a-c811-4940-9393-bca6a08f819f:3650:1869066301304192:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1782481021.703388:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9f5c83769000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481021.703396:0:3649:0:(import.c:512:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 544 00000100:00080000:2.0:1782481021.703404:0:3649:0:(import.c:626:import_select_connection()) MGC192.168.204.111@tcp: import ffff9f5c83769000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481021.703440:0:3649:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bc000 x1869066301304448/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782481021.703483:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e024ba8a-c811-4940-9393-bca6a08f819f:3649:1869066301303808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782481021.703591:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e024ba8a-c811-4940-9393-bca6a08f819f:3646:1869066301304448:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1782481021.703643:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869066301304448 offset 0 length 520: 4 00000020:00080000:1.0:1782481021.708058:0:20867:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9f5c88573380) has no exports 00000020:01000000:1.0:1782481021.771145:0:20867:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5cb6324f00 - data ffff9f5c8f0bc6c0/ffff9f5c88a2d800 00000020:01000000:1.0:1782481021.771313:0:20867:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5c9a720ae0 - data ffff9f5ca6871bd0/ffff9f5c88a4c400 00000001:00000004:0.0:1782481021.780980:0:20867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1782481021.835500:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782481021.835510:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782481021.835518:0:20867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1782481021.838080:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1782481021.838087:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1782481021.838113:0:20867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782481021.838116:0:20867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782481021.839391:0:17836:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782481021.839459:0:17836:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1782481021.839469:0:17836:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1782481021.840684:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1782481021.840690:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1782481021.840723:0:20867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782481021.840726:0:20867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782481021.841358:0:17838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782481021.841362:0:17838:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1782481021.841373:0:17838:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1782481021.848584:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b3a 00000020:00000080:1.0:1782481021.848597:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5cb5cbc000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1782481021.849324:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b4f 00000020:00000080:1.0:1782481021.849331:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5c8fe37800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1782481021.849337:0:20867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1782481021.849343:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782481021.849350:0:20867:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782481021.849354:0:20867:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9f5c885719c0) has no exports 00000020:00000080:2.0:1782481021.849516:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb5cbc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1782481021.849525:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8fe37800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1782481021.849677:0:20867:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1782481021.849687:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3ba3 00000020:00000080:1.0:1782481021.849758:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5cb1d1a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1782481021.849805:0:20867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1782481021.849810:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782481021.849815:0:20867:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782481021.849818:0:20867:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9f5b86a2cd40) has no exports 00000020:00000080:1.0:1782481021.849823:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b9c 00000020:00000080:1.0:1782481021.849836:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5cb1d1f000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1782481021.850210:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1d1a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1782481021.850647:0:20867:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1782481021.850652:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782481021.850657:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1782481021.850673:0:20867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782481021.850676:0:20867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782481021.851117:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1d1f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1782481021.851222:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782481021.851231:0:20867:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782481021.851238:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b8e 00000020:00000080:1.0:1782481021.851244:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5b87ba3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782481021.851534:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1d19000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1782481021.851548:0:8:0:(genops.c:906:class_export_put()) final put ffff9f5b87ba4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782481021.851550:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b87ba4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1782481021.851555:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1782481021.851712:0:20867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1782481021.851717:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782481021.851722:0:20867:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782481021.851726:0:20867:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9f5cb2e2cd40) has no exports 00000020:00000080:1.0:1782481021.851731:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b80 00000020:00000080:1.0:1782481021.851735:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5b869ee000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1782481021.852090:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b87ba3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1782481021.852608:0:20867:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1782481021.852613:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782481021.852616:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1782481021.852622:0:20867:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782481021.852624:0:20867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782481021.853001:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b869ee000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1782481021.853108:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782481021.853116:0:20867:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1782481021.853132:0:20867:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1782481021.853140:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b72 00000020:00000080:1.0:1782481021.853147:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5cb1c93800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782481021.853389:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b869e9000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1782481021.853474:0:8:0:(genops.c:906:class_export_put()) final put ffff9f5cb1c93000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782481021.853478:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1c93000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1782481021.853483:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1782481021.853621:0:20867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1782481021.853627:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782481021.853633:0:20867:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782481021.853638:0:20867:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9f5cb2e2b380) has no exports 00000020:00000080:1.0:1782481021.853646:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b6b 00000020:00000080:1.0:1782481021.853651:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5cb5c32000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1782481021.854036:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1c93800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00010000:01000000:0.0:1782481021.855098:0:20867:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1782481021.855104:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782481021.855108:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782481021.855114:0:20867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782481021.855821:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb5c32000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1782481021.856166:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481021.856179:0:20867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782481021.856215:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481021.856219:0:20867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782481021.856223:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5cb5c36000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782481021.856227:0:20867:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb5c36000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1782481021.856235:0:20867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782481021.856389:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b56 00000020:00000080:0.0:1782481021.856405:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5c8fe33800/lustre-MDD0001_UUID 00000020:01000000:0.0:1782481021.856410:0:20867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1782481021.856414:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782481021.856418:0:20867:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782481021.856432:0:20867:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9f5c88570000) has no exports 00000020:00000080:0.0:1782481021.856454:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481021.856458:0:20867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1782481021.856462:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b5d 00000020:00000080:0.0:1782481021.856466:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5c8fe37000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1782481021.856475:0:20867:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5cbf434000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1782481021.856478:0:20867:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5cbf434000 2 00000020:01000004:0.0:1782481021.856481:0:20867:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f5cbf434000 from lustre-MDT0001 00000020:00000080:0.0:1782481021.856498:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481021.856502:0:20867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1782481021.856504:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5cb5cb8000/lustre-MDT0001_UUID 00000020:00000080:0.0:1782481021.856506:0:20867:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb5cb8000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1782481021.856514:0:20867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1782481021.856544:0:20867:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1782481021.856548:0:20867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1782481021.856550:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782481021.856554:0:20867:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782481021.856560:0:20867:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9f5c8852b000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782481021.856565:0:20867:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9f5c83fbb380) has exports, disconnecting them 00000020:00080000:0.0:1782481021.856570:0:20867:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9f5c8852b000), last request at 1782480941 00000020:00000080:0.0:1782481021.856574:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3bdb 00000020:00080000:0.0:1782481021.856585:0:20867:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5c8852b000): rc 0 00000020:00000080:0.0:1782481021.856589:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5c8852b000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1782481021.857443:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb5c37800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1782481021.857455:0:8:0:(genops.c:906:class_export_put()) final put ffff9f5b869eb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1782481021.857458:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b869eb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1782481021.857463:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1782481021.857572:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8fe33800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1782481021.857576:0:8:0:(genops.c:906:class_export_put()) final put ffff9f5c88528800/lustre-MDD0001_UUID 00000020:00000080:2.0:1782481021.857578:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c88528800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1782481021.857581:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1782481021.857716:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8fe37000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1782481021.857722:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8852b000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1782481021.858836:0:20867:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1782481021.858843:0:20867:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782481021.858847:0:20867:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782481021.858854:0:20867:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782481021.858882:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1e83000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1782481021.859020:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782481021.859038:0:20867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1782481021.859042:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5b8790a000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1782481021.859046:0:20867:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b8790a000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1782481021.859051:0:20867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1782481021.859103:0:20867:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5cbf434000 1 00000020:00000080:2.0:1782481021.859108:0:20867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3b02 00000020:00000080:2.0:1782481021.859115:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5c8857c800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1782481021.859123:0:20867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1782481021.859131:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8857c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1782481021.859140:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481021.859145:0:20867:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782481021.859149:0:20867:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9f5b86bacd40) has no exports 00010000:00010000:0.0:1782481021.957564:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782481022.074028:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782481022.074043:0:20867:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1782481022.074049:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5cbf436800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1782481022.074054:0:20867:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cbf436800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1782481022.074065:0:20867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1782481022.074190:0:20867:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9f5cbf436000 00000020:01000000:3.0:1782481022.074210:0:20867:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1782481022.074214:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782481022.074218:0:20867:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782481022.074222:0:20867:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9f5b86bab380) has no exports 00000100:00100000:2.0:1782481022.077026:0:20235:0:(service.c:3182:ptlrpc_main()) mdt00_003: service thread [ffff9f5c88996600:20235] 3 exiting: rc = 0 00000100:00100000:1.0:1782481022.079102:0:17096:0:(service.c:3182:ptlrpc_main()) mdt00_002: service thread [ffff9f5cc1c57e00:17096] 2 exiting: rc = 0 00000100:00100000:2.0:1782481022.084120:0:17095:0:(service.c:3182:ptlrpc_main()) mdt00_001: service thread [ffff9f5cb6712400:17095] 1 exiting: rc = 0 00000100:00100000:0.0:1782481022.084720:0:17094:0:(service.c:3182:ptlrpc_main()) mdt00_000: service thread [ffff9f5c89f3d000:17094] 0 exiting: rc = 1 00000100:00100000:3.0:1782481022.084861:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084870:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084875:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084880:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084886:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084891:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084896:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084902:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084912:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084918:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084923:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084929:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084980:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084986:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.084991:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085000:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085005:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085011:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085016:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085021:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085027:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085032:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085038:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085043:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085048:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085053:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085059:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085064:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085068:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085073:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085079:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085083:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085088:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085094:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085099:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085104:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085111:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085117:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085122:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085126:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085132:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085138:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085143:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085150:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085156:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085161:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085166:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085180:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085185:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085191:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085196:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085202:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085208:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085213:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085219:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085225:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085230:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085235:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085240:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085245:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085251:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085272:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085277:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.085283:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.087807:0:17097:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f5cc1c56e00:17097] 0 exiting: rc = 1 00000100:00100000:1.0:1782481022.088073:0:17098:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f5cc1c56800:17098] 1 exiting: rc = 0 00000100:00100000:2.0:1782481022.088135:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088144:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088150:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088155:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088161:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088166:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088172:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088177:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088181:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088187:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088192:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088197:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088202:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088207:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088213:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088218:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088223:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088244:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088249:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088270:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088277:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088283:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088287:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088293:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088298:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088304:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088309:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088313:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088318:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088323:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088328:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088333:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088338:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088343:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088347:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088351:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088355:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088360:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088364:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088369:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088374:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088379:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088384:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088390:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088396:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088401:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088406:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088411:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088416:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088421:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088426:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088430:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088445:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088449:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088454:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088459:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088464:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088469:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088474:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088478:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088484:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088490:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088494:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.088499:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782481022.089675:0:17100:0:(service.c:3182:ptlrpc_main()) mdt_out00_001: service thread [ffff9f5c89f3cc00:17100] 1 exiting: rc = 0 00000100:00100000:3.0:1782481022.089884:0:17099:0:(service.c:3182:ptlrpc_main()) mdt_out00_000: service thread [ffff9f5cb6713400:17099] 0 exiting: rc = 1 00000100:00100000:2.0:1782481022.089988:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.089996:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090014:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090020:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090025:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090030:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090036:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090042:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090054:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090199:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090210:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090217:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090224:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090232:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090240:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090345:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090352:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090359:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090365:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090371:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090377:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090399:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090407:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090427:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090434:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090442:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090448:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090454:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090462:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090470:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090476:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090483:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090489:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090510:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090517:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090523:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090529:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090535:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090540:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090545:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090551:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090556:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090562:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090569:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090574:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090596:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090602:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090608:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090612:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090617:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090623:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090628:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090633:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090638:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090644:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090651:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090656:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090676:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090688:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090765:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090773:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090779:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090783:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.090789:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782481022.105662:0:17102:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f5c89f3d600:17102] 1 exiting: rc = 0 00000100:00100000:0.0:1782481022.105963:0:17101:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f5c89f3da00:17101] 0 exiting: rc = 1 00000100:00100000:3.0:1782481022.106047:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106055:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106060:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106065:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106070:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106075:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106080:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106085:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106090:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106095:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106099:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106104:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106109:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106114:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106118:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106122:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106126:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106140:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106145:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106150:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106155:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106160:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106165:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106170:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106175:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106179:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106183:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106188:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106193:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106197:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106202:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106206:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106211:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106215:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106221:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106225:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106230:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106234:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106238:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106242:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106247:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106262:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106268:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106273:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106278:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106284:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106288:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106293:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106299:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106303:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106308:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106312:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106324:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106329:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106334:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106339:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106343:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106348:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106353:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106358:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106362:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106367:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106372:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.106376:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782481022.106751:0:17104:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f5c81284600:17104] 1 exiting: rc = 0 00000100:00100000:0.0:1782481022.106949:0:17103:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f5b85b46e00:17103] 0 exiting: rc = 1 00000100:00100000:3.0:1782481022.107387:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107394:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107399:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107404:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107409:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107414:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107420:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107425:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107431:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107435:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107440:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107446:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107450:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107457:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107461:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107466:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107471:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107476:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107481:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107486:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107490:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107495:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107500:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107516:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107521:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107526:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107531:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107536:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107541:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107545:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107551:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107555:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107560:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107566:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107571:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107576:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107581:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107586:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107591:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107596:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107600:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107605:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107610:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107614:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107618:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107623:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107627:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107632:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107636:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107641:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107645:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107649:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107654:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107658:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107663:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107668:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107672:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107677:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107688:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107708:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107714:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107719:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107725:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.107730:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782481022.108752:0:17106:0:(service.c:3182:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f5cb657ec00:17106] 1 exiting: rc = 0 00000100:00100000:0.0:1782481022.109028:0:17105:0:(service.c:3182:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f5cb657e600:17105] 0 exiting: rc = 1 00000100:00100000:3.0:1782481022.109390:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109397:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109402:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109407:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109413:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109418:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109422:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109427:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109432:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109438:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109443:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109448:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109453:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109458:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109463:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109469:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109474:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109479:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109484:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109488:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109494:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109499:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109504:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109509:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109514:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109519:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109524:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109529:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109534:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109550:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109556:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109561:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109566:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109570:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109575:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109580:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109585:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109589:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109594:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109601:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109606:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109611:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109616:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109621:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109626:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109630:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109634:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109639:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109644:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109648:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109652:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109656:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109661:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109666:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109671:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109676:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109681:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109686:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109690:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109719:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109724:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109729:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109734:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.109739:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481022.110448:0:17108:0:(service.c:3182:ptlrpc_main()) mdt_io00_001: service thread [ffff9f5c8a6bae00:17108] 1 exiting: rc = 0 00000100:00100000:3.0:1782481022.110748:0:17109:0:(service.c:3182:ptlrpc_main()) mdt_io00_002: service thread [ffff9f5b8657f600:17109] 2 exiting: rc = 0 00000100:00100000:1.0:1782481022.110854:0:17107:0:(service.c:3182:ptlrpc_main()) mdt_io00_000: service thread [ffff9f5c89653400:17107] 0 exiting: rc = 1 00000100:00100000:3.0:1782481022.116177:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116189:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116213:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116220:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116227:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116232:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116238:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116244:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116250:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116256:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116262:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116267:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116273:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116279:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116285:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116290:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116296:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116301:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116307:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116324:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116331:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116337:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116343:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116349:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116354:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116360:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116366:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116371:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116376:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116382:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116387:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116392:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116397:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116404:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116423:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116428:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116434:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116439:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116444:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116449:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116454:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116460:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116465:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116486:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116493:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116499:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116504:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116509:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116514:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116521:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116526:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116532:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116537:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116542:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116547:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116552:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116556:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116561:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116566:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116572:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116576:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116581:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116586:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481022.116591:0:20867:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1782481022.120030:0:20867:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481022.120042:0:20867:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1782481022.120059:0:20867:0:(genops.c:906:class_export_put()) final put ffff9f5b8822d800/MDS_uuid 00000020:00000080:0.0:1782481022.120064:0:20867:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b8822d800/MDS_uuid for MDS 00000020:01000000:0.0:1782481022.120070:0:20867:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1782481022.120194:0:20867:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1782481023.007303:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481024.038922:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782481024.988232:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782481024.988242:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782481024.988245:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782481024.988248:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782481024.988251:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782481024.988259:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1782481024.988265:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782481024.988272:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f5cb1fec000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481024.988309:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ddb100 x1869066301304576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782481024.988365:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782481024.988368:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782481024.988370:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fe9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782481024.988374:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 636 00000100:00080000:1.0:1782481024.988377:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782481024.988381:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f5cb1fe9000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481024.988393:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1dd9f80 x1869066301304832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782481024.988430:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782481024.988445:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301304704:0@lo:400:kworker.0 00000400:00000100:1.0:1782481024.988494:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301304704 offset 0 length 224: 4 00000100:00100000:1.0:1782481024.988525:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782481024.988544:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1869066301304960:0@lo:400:kworker.0 00000400:00000100:1.0:1782481024.988564:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301304960 offset 0 length 224: 4 00000100:00100000:2.0:1782481024.990300:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1869066301304576:0@lo:38:kworker.0 00000400:00000100:2.0:1782481024.990360:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301304576 offset 0 length 520: 4 00000100:00100000:2.0:1782481024.990386:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1869066301304832:0@lo:38:kworker.0 00000400:00000100:2.0:1782481024.990404:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301304832 offset 0 length 520: 4 00010000:00010000:0.0:1782481025.053800:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782481025.848257:0:21070:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782481025.857211:0:21070:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1782481025.857265:0:21070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481025.857281:0:21070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481025.857289:0:21070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481025.857296:0:21070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481025.857316:0:21070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782481025.857322:0:21070:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782481025.857346:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782481025.857358:0:21070:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1ddb100 x1869066301304576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782481044 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481025.857388:0:21070:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782481025.857394:0:21070:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782481025.857400:0:21070:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fec000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1782481025.857404:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782481025.857408:0:21070:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1ddb100 x1869066301304576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782481044 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481025.857414:0:21070:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782481025.857417:0:21070:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:0.0:1782481025.857828:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481025.857836:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481025.857844:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5b880f7200 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1782481025.857847:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481025.857855:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481025.857863:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481025.857868:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782481025.857871:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782481025.857873:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782481025.857888:0:17082:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f5c83769000 00010000:00010000:0.0:1782481025.857892:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481025.857899:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5b880f7200/0x65dae4c042ee3c75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3c7c expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481025.857922:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481025.857931:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481025.857933:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481025.858165:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1869066301304576:0@lo:38:kworker.0 00000100:00080000:2.0:1782481025.861337:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782481025.861357:0:21070:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1dda680 x1869066301304704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481025.861384:0:21070:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782481025.861391:0:21070:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1782481025.861415:0:21070:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e61800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1782481025.862072:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1869066301305088:0@lo:39:umount.0 00000400:00000100:0.0:1782481025.862126:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301305088 offset 0 length 224: 4 00000100:00100000:1.0:1782481025.862630:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301304704:0@lo:400:kworker.0 00010000:00010000:0.0:1782481026.077235:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782481027.037226:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782481027.037235:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481027.037255:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782481027.037258:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782481027.037345:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1869066301305216:0@lo:400:kworker.0 00000400:00000100:1.0:1782481027.037404:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301305216 offset 0 length 224: 4 00010000:00010000:2.0:1782481027.099976:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782481027.558556:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782481027.558566:0:18598:0:(genops.c:906:class_export_put()) final put ffff9f5c8852e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1782481027.558845:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c8852e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1782481027.558902:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c8852d800 for lustre-OST0000 00000001:00100000:0.0:1782481027.560772:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1782481027.560780:0:19416:0:(genops.c:906:class_export_put()) final put ffff9f5b87800000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1782481027.561406:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b87800000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1782481027.561468:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b87807800 for lustre-OST0001 00010000:00010000:0.0:1782481028.123913:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481029.147886:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782481030.043840:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782481030.043850:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782481030.043852:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782481030.043855:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782481030.043987:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301305344:0@lo:400:kworker.0 00000400:00000100:0.0:1782481030.044046:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301305344 offset 0 length 224: 4 00010000:00010000:0.0:1782481030.172766:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481031.004426:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481021/real 1782481021] req@ffff9f5b882bc000 x1869066301304448/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782481031 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481031.004461:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5b882bc000 x1869066301304448/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782481031 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782481031.004479:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c83769000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782481031.004507:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1782481031.004512:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e024ba8a-c811-4940-9393-bca6a08f819f:3646:1869066301304448:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1782481031.004710:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782481031.004725:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1782481031.004728:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5c83769000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782481031.004733:0:37:0:(import.c:512:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 638 00000100:00080000:1.0:1782481031.004738:0:37:0:(import.c:591:import_select_connection()) MGC192.168.204.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1782481031.004745:0:37:0:(import.c:626:import_select_connection()) MGC192.168.204.111@tcp: import ffff9f5c83769000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481031.004777:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ddb100 x1869066301305472/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782481031.004801:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782481031.004805:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782481031.004963:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1869066301305600:0@lo:400:kworker.0 00000400:00000100:3.0:1782481031.005017:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301305600 offset 0 length 224: 4 00000100:00100000:0.0:1782481031.005183:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e024ba8a-c811-4940-9393-bca6a08f819f:3646:1869066301305472:0@lo:250:kworker.0 00000400:00000100:0.0:1782481031.005205:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869066301305472 offset 0 length 520: 4 00010000:00010000:2.0:1782481031.197329:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481032.219871:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481033.243900:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481034.268689:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481035.100008:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481025/real 1782481025] req@ffff9f5b882bdc00 x1869066301305088/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782481035 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481035.100057:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5b882bdc00 x1869066301305088/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782481035 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782481035.100074:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1e61800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782481035.100095:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1869066301305088:0@lo:39:umount.0 00000100:00080000:2.0:1782481035.100203:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782481035.100216:0:21070:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1782481035.100221:0:21070:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1782481035.101749:0:21070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.101765:0:21070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.101773:0:21070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.101796:0:21070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.101893:0:21070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481035.101902:0:21070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.101909:0:21070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.101915:0:21070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.101920:0:21070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.103677:0:18249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782481035.103690:0:18249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.103714:0:18249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79abc00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1782481035.103719:0:18249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.103730:0:18249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481035.103737:0:18249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481035.103744:0:18249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782481035.103747:0:18249:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1782481035.103759:0:18249:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f5c83769000 00010000:00010000:0.0:1782481035.103764:0:18249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.103771:0:18249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5cb79abc00/0x65dae4c042ee3c4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3c52 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.103808:0:18249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481035.103811:0:18249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.103817:0:18249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1782481035.103820:0:18249:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.103827:0:18249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481035.103834:0:18249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481035.103838:0:18249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782481035.103840:0:18249:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1782481035.103845:0:18249:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f5c83769000 00010000:00010000:0.0:1782481035.103847:0:18249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.103854:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481035.103855:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481035.103857:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481035.107380:0:21070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1782481035.107398:0:21070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa800/0x65dae4c042ee3faf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3fb6 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481035.107418:0:21070:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1782481035.107426:0:21070:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1782481035.107428:0:21070:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1782481035.107463:0:21070:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1782481035.107467:0:21070:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1782481035.107477:0:21070:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481035.107482:0:21070:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782481035.107486:0:21070:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9f5cb2e299c0) has no exports 00000020:00080000:2.0:1782481035.107508:0:21070:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9f5cb2e299c0) has no exports 00010000:00010000:0.0:1782481035.108253:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1782481035.112857:0:21070:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5cb6445a20 - data ffff9f5c8f3c6948/ffff9f5cb5968400 00000020:01000000:2.0:1782481035.113334:0:21070:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5cb60292a0 - data ffff9f5ca689b000/ffff9f5cb1cab000 00100000:10000000:2.0:1782481035.125921:0:21070:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1782481035.146898:0:21070:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3c60 00000020:00000080:3.0:1782481035.146910:0:21070:0:(genops.c:906:class_export_put()) final put ffff9f5b86654000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1782481035.146925:0:21070:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5cb1e85800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1782481035.146928:0:21070:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5cb1e85800 2 00000020:01000004:3.0:1782481035.146931:0:21070:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f5cb1e85800 from lustre-OST0000 00000020:00000080:3.0:1782481035.146954:0:21070:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782481035.146965:0:21070:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1782481035.146967:0:21070:0:(genops.c:906:class_export_put()) final put ffff9f5cb1fed000/lustre-OST0000_UUID 00000020:00000080:3.0:1782481035.146970:0:21070:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1fed000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1782481035.146977:0:21070:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1782481035.147037:0:21070:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1782481035.147041:0:21070:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1782481035.147045:0:21070:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782481035.147049:0:21070:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782481035.147056:0:21070:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f5b86b8e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782481035.147061:0:21070:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff9f5cb5f7cd40) has exports, disconnecting them 00000020:00080000:3.0:1782481035.147066:0:21070:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f5b86b8e800), last request at 1782480956 00000020:00000080:3.0:1782481035.147070:0:21070:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3c8a 00000020:00080000:3.0:1782481035.147078:0:21070:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5b86b8e800): rc 0 00000020:00000080:3.0:1782481035.147096:0:21070:0:(genops.c:906:class_export_put()) final put ffff9f5b86b8e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1782481035.148803:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86654000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1782481035.148821:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86b8e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1782481035.238665:0:21070:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1782481035.238675:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782481035.238679:0:21070:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782481035.238686:0:21070:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782481035.238948:0:21070:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782481035.238959:0:21070:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1782481035.238966:0:21070:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1782481035.238971:0:21070:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782481035.238975:0:21070:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782481035.238982:0:21070:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9f5cb654b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782481035.238988:0:21070:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff9f5b86a2b380) has exports, disconnecting them 00000020:00080000:3.0:1782481035.238993:0:21070:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9f5cb654b800), last request at 1782480956 00000020:00000080:3.0:1782481035.238997:0:21070:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3c9f 00000020:00080000:3.0:1782481035.239010:0:21070:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5cb654b800): rc 0 00000020:00000080:3.0:1782481035.239016:0:21070:0:(genops.c:906:class_export_put()) final put ffff9f5cb654b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1782481035.239068:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1fec000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1782481035.239075:0:37:0:(genops.c:906:class_export_put()) final put ffff9f5b86650000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1782481035.239088:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86650000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1782481035.239097:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1782481035.239626:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb654b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1782481035.258403:0:21070:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1782481035.258412:0:21070:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782481035.258416:0:21070:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782481035.258423:0:21070:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782481035.258677:0:21070:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782481035.258687:0:21070:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1782481035.258813:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1e61800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1782481035.258823:0:37:0:(genops.c:906:class_export_put()) final put ffff9f5cb1c92800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1782481035.258836:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1c92800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1782481035.258842:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1782481035.259112:0:21070:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5cb1e85800 1 00000020:00000080:0.0:1782481035.259119:0:21070:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3c3d 00000020:00000080:0.0:1782481035.259126:0:21070:0:(genops.c:906:class_export_put()) final put ffff9f5cb1fef800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1782481035.259135:0:21070:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1782481035.259139:0:21070:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782481035.259145:0:21070:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782481035.259148:0:21070:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9f5c83fb99c0) has no exports 00000020:00000080:2.0:1782481035.259635:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1fef800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1782481035.292286:0:21070:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481035.292302:0:21070:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1782481035.292308:0:21070:0:(genops.c:906:class_export_put()) final put ffff9f5cb1e84800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1782481035.292313:0:21070:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1e84800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1782481035.292328:0:21070:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1782481035.292457:0:21070:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9f5cb1e84000 00000020:02000400:0.0:1782481035.292505:0:21070:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1782481035.296833:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782481036.256791:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782481036.256801:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481036.256804:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782481036.256807:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782481036.256885:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1869066301305728:0@lo:400:kworker.0 00000400:00000100:3.0:1782481036.256942:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301305728 offset 0 length 224: 4 00010000:00010000:1.0:1782481036.318562:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481037.339871:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481038.364469:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782481039.109481:0:21274:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1782481039.125843:0:21274:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1782481039.126187:0:21274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481039.126202:0:21274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481039.126226:0:21274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481039.126233:0:21274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481039.126251:0:21274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782481039.126257:0:21274:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1782481039.126283:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481039.126289:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481039.126296:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddec00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1782481039.126300:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481039.126308:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481039.126316:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481039.126321:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782481039.126324:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782481039.126326:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782481039.126339:0:17082:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f5c83769000 00010000:00010000:0.0:1782481039.126343:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481039.126359:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddec00/0x65dae4c042ee3d0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3d16 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481039.126370:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481039.126371:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481039.126373:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782481039.126386:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782481039.126397:0:21274:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1dd9f80 x1869066301304832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782481044 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481039.126415:0:21274:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782481039.126420:0:21274:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782481039.126425:0:21274:0:(import.c:65:import_set_state_nolock()) ffff9f5cb1fe9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1782481039.126430:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782481039.126433:0:21274:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1dd9f80 x1869066301304832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782481044 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481039.126438:0:21274:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782481039.126441:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:3.0:1782481039.127603:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1869066301304832:0@lo:38:kworker.0 00000100:00080000:1.0:1782481039.132512:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782481039.132531:0:21274:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1ddb800 x1869066301304960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481039.132558:0:21274:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5b88815180 x1869066301305216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481043 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481039.132568:0:21274:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1dda680 x1869066301305344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481046 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481039.132590:0:21274:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1dd8000 x1869066301305600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481047 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481039.132602:0:21274:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5b882be300 x1869066301305728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481052 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481039.132611:0:21274:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782481039.132617:0:21274:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1782481039.132724:0:21274:0:(import.c:65:import_set_state_nolock()) ffff9f5b87801800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1782481039.132811:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1869066301305216:0@lo:400:kworker.0 00000100:00100000:3.0:1782481039.132822:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1869066301304960:0@lo:400:kworker.0 00000100:00100000:3.0:1782481039.132937:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1869066301305600:0@lo:400:kworker.0 00000100:00100000:3.0:1782481039.132964:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1869066301305728:0@lo:400:kworker.0 00000100:00100000:3.0:1782481039.132989:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1869066301305856:0@lo:39:umount.0 00000400:00000100:3.0:1782481039.133170:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066301305856 offset 0 length 224: 4 00000100:00100000:0.0:1782481039.133308:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301305344:0@lo:400:kworker.0 00010000:00010000:1.0:1782481039.388894:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481040.412127:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782481041.372132:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782481041.372143:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1782481041.436884:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481042.460204:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481043.493857:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481044.507861:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481045.531894:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481046.299879:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481031/real 1782481031] req@ffff9f5cb1ddb100 x1869066301305472/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782481046 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481046.299913:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5cb1ddb100 x1869066301305472/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782481046 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782481046.299934:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c83769000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481046.299943:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1782481046.299947:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e024ba8a-c811-4940-9393-bca6a08f819f:3646:1869066301305472:0@lo:250:kworker.0 00000100:00080000:1.0:1782481046.300445:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) e024ba8a-c811-4940-9393-bca6a08f819f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1782481046.300452:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1782481046.300455:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f5c83769000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782481046.300460:0:38:0:(import.c:512:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 647 00000100:00080000:1.0:1782481046.300466:0:38:0:(import.c:591:import_select_connection()) MGC192.168.204.111@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782481046.300472:0:38:0:(import.c:626:import_select_connection()) MGC192.168.204.111@tcp: import ffff9f5c83769000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481046.300505:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ddaa00 x1869066301305984/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782481046.300632:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e024ba8a-c811-4940-9393-bca6a08f819f:3646:1869066301305984:0@lo:250:kworker.0 00000400:00000100:3.0:1782481046.300680:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869066301305984 offset 0 length 520: 4 00010000:00010000:0.0:1782481046.556956:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481047.581940:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481048.603899:0:18249:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481049.371867:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481039/real 1782481039] req@ffff9f5cb1dd8e00 x1869066301305856/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782481049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481049.371913:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5cb1dd8e00 x1869066301305856/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782481049 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782481049.371931:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b87801800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1782481049.371950:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1869066301305856:0@lo:39:umount.0 00000100:00080000:1.0:1782481049.372104:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1782481049.372110:0:21274:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782481049.372132:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1782481049.373162:0:21274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481049.373177:0:21274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481049.373184:0:21274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481049.373189:0:21274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481049.373218:0:21274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481049.373225:0:21274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481049.373232:0:21274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481049.373237:0:21274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481049.373243:0:21274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481049.373268:0:21274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782481049.373273:0:21274:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1782481049.373306:0:21274:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1782481049.373310:0:21274:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1782481049.373315:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782481049.373330:0:21274:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782481049.373334:0:21274:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9f5b874e4d40) has no exports 00010000:00010000:2.0:1782481049.373338:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782481049.373344:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481049.373351:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79ab000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1782481049.373354:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782481049.373355:0:21274:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9f5b874e4d40) has no exports 00010000:00010000:2.0:1782481049.373363:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782481049.373370:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481049.373386:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782481049.373389:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1782481049.373391:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1782481049.373405:0:17082:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f5c83769000 00010000:00010000:2.0:1782481049.373409:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481049.373416:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee3ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3cec expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481049.373429:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481049.373433:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481049.373439:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:2.0:1782481049.373442:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481049.373448:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782481049.373454:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481049.373459:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1782481049.373461:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1782481049.373462:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1782481049.373467:0:17082:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f5c83769000 00010000:00010000:2.0:1782481049.373469:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481049.373481:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee3fa1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3fa8 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481049.373493:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481049.373673:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481049.373675:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1782481049.375027:0:21274:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5cb6324cc0 - data ffff9f5ca685bbd0/ffff9f5c88a2f000 00000020:01000000:1.0:1782481049.375155:0:21274:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9f5c8fc1fea0 - data ffff9f5c90b2a6c0/ffff9f5cb59ab800 00010000:00010000:0.0:1782481049.375582:0:20868:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1782481049.384920:0:21274:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1782481049.393425:0:21274:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3cfa 00000020:00000080:0.0:1782481049.393451:0:21274:0:(genops.c:906:class_export_put()) final put ffff9f5b86652800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1782481049.393474:0:21274:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5b86b89800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1782481049.393478:0:21274:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5b86b89800 2 00000020:01000004:0.0:1782481049.393481:0:21274:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f5b86b89800 from lustre-OST0001 00000020:00000080:0.0:1782481049.393513:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481049.393524:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1782481049.393527:0:21274:0:(genops.c:906:class_export_put()) final put ffff9f5b86655000/lustre-OST0001_UUID 00000020:00000080:0.0:1782481049.393530:0:21274:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86655000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1782481049.393537:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1782481049.393640:0:21274:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import e024ba8a-c811-4940-9393-bca6a08f819f->MGS 00010000:00010000:0.0:1782481049.393655:0:21274:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5b880f6400/0x65dae4c042ee3b09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee3b10 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481049.393667:0:21274:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5b880f6400/0x65dae4c042ee3b09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee3b10 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481049.393674:0:21274:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1782481049.393677:0:21274:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1782481049.393680:0:21274:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1782481049.393721:0:21274:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f5c83769000 00010000:00010000:0.0:1782481049.393726:0:21274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5b880f6400/0x65dae4c042ee3b09 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee3b10 expref: -99 pid: 17827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481049.393742:0:21274:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee39f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x65dae4c042ee39ff expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481049.393749:0:21274:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee39f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x65dae4c042ee39ff expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481049.393755:0:21274:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782481049.393757:0:21274:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1782481049.393759:0:21274:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1782481049.393775:0:21274:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f5c83769000 00010000:00010000:0.0:1782481049.393778:0:21274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee39f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x65dae4c042ee39ff expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782481049.393794:0:21274:0:(import.c:65:import_set_state_nolock()) ffff9f5c83769000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1782481049.393798:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1782481049.393800:0:21274:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1782481049.393802:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1782481049.393805:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1782481049.393815:0:21274:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f5cb1ddaa00 x1869066301305984/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782481066 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1782481049.393934:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86652800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1782481049.394773:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1782481049.394778:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:3.0:1782481049.396717:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e024ba8a-c811-4940-9393-bca6a08f819f:3646:1869066301305984:0@lo:250:kworker.0 10000000:01000000:0.0:1782481049.396871:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1782481049.396895:0:21274:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee39e3 00000020:00000080:0.0:1782481049.396905:0:21274:0:(genops.c:906:class_export_put()) final put ffff9f5b88228000/e024ba8a-c811-4940-9393-bca6a08f819f 00000020:01000000:0.0:1782481049.396925:0:21274:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.111@tcp (flags='') 00000020:00000080:0.0:1782481049.396932:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782481049.396939:0:21274:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1782481049.396943:0:21274:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9f5b86a28000) has no exports 00000020:00000080:2.0:1782481049.396992:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b88228000/e024ba8a-c811-4940-9393-bca6a08f819f for MGC192.168.204.111@tcp 10000000:01000000:3.0:1782481049.397109:0:17091:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1782481049.397267:0:21274:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.111@tcp: client import never connected 00000100:00080000:0.0:1782481049.397272:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1782481049.397275:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1782481049.397278:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1782481049.397279:0:21274:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1782481049.397345:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782481049.397351:0:21274:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.111@tcp (uuid e024ba8a-c811-4940-9393-bca6a08f819f) 00000020:01000000:0.0:1782481049.397356:0:21274:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1782481049.397360:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782481049.397363:0:21274:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782481049.397368:0:21274:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f5b86b8b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782481049.397373:0:21274:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff9f5c8a170000) has exports, disconnecting them 00000020:00080000:0.0:1782481049.397387:0:21274:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f5b86b8b800), last request at 1782480971 00000020:00000080:0.0:1782481049.397391:0:21274:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3d24 00000020:00080000:0.0:1782481049.397401:0:21274:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5b86b8b800): rc 0 00000020:00000080:0.0:1782481049.397405:0:21274:0:(genops.c:906:class_export_put()) final put ffff9f5b86b8b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1782481049.398177:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5c83769000 for MGC192.168.204.111@tcp 00000020:00000080:2.0:1782481049.398187:0:37:0:(genops.c:906:class_export_put()) final put ffff9f5b879ab800/e024ba8a-c811-4940-9393-bca6a08f819f 00000020:00000080:2.0:1782481049.398190:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b879ab800/e024ba8a-c811-4940-9393-bca6a08f819f for MGC192.168.204.111@tcp 00000020:01000000:2.0:1782481049.398197:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.111@tcp (e024ba8a-c811-4940-9393-bca6a08f819f) 00000020:00000080:2.0:1782481049.398470:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86b8b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1782481049.398717:0:21274:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1782481049.398724:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782481049.398739:0:21274:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782481049.398746:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782481049.398869:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782481049.398878:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1782481049.398885:0:21274:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1782481049.398890:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782481049.398894:0:21274:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782481049.398902:0:21274:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9f5b87804800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782481049.398908:0:21274:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9f5b87564d40) has exports, disconnecting them 00000020:00080000:3.0:1782481049.398913:0:21274:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9f5b87804800), last request at 1782480971 00000020:00000080:3.0:1782481049.398917:0:21274:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3d39 00000020:00080000:3.0:1782481049.398930:0:21274:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f5b87804800): rc 0 00000020:00000080:3.0:1782481049.398934:0:21274:0:(genops.c:906:class_export_put()) final put ffff9f5b87804800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1782481049.399587:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5cb1fe9000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1782481049.399597:0:37:0:(genops.c:906:class_export_put()) final put ffff9f5b883f8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1782481049.399600:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b883f8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1782481049.399606:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1782481049.399659:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b87804800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1782481049.399679:0:21274:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1782481049.399683:0:21274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1782481049.399686:0:21274:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782481049.399705:0:21274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782481049.399722:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9f5b87801800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1782481049.399776:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1782481049.399878:0:18249:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1782481049.399960:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1782481049.400043:0:20868:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1782481049.400138:0:17077:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f5b86883200:17077] 0 exiting: rc = 1 00000100:00100000:2.0:1782481049.400254:0:17078:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f5c893e3000:17078] 1 exiting: rc = 0 00000100:00100000:2.0:1782481049.400331:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400580:0:17081:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f5b87a8b000:17081] 2 exiting: rc = 0 00000100:00100000:2.0:1782481049.400649:0:17132:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f5cb5cdc000:17132] 3 exiting: rc = 0 00000100:00100000:2.0:1782481049.400762:0:17080:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f5b86882c00:17080] 1 exiting: rc = 0 00000100:00100000:2.0:1782481049.400851:0:17079:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f5c893e2400:17079] 0 exiting: rc = 1 00000100:00100000:2.0:1782481049.400902:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400910:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400921:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400927:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400933:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400939:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400946:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400951:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400956:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400961:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400966:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400971:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400977:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400982:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400988:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400993:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.400998:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401003:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401008:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401013:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401018:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401024:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401029:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401035:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401041:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401059:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401065:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401070:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401075:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401080:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401085:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401091:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401096:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401102:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401108:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401114:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401118:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401123:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401129:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401134:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401139:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401143:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401148:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401153:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401159:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401166:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401170:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401175:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401180:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401185:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401190:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401196:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401201:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401207:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401212:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401218:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401223:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401228:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401233:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401238:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401252:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401258:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401262:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.401268:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1782481049.401862:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782481049.401871:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1782481049.401877:0:21274:0:(genops.c:906:class_export_put()) final put ffff9f5b87803800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1782481049.401882:0:21274:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b87803800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1782481049.401888:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1782481049.401973:0:21274:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5b86b89800 1 00000020:00000080:2.0:1782481049.401979:0:21274:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x65dae4c042ee3cde 00000020:00000080:2.0:1782481049.401986:0:21274:0:(genops.c:906:class_export_put()) final put ffff9f5c88578800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1782481049.401998:0:21274:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1782481049.402007:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5c88578800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1782481049.402018:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481049.402023:0:21274:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782481049.402027:0:21274:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff9f5b874e0000) has no exports 00000020:00000080:2.0:1782481049.532587:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782481049.532602:0:21274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1782481049.532607:0:21274:0:(genops.c:906:class_export_put()) final put ffff9f5b86b8e000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1782481049.532612:0:21274:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5b86b8e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1782481049.532622:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1782481049.533041:0:21274:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9f5b86b8d800 00000020:01000000:2.0:1782481049.533067:0:21274:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1782481049.533201:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782481049.533207:0:21274:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782481049.533212:0:21274:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9f5cb2e28000) has no exports 00000020:00000080:2.0:1782481049.533234:0:21274:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782481049.533240:0:21274:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1782481049.533243:0:21274:0:(genops.c:906:class_export_put()) final put ffff9f5cb1fe8000/OSS_uuid 00000020:00000080:2.0:1782481049.533246:0:21274:0:(genops.c:865:class_export_destroy()) destroying export ffff9f5cb1fe8000/OSS_uuid for OSS 00000020:01000000:2.0:1782481049.533252:0:21274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1782481049.533394:0:18604:0:(service.c:3182:ptlrpc_main()) ll_ost00_002: service thread [ffff9f5b87a8de00:18604] 2 exiting: rc = 0 00000100:00080000:0.0:1782481049.533572:0:17090:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1782481049.533814:0:18603:0:(service.c:3182:ptlrpc_main()) ll_ost00_001: service thread [ffff9f5cb1d08000:18603] 1 exiting: rc = 0 00000100:00100000:0.0:1782481049.533864:0:18602:0:(service.c:3182:ptlrpc_main()) ll_ost00_000: service thread [ffff9f5cb1da9c00:18602] 0 exiting: rc = 1 00000100:00100000:0.0:1782481049.533926:0:19137:0:(service.c:3182:ptlrpc_main()) ll_ost00_003: service thread [ffff9f5b879db200:19137] 3 exiting: rc = 0 00000100:00100000:2.0:1782481049.538865:0:19539:0:(service.c:3182:ptlrpc_main()) ll_ost00_004: service thread [ffff9f5b81aab200:19539] 4 exiting: rc = 0 00000100:00100000:0.0:1782481049.539137:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539150:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539156:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539161:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539167:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539179:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539189:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539195:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539200:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539207:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539213:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539218:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539224:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539229:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539234:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539240:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539247:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539254:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539263:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539271:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539280:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539521:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539528:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539534:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539540:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539557:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539562:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539567:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539573:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539577:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539582:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539587:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539592:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539598:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539603:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539609:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539614:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539619:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539625:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539630:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539635:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539640:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539645:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539651:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539672:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539681:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539732:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539742:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539747:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539752:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539760:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539766:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539772:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539777:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539785:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539791:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539797:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539803:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539808:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539813:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539828:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539833:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539838:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.539843:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782481049.543475:0:18606:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f5cb1d12a00:18606] 1 exiting: rc = 0 00000100:00100000:3.0:1782481049.548106:0:18605:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f5b87a8dc00:18605] 0 exiting: rc = 1 00000100:00100000:0.0:1782481049.548421:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548428:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548434:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548439:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548444:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548449:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548454:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548459:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548464:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548469:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548475:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548480:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548486:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548491:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548536:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548541:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548546:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548551:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548556:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548562:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548568:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548573:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548578:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548583:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548587:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548592:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548597:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548602:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548608:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548615:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548620:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548637:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548642:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548647:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548652:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548657:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548662:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548667:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548672:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548677:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548683:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548688:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548710:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548717:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548723:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548728:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548733:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548739:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548757:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548762:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548767:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548985:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.548994:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549000:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549004:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549010:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549014:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549019:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549024:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549029:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549036:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549041:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549047:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.549052:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.551654:0:18607:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f5cc1c0fe00:18607] 0 exiting: rc = 1 00000100:00100000:3.0:1782481049.555280:0:18609:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f5cb1fb4400:18609] 2 exiting: rc = 0 00000100:00100000:3.0:1782481049.555934:0:18608:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f5cc1c0f600:18608] 1 exiting: rc = 0 00000100:00100000:0.0:1782481049.558195:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558217:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558224:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558231:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558236:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558242:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558248:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558254:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558259:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558264:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558269:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558275:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558281:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558296:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558302:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558308:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558313:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558319:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558340:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558347:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558353:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558358:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558363:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558368:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558374:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558380:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558385:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558390:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558396:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558402:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558408:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558415:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558421:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558430:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558439:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558447:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558469:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558475:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558480:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558487:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558492:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558498:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558519:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558526:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558531:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558537:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558541:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558547:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558553:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558559:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558564:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558569:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558574:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558588:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558594:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558613:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558620:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558625:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558631:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558636:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558642:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558646:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558652:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.558658:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.569085:0:18611:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f5c90da1a00:18611] 1 exiting: rc = 0 00000100:00100000:3.0:1782481049.572054:0:18610:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f5b8796e000:18610] 0 exiting: rc = 1 00000100:00100000:0.0:1782481049.572687:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.572725:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.572731:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.572736:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.572741:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.572996:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573013:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573018:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573024:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573029:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573035:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573040:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573045:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573056:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573062:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573067:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573071:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573077:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573082:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573087:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573092:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573097:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573102:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573106:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573111:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573117:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573121:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573126:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573132:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573138:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573143:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573567:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573578:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573618:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573624:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573630:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573635:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573640:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573644:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573650:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573654:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573665:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573670:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573675:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573680:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573685:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573690:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573828:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573834:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573838:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573843:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573848:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573854:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573858:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573863:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573867:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573872:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573877:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573882:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573886:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573891:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573895:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573900:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782481049.573904:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576276:0:18612:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f5c90da0000:18612] 0 exiting: rc = 1 00000100:00100000:0.0:1782481049.576527:0:18613:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f5c90da1600:18613] 1 exiting: rc = 0 00000100:00100000:3.0:1782481049.576633:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576648:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576673:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576680:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576686:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576727:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576734:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576741:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576984:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.576994:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577002:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577008:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577014:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577033:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577499:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577513:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577525:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577537:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577549:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577558:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577565:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577573:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577579:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577585:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577590:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577596:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577617:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577624:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577630:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577636:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577642:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577647:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577653:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577658:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577663:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577669:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577674:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577679:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.577991:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578000:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578005:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578011:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578017:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578022:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578028:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578033:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578039:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578044:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578060:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578065:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578084:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578090:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578096:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578103:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578109:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578114:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578120:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578125:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578131:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578137:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578143:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578218:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578228:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782481049.578241:0:21274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1782481049.598425:0:21274:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1782481068.723254:0:22040:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1782481079.603837:0:22639:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782481079.603844:0:22639:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1782481079.603845:0:22639:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1782481079.603953:0:22639:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f5cb59c2800 00000020:01000004:3.0:1782481079.603969:0:22639:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1782481079.603978:0:22639:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1782481079.603992:0:22639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f5c8a1719c0) 00000020:00000080:3.0:1782481079.604007:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1782481079.659024:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1782481079.661306:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.667866:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.668134:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.668570:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.670894:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.671243:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.672263:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1782481079.672603:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.672955:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.673324:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.674799:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1782481079.676616:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1782481079.677073:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.677529:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1782481079.677859:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1782481079.678061:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.682332:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.683092:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.683646:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.684083:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1782481079.684364:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.684785:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.685000:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1782481079.685271:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.685766:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.685958:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1782481079.686333:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.693045:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.693957:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1782481079.694306:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1782481079.694789:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1782481079.695000:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.695258:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1782481079.697254:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1782481079.699805:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1782481079.700270:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1782481079.700931:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1782481079.701128:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1782481079.701397:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1782481079.701944:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1782481079.702145:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1782481079.702602:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1782481079.703051:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1782481079.703328:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1782481079.703815:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1782481079.704014:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1782481079.708361:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1782481079.709430:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1782481079.710076:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1782481079.710879:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1782481079.711118:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1782481079.712458:0:22639:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1782481079.714122:0:22639:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782481079.714679:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782481079.714690:0:22639:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782481079.714817:0:22639:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x65dae4c042ee42e9 00000020:01000004:2.0:1782481079.714825:0:22639:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1782481079.714830:0:22639:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782481079.714835:0:22639:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f5cb59c2800 from MGS 00000020:01000004:2.0:1782481079.714839:0:22639:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782481079.714850:0:22639:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f5cb5f7b380) 00000020:00000080:2.0:1782481079.714863:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782481079.715080:0:22639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5cb59c2800 from MGS, refs=2 00080000:01000000:2.0:1782481079.715085:0:22639:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782481079.715091:0:22639:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x65dae4c042ee42f7 00000100:00100000:2.0:1782481079.715274:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782481079.715605:0:22639:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782481079.715612:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782481079.716250:0:22639:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782481079.716258:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1782481079.717239:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782481079.717395:0:22639:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782481079.718521:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1782481079.723583:0:22639:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1782481079.723597:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1782481079.724167:0:22639:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1782481079.724175:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782481079.726450:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481079.726454:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481079.726456:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481079.726973:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481079.726975:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481079.726977:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481079.729077:0:22639:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1782481079.731452:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1782481079.741261:0:22639:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1782481079.742160:0:22651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1782481079.742236:0:22639:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1782481079.742272:0:22639:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782481079.744984:0:22639:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782481079.745493:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782481079.746098:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782481079.746107:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1782481079.746888:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1782481079.746902:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782481079.747365:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1782481079.747371:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1782481079.748279:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1782481079.748301:0:22639:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.111@tcp' 00000020:01000004:2.0:1782481079.748303:0:22639:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1782481079.748333:0:22639:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.111@tcp (typ=mgc) 00000020:00000080:2.0:1782481079.748345:0:22639:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.111@tcp (ffff9f5cb5f799c0) 00000020:00000080:2.0:1782481079.748360:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1782481079.748442:0:22639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5cb5cbc000@MGC192.168.204.111@tcp: add connection 192.168.204.111@tcp at head 00010000:00010000:2.0:1782481079.748584:0:22639:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.111@tcp-0 is initialized 00000040:01000000:2.0:1782481079.748590:0:22639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 1 is initialized 10000000:01000000:2.0:1782481079.751625:0:22656:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1782481079.751688:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.111@tcp (uuid 93f44a9c-11b5-4eed-b910-753bd776bd7b) 00000020:00000080:2.0:1782481079.751736:0:22639:0:(genops.c:1406:class_connect()) connect: client 93f44a9c-11b5-4eed-b910-753bd776bd7b, cookie 0x65dae4c042ee4305 00000100:00080000:2.0:1782481079.751748:0:22639:0:(import.c:512:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782481079.751754:0:22639:0:(import.c:626:import_select_connection()) MGC192.168.204.111@tcp: import ffff9f5cb5cbc000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481079.751787:0:22639:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bf800 x1869066301306112/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782481079.751814:0:22639:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 93f44a9c-11b5-4eed-b910-753bd776bd7b->MGS 00000020:01000004:2.0:1782481079.751835:0:22639:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1782481079.751839:0:22639:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1782481079.751853:0:22639:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f5cb5f78000) 00000020:00000080:2.0:1782481079.751864:0:22639:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1782481079.759354:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:93f44a9c-11b5-4eed-b910-753bd776bd7b:3646:1869066301306112:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1782481079.759441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782481079.759838:0:22655:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1782481079.760835:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301306112 00000100:00100000:3.0:1782481079.760850:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301306112 00000100:00100000:3.0:1782481079.760902:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782481079.760910:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3646:x1869066301306112:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1782481079.760939:0:22653:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 93f44a9c-11b5-4eed-b910-753bd776bd7b@0@lo t0 exp 0000000000000000 cur 696 last 0 00000020:00000080:3.0:1782481079.760973:0:22653:0:(genops.c:1406:class_connect()) connect: client 93f44a9c-11b5-4eed-b910-753bd776bd7b, cookie 0x65dae4c042ee4313 00000100:00080000:3.0:1782481079.761122:0:22653:0:(import.c:65:import_set_state_nolock()) ffff9f5b87b90800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782481079.761330:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+5:3646:x1869066301306112:12345-0@lo:250:mount.lustre.0 Request processed in 419us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481079.761338:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782481079.761391:0:3646:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782481079.761400:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.111@tcp: connect to target with instance 0 00000100:00080000:3.0:1782481079.761407:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782481079.761412:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782481079.761416:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5cbc000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782481079.761418:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782481079.761550:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782481079.761556:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:93f44a9c-11b5-4eed-b910-753bd776bd7b:3646:1869066301306112:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1782481079.774849:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782481079.775722:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1782481079.775731:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1782481079.776863:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1782481079.776873:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1782481079.777333:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1782481079.777340:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1782481079.790235:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782481079.790407:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1782481079.790413:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1782481079.791589:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1782481079.791598:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782481079.865390:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782481079.865896:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782481079.865911:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1782481079.867173:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1782481079.867185:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1782481079.867896:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782481079.868060:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782481079.868067:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782481079.869109:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782481079.869118:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1782481079.870104:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782481079.870322:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782481079.870328:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1782481079.871899:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782481079.871909:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1782481079.877019:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782481079.877301:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782481079.877308:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782481079.878276:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782481079.878284:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782481079.917961:0:22639:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782481079.918823:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782481079.918833:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1782481079.923234:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782481079.923250:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1782481079.925406:0:22639:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782481079.925421:0:22639:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1782481079.931397:0:22639:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1782481079.931439:0:22639:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1782481079.931445:0:22639:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1782481079.931552:0:22639:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782481079.931591:0:22639:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.111@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1782481079.931596:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782481079.931598:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782481079.931599:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481079.931600:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481079.931601:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481079.931602:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481079.931604:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782481079.931605:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782481079.931607:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481079.931609:0:22639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782481079.931612:0:22639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1782481079.931614:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782481079.931615:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782481079.931616:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481079.931617:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481079.931618:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481079.931619:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481079.931620:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782481079.931621:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782481079.931622:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481079.931623:0:22639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782481079.931650:0:22639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782481079.936414:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782481079.936522:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481079.936566:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b87a099c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481079.936673:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301306240 00000100:00100000:3.0:1782481079.936680:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301306240 00000100:00100000:3.0:1782481079.937057:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782481079.937068:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+5:22639:x1869066301306240:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782481079.937135:0:22654:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782481079.937138:0:22654:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782481079.937152:0:22654:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1782481079.945495:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1782481079.946538:0:22654:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1782481079.952270:0:22676:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1782481079.952278:0:22676:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1782481079.952281:0:22676:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1782481079.952284:0:22676:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1782481079.952474:0:22676:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1782481079.952752:0:22654:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782481079.952763:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782481079.956232:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+5:22639:x1869066301306240:12345-0@lo:253:mount.lustre.0 Request processed in 19158us (19701us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481079.956250:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782481079.956354:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306240:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782481079.956369:0:22639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782481079.956373:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782481079.956375:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782481079.956376:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782481079.956377:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782481079.956378:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782481079.956379:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782481079.956381:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782481079.956382:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782481079.956384:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782481079.956385:0:22639:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782481079.956407:0:22639:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f5cb59c2800 from lustre-MDT0000 10000000:01000000:1.0:1782481079.956440:0:22639:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1782481079.956444:0:22639:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782481079.956457:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f5cb5f799c0 10000000:01000000:1.0:1782481079.956462:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782481079.956469:0:22639:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9f5cb5f799c0 from 1 10000000:01000000:1.0:1782481079.956472:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782481079.956511:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.956522:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.956531:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481079.956551:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782481079.956586:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481079.956676:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481079.963183:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301306368 00000100:00100000:3.0:1782481079.963198:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301306368 00000100:00100000:3.0:1782481079.963261:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782481079.963272:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+5:22639:x1869066301306368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782481079.963290:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481079.963315:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca6eb5600/0x65dae4c042ee4321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee431a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481079.963340:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca6eb5600/0x65dae4c042ee4321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee431a expref: 6 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481079.963353:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca6eb5600/0x65dae4c042ee4321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee431a expref: 6 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481079.963362:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb5600, rc 0) 00000100:00100000:3.0:1782481079.963446:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+6:22639:x1869066301306368:12345-0@lo:101:mount.lustre.0 Request processed in 176us (6858us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481079.963454:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782481079.963786:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481079.963806:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.963815:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481079.964075:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481079.964126:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481079.964163:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481079.964230:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301306496 00000100:00100000:2.0:1782481079.964236:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301306496 00000100:00100000:2.0:1782481079.964268:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782481079.964276:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+6:22639:x1869066301306496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782481079.964348:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+6:22639:x1869066301306496:12345-0@lo:501:mount.lustre.0 Request processed in 73us (222us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782481079.964356:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782481079.964432:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306496:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782481079.964464:0:22639:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782481079.964491:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.964499:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481079.964508:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f5cb59c2800 10000000:01000000:1.0:1782481079.964512:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782481079.964515:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f5cb59c2800 10000000:01000000:1.0:1782481079.964517:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1782481079.964520:0:22639:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9f5cb59c2800 from 1 10000000:01000000:1.0:1782481079.964523:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1782481079.964542:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74c00/0x65dae4c042ee4328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.964549:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74c00/0x65dae4c042ee4328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.964557:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74c00/0x65dae4c042ee4328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481079.964568:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782481079.964591:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481079.973317:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782481079.973543:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301306624 00000100:00100000:0.0:1782481079.973554:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301306624 00000100:00100000:0.0:1782481079.974033:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782481079.974045:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+6:22639:x1869066301306624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481079.974062:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481079.974083:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111c400/0x65dae4c042ee432f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4328 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481079.976153:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111c400/0x65dae4c042ee432f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4328 expref: 7 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481079.976174:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111c400/0x65dae4c042ee432f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4328 expref: 7 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481079.976185:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111c400, rc 0) 00000100:00100000:0.0:1782481079.976285:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+7:22639:x1869066301306624:12345-0@lo:101:mount.lustre.0 Request processed in 2241us (11691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481079.976294:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782481079.976521:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481079.976543:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74c00/0x65dae4c042ee4328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee432f expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.976554:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74c00/0x65dae4c042ee4328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee432f expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481079.976598:0:22639:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1782481079.976621:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74c00/0x65dae4c042ee4328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee432f expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.976628:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74c00/0x65dae4c042ee4328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee432f expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481079.976636:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782481079.976641:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782481079.976647:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f5cb59c2800 10000000:01000000:1.0:1782481079.976649:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1782481079.976653:0:22639:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1782481079.976656:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782481079.976683:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75e00/0x65dae4c042ee4336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.976722:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75e00/0x65dae4c042ee4336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.976731:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75e00/0x65dae4c042ee4336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481079.976751:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782481079.976788:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481079.976816:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782481079.977000:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301306752 00000100:00100000:0.0:1782481079.977006:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301306752 00000100:00100000:0.0:1782481079.977041:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782481079.977050:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+7:22639:x1869066301306752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481079.977063:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481079.977075:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111d600/0x65dae4c042ee433d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4336 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481079.977106:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111d600/0x65dae4c042ee433d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4336 expref: 8 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481079.977115:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111d600/0x65dae4c042ee433d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4336 expref: 8 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481079.977122:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111d600, rc 0) 00000100:00100000:0.0:1782481079.977165:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+8:22639:x1869066301306752:12345-0@lo:101:mount.lustre.0 Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481079.977172:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481079.977362:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481079.977375:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75e00/0x65dae4c042ee4336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee433d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481079.977389:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75e00/0x65dae4c042ee4336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee433d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481079.977445:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481079.977476:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481079.977505:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782481079.977563:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301306880 00000100:00100000:0.0:1782481079.977567:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301306880 00000100:00100000:0.0:1782481079.977585:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782481079.977590:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+8:22639:x1869066301306880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481079.977761:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+9:22639:x1869066301306880:12345-0@lo:501:mount.lustre.0 Request processed in 169us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481079.977769:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782481079.977893:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301306880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481079.977939:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301307008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481079.977975:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481079.977999:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782481079.978199:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301307008 00000100:00100000:0.0:1782481079.978203:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301307008 00000100:00100000:0.0:1782481079.978223:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782481079.978228:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+9:22639:x1869066301307008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782481079.979142:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+9:22639:x1869066301307008:12345-0@lo:503:mount.lustre.0 Request processed in 907us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481079.979151:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782481079.979312:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301307008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481079.979776:0:22677:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22677:1869066301307136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782481079.979825:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481079.979861:0:22677:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782481079.979962:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301307136 00000100:00100000:2.0:1782481079.979969:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301307136 00000100:00100000:2.0:1782481079.979999:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782481079.980006:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+9:22677:x1869066301307136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782481079.980935:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+9:22677:x1869066301307136:12345-0@lo:502:llog_process_th.0 Request processed in 925us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481079.980944:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782481079.981190:0:22677:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22677:1869066301307136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782481079.981222:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481079.981234:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481079.981236:0:22677:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782481079.981241:0:22677:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1782481079.981244:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782481079.981259:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f5b87563380) 00000020:00000080:1.0:1782481079.981275:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1782481079.981282:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1782481079.981375:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1782481079.981382:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x65dae4c042ee434b 00000020:00000080:1.0:1782481079.981825:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1782481079.981830:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481079.981834:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481079.981835:0:22677:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1782481079.981838:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481079.981842:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481079.981843:0:22677:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1782481079.981846:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782481079.981854:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f5b875619c0) 00000020:00000080:1.0:1782481079.981864:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1782481079.981867:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1782481079.981869:0:22677:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1782481079.981871:0:22677:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1782481079.981877:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782481079.981927:0:22677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5cb59c2800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1782481079.981938:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f5b87560000) 00000020:00000080:1.0:1782481079.981946:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1782481079.981994:0:22677:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1782481079.981998:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x65dae4c042ee4360 00000020:00000080:1.0:1782481079.982569:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1782481079.982579:0:22677:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782481079.982587:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x65dae4c042ee4367 00080000:01000000:1.0:1782481079.982592:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782481079.982596:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x65dae4c042ee436e 00010000:00010000:1.0:1782481080.081379:0:22677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1782481080.082183:0:22677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:1.0:1782481080.082555:0:22677:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1782481080.084468:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f5b87564d40) 00000020:00000080:1.0:1782481080.084491:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1782481080.084593:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1782481080.084601:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x65dae4c042ee437c 00000020:00000080:0.0:1782481080.090857:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1782481080.095403:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x65dae4c042ee4383 00000020:00000080:0.0:1782481080.096567:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1782481080.096589:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481080.096594:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.096596:0:22677:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1782481080.096600:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782481080.096603:0:22677:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1782481080.096605:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782481080.096606:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782481080.096607:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782481080.096610:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.096611:0:22677:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782481080.096613:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481080.096618:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.096619:0:22677:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1782481080.096624:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1782481080.096672:0:22677:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1782481080.096713:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481080.096717:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.096719:0:22677:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1782481080.096721:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481080.096723:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.096725:0:22677:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1782481080.096728:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782481080.096733:0:22677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:00000080:0.0:1782481080.096760:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782481080.096777:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f5b874e4d40) 00000020:00000080:0.0:1782481080.096790:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1782481080.096795:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782481080.096849:0:22677:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1782481080.096854:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1782481080.096859:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x65dae4c042ee4391 00010000:00080000:0.0:1782481080.096902:0:22677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5b86a63800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1782481080.098504:0:22677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1782481080.102663:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782481080.102678:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1782481080.102859:0:22677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1782481080.102991:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x65dae4c042ee4398 00000100:00080000:2.0:1782481080.103002:0:22677:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782481080.103007:0:22677:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f5b86a63800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481080.103040:0:22677:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bf480 x1869066301307264/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782481080.103067:0:22677:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1782481080.103159:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782481080.103174:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782481080.103177:0:22677:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1782481080.103180:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782481080.103182:0:22677:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1782481080.103184:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782481080.103185:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782481080.103187:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782481080.103189:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782481080.103190:0:22677:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782481080.103193:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782481080.103197:0:22677:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1782481080.103200:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782481080.103202:0:22677:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782481080.103204:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782481080.103208:0:22677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:2.0:1782481080.103231:0:22677:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782481080.103233:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782481080.103246:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f5cb5f7cd40) 00000020:00000080:2.0:1782481080.103257:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1782481080.103262:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782481080.103333:0:22677:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1782481080.103339:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1782481080.103345:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x65dae4c042ee43a6 00010000:00080000:2.0:1782481080.103385:0:22677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5cb654b000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:2.0:1782481080.103564:0:22677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1782481080.103915:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301307264:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782481080.103977:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481080.104451:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301307264 00000100:00100000:2.0:1782481080.104459:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301307264 00000100:00100000:2.0:1782481080.104493:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782481080.104500:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1869066301307264:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1782481080.104518:0:22664:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1782481080.105817:0:22677:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1782481080.107044:0:22677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1782481080.113854:0:22677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782481080.116282:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1782481080.128025:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1782481080.133449:0:22683:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1782481080.133465:0:22683:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782481080.136487:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782481080.136501:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782481080.136537:0:22677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782481080.136554:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x65dae4c042ee43ad 00000100:00080000:1.0:1782481080.136565:0:22677:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782481080.136572:0:22677:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f5cb654b000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481080.136604:0:22677:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1dd9c00 x1869066301307392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782481080.136631:0:22677:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1782481080.136714:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481080.136718:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481080.136720:0:22677:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782481080.136724:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782481080.136727:0:22677:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1782481080.136728:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782481080.136730:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782481080.136732:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782481080.136735:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481080.136736:0:22677:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782481080.136739:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782481080.136743:0:22677:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1782481080.136746:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481080.136747:0:22677:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782481080.136750:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782481080.136753:0:22677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:1.0:1782481080.136774:0:22677:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782481080.136777:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782481080.136788:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f5b86a28000) 00000020:00000080:1.0:1782481080.136800:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1782481080.136804:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782481080.136892:0:22677:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782481080.136898:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1782481080.136904:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x65dae4c042ee43bb 00010000:00080000:1.0:1782481080.136933:0:22677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5c9113a000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:1.0:1782481080.137124:0:22677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1782481080.137332:0:22677:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782481080.137348:0:22677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1782481080.137924:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301307392:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782481080.137981:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301307392 offset 0 length 520: 4 00000040:00080000:1.0:1782481080.141648:0:22677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782481080.142320:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1782481080.142480:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:3.0:1782481080.145459:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1869066301307264:12345-0@lo:38:llog_process_th.0 Request processed in 40950us (41474us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782481080.145493:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1782481080.146555:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b86a63800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782481080.146571:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782481080.146575:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301307264:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1782481080.147546:0:22685:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1782481080.147551:0:22685:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782481080.148388:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782481080.148401:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782481080.148436:0:22677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782481080.148457:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x65dae4c042ee43c2 00000100:00080000:1.0:1782481080.148466:0:22677:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782481080.148471:0:22677:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f5c9113a000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481080.148503:0:22677:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1dd8380 x1869066301307520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782481080.148531:0:22677:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1782481080.148616:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301307520:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1782481080.148676:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301307520 offset 0 length 520: 4 00000020:01000000:1.0:1782481080.149179:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481080.149185:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481080.149187:0:22677:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782481080.149190:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481080.149194:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481080.149196:0:22677:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782481080.149198:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782481080.149200:0:22677:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782481080.149203:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481080.149205:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481080.149206:0:22677:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782481080.149209:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481080.149219:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481080.149221:0:22677:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782481080.149225:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782481080.149255:0:22677:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22677:1869066301307648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782481080.149307:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481080.149386:0:22677:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481080.150297:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301307648 00000100:00100000:3.0:1782481080.150306:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301307648 00000100:00100000:3.0:1782481080.150357:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782481080.150365:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+9:22677:x1869066301307648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782481080.150506:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+9:22677:x1869066301307648:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481080.150514:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782481080.150840:0:22677:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22677:1869066301307648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782481080.150881:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481080.150888:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481080.150890:0:22677:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782481080.150895:0:22677:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1782481080.151248:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1782481080.151268:0:22639:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782481080.151287:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75e00/0x65dae4c042ee4336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee433d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481080.151298:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75e00/0x65dae4c042ee4336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee433d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481080.151306:0:22639:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f5cb59c2800 from 1 10000000:01000000:3.0:1782481080.151309:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782481080.151390:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481080.151398:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481080.151406:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481080.151438:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301307776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782481080.151477:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481080.151501:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c86ec9600 going to sleep for 11 seconds 00000100:00100000:2.0:1782481080.151650:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301307776 00000100:00100000:2.0:1782481080.151996:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301307776 00000100:00100000:3.0:1782481080.152086:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481080.152094:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+9:22639:x1869066301307776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782481080.152104:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481080.152117:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee43c9 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481080.152249:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee43c9 expref: 10 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481080.152261:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee43c9 expref: 10 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481080.152270:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4c00, rc 0) 00000100:00100000:3.0:1782481080.152319:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+10:22639:x1869066301307776:12345-0@lo:101:mount.lustre.0 Request processed in 225us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481080.152326:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782481080.152407:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301307776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481080.152423:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481080.152430:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481080.154353:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301307904:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1782481080.154428:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481080.154508:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f32e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481080.154568:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301307904 00000100:00100000:2.0:1782481080.154576:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301307904 00000100:00100000:2.0:1782481080.154632:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782481080.154641:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+10:22639:x1869066301307904:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1782481080.154671:0:22652:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782481080.154677:0:22652:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1782481080.162134:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+10:22639:x1869066301307904:12345-0@lo:256:mount.lustre.0 Request processed in 7483us (7696us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481080.162168:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782481080.162392:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301307904:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1782481080.163018:0:22639:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782481080.163042:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.163054:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481080.163064:0:22639:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5cb59c2800 from 1 10000000:01000000:0.0:1782481080.163067:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782481080.163109:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.163118:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.163128:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481080.163161:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782481080.163270:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481080.163312:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cc1b9c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782481080.163642:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301308032 00000100:00100000:2.0:1782481080.163660:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301308032 00000100:00100000:2.0:1782481080.163740:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782481080.163750:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+10:22639:x1869066301308032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481080.163762:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481080.163778:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee43d7 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481080.163813:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee43d7 expref: 11 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481080.163824:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee43d7 expref: 11 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481080.163833:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddf600, rc 0) 00000100:00100000:2.0:1782481080.163889:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22639:x1869066301308032:12345-0@lo:101:mount.lustre.0 Request processed in 139us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481080.163896:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782481080.164042:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308032:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481080.164057:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481080.164067:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481080.164129:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481080.164173:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481080.164204:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481080.164357:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301308160 00000100:00100000:2.0:1782481080.164363:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301308160 00000100:00100000:2.0:1782481080.164390:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782481080.164396:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22639:x1869066301308160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782481080.164519:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22639:x1869066301308160:12345-0@lo:501:mount.lustre.0 Request processed in 122us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481080.164526:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782481080.164596:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308160:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481080.164624:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481080.164719:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481080.164746:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481080.164844:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301308288 00000100:00100000:2.0:1782481080.164849:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301308288 00000100:00100000:2.0:1782481080.164888:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782481080.164896:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22639:x1869066301308288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782481080.164983:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22639:x1869066301308288:12345-0@lo:503:mount.lustre.0 Request processed in 88us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481080.164991:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782481080.165132:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308288:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481080.166081:0:22687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22687:1869066301308416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782481080.166133:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481080.166176:0:22687:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9a300 going to sleep for 11 seconds 00000100:00100000:2.0:1782481080.166281:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301308416 00000100:00100000:2.0:1782481080.166288:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301308416 00000100:00100000:2.0:1782481080.166329:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782481080.166337:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22687:x1869066301308416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782481080.166831:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22687:x1869066301308416:12345-0@lo:502:llog_process_th.0 Request processed in 493us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481080.166840:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782481080.167113:0:22687:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22687:1869066301308416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782481080.167209:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481080.167219:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.167221:0:22687:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782481080.167228:0:22687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f5cb59c2800 00000020:00000080:0.0:1782481080.167231:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782481080.167239:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481080.167241:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.167242:0:22687:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782481080.167245:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481080.167247:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.167248:0:22687:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782481080.167251:0:22687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f5cb59c2800 00000020:00000080:0.0:1782481080.167253:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782481080.167313:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481080.167317:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.167318:0:22687:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782481080.167321:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481080.167323:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.167324:0:22687:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782481080.167328:0:22687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f5cb59c2800 00000020:00000080:0.0:1782481080.167329:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782481080.167347:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481080.167349:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.167350:0:22687:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782481080.167353:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481080.167355:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.167356:0:22687:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1782481080.167359:0:22687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f5cb59c2800 00000020:00000080:0.0:1782481080.167361:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782481080.167412:0:22687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22687:1869066301308544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782481080.167455:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481080.167482:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301308544 00000100:00100000:0.0:1782481080.167488:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301308544 00000100:00100000:0.0:1782481080.167515:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782481080.167523:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22687:x1869066301308544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782481080.169025:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22687:x1869066301308544:12345-0@lo:502:llog_process_th.0 Request processed in 1498us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481080.169036:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782481080.169098:0:22687:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cc1b9c240 going to sleep for 11 seconds 00000100:00100000:0.0:1782481080.169118:0:22687:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22687:1869066301308544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782481080.169223:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481080.169230:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481080.169232:0:22687:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1782481080.169235:0:22687:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1782481080.169303:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1782481080.169321:0:22639:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782481080.169336:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.169348:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481080.169393:0:22639:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1782481080.169396:0:22639:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f5cb59c2800 10000000:01000000:0.0:1782481080.169399:0:22639:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f5cb59c2800 10000000:01000000:0.0:1782481080.169403:0:22639:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782481080.169408:0:22639:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f5cb59c2800 from 1 10000000:01000000:0.0:1782481080.169416:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782481080.170251:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d200/0x65dae4c042ee43e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.170263:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d200/0x65dae4c042ee43e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.170273:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d200/0x65dae4c042ee43e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481080.170290:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782481080.170339:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481080.170373:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cc1b9c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782481080.170487:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301308672 00000100:00100000:2.0:1782481080.170494:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301308672 00000100:00100000:2.0:1782481080.170534:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782481080.170542:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22639:x1869066301308672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481080.170553:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481080.170565:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c8fddfa00/0x65dae4c042ee43ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee43e5 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481080.171815:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c8fddfa00/0x65dae4c042ee43ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee43e5 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481080.171831:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c8fddfa00/0x65dae4c042ee43ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee43e5 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481080.171840:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddfa00, rc 0) 00000100:00100000:2.0:1782481080.172127:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22639:x1869066301308672:12345-0@lo:101:mount.lustre.0 Request processed in 1583us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481080.172136:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782481080.173254:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481080.173278:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d200/0x65dae4c042ee43e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee43ec expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.173289:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d200/0x65dae4c042ee43e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee43ec expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481080.173369:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481080.173417:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481080.173485:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cc1b9c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782481080.182527:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301308800 00000100:00100000:1.0:1782481080.182541:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301308800 00000100:00100000:1.0:1782481080.182620:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782481080.182632:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22639:x1869066301308800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481080.182843:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22639:x1869066301308800:12345-0@lo:501:mount.lustre.0 Request processed in 213us (9426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481080.182852:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782481080.183943:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481080.184008:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782481080.184078:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481080.184161:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b868b1840 going to sleep for 11 seconds 00000100:00100000:2.0:1782481080.189087:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301308928 00000100:00100000:2.0:1782481080.189102:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301308928 00000100:00100000:2.0:1782481080.189395:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782481080.189406:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22639:x1869066301308928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782481080.189840:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301308928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782481080.190009:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22639:x1869066301308928:12345-0@lo:503:mount.lustre.0 Request processed in 173us (5498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481080.190025:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782481080.206934:0:22689:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22689:1869066301309056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782481080.207018:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481080.207069:0:22689:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b868b1300 going to sleep for 11 seconds 00000100:00100000:3.0:1782481080.207430:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301309056 00000100:00100000:3.0:1782481080.207438:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301309056 00000100:00100000:3.0:1782481080.207521:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782481080.207531:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c837ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22689:x1869066301309056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782481080.208673:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c837ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22689:x1869066301309056:12345-0@lo:502:llog_process_th.0 Request processed in 125us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481080.208691:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782481080.214586:0:22689:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22689:1869066301309056:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1782481080.214668:0:22689:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1782481080.214709:0:22689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f5b874e3380) 00000020:00000080:0.0:1782481080.214730:0:22689:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1782481080.216597:0:22689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5cb59c2800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782481080.216605:0:22689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5cb59c2800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782481080.216608:0:22689:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5cb59c2800 4 00010000:00080000:0.0:1782481080.216650:0:22689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5c9a380800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1782481080.218262:0:22689:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1782481080.218378:0:22689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1782481080.218421:0:22689:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782481080.218434:0:22689:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x65dae4c042ee43fa 00000100:00080000:0.0:1782481080.218444:0:22689:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782481080.218449:0:22689:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f5c9a380800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1782481080.218481:0:22689:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ece680 x1869066301309184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782481080.218511:0:22689:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782481080.220011:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869066301309184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782481080.220115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481080.220178:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301309184 00000100:00100000:1.0:1782481080.220187:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301309184 00000100:00100000:1.0:1782481080.220235:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782481080.220244:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301309184:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782481080.220298:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1869066301309184:12345-0@lo:38:llog_process_th.0 Request processed in 54us (183us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782481080.220305:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782481080.220310:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782481080.220317:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c9a380800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782481080.220322:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782481080.220325:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869066301309184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782481080.222843:0:22689:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22689:1869066301309312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782481080.222914:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481080.222956:0:22689:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1782481080.223824:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301309312 00000100:00100000:3.0:1782481080.223837:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301309312 00000100:00100000:3.0:1782481080.224794:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782481080.224809:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c837ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22689:x1869066301309312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782481080.225201:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c837ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22689:x1869066301309312:12345-0@lo:502:llog_process_th.0 Request processed in 394us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481080.225210:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782481080.227000:0:22689:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22689:1869066301309312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782481080.227069:0:22689:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1eced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22689:1869066301309440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782481080.227132:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481080.227173:0:22689:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b868b1780 going to sleep for 11 seconds 00000100:00100000:2.0:1782481080.227241:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301309440 00000100:00100000:2.0:1782481080.227247:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301309440 00000100:00100000:2.0:1782481080.227295:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782481080.227304:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22689:x1869066301309440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782481080.227459:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22689:x1869066301309440:12345-0@lo:502:llog_process_th.0 Request processed in 155us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481080.227467:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782481080.238310:0:22689:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1eced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:93f44a9c-11b5-4eed-b910-753bd776bd7b:22689:1869066301309440:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782481080.238372:0:22689:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1782481080.238617:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1782481080.238640:0:22639:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782481080.238680:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d200/0x65dae4c042ee43e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee43ec expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481080.238714:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c9111d200/0x65dae4c042ee43e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee43ec expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782481080.238763:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782481080.238766:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782481080.238767:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481080.238768:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481080.238769:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481080.238775:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481080.238777:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782481080.238778:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782481080.238780:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481080.238781:0:22639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782481080.238785:0:22639:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1782481080.238787:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782481080.238788:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782481080.238789:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481080.238790:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481080.238791:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481080.238792:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481080.238792:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782481080.238793:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782481080.238794:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481080.238795:0:22639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782481080.238818:0:22639:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782481080.238835:0:22639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301309568:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782481080.239074:0:22639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481080.239116:0:22639:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8ec0d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481080.239161:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301309568 00000100:00100000:0.0:1782481080.239167:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301309568 00000100:00100000:0.0:1782481080.239214:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782481080.239222:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22639:x1869066301309568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782481080.239247:0:22652:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782481080.239260:0:22652:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782481080.245049:0:22652:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782481080.245070:0:22652:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1782481080.245187:0:22675:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782481080.245193:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782481080.245216:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.245236:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee43c9 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.245246:0:22675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.245283:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee43c9 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.245297:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee43c9 expref: 12 pid: 22654 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481080.245310:0:22675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1eced80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301309696:0@lo:104: 00000100:00100000:0.0:1782481080.245373:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481080.245412:0:22675:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b868b1840 going to sleep for 11 seconds 00000100:00100000:3.0:1782481080.245503:0:22643:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301309696 00000100:00100000:3.0:1782481080.245510:0:22643:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301309696 00000100:00100000:3.0:1782481080.245560:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782481080.245570:0:22643:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:22675:x1869066301309696:12345-0@lo:104: 00010000:00010000:3.0:1782481080.245583:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481080.245645:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782481080.245651:0:22643:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:22675:x1869066301309696:12345-0@lo:104: Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481080.245658:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782481080.245782:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22639:x1869066301309568:12345-0@lo:253:mount.lustre.0 Request processed in 6559us (6707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481080.245791:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1782481080.245815:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481080.245822:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481080.245830:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1782481080.245839:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481080.245848:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782481080.245855:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481080.245860:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782481080.245897:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481080.245903:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782481080.245925:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481080.245932:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee43c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee43d0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481080.245947:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481080.245949:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481080.245951:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481080.245993:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301309824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782481080.246023:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481080.246108:0:22675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1eced80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301309696:0@lo:104: 00010000:00010000:1.0:1782481080.246124:0:22675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481080.246400:0:22645:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301309824 00000100:00100000:0.0:1782481080.246406:0:22645:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301309824 00010000:00010000:0.0:1782481080.246425:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee43c9 expref: 12 pid: 22654 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481080.246446:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782481080.246453:0:22645:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:3650:x1869066301309824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782481080.246464:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782481080.246468:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee43c9 expref: 12 pid: 22654 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246477:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee43c9 expref: 12 pid: 22654 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246490:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca6eb4c00/0x65dae4c042ee43d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee43c9 expref: 12 pid: 22654 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246502:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246510:0:22645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782481080.246522:0:22645:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001329699s 00010000:00010000:0.0:1782481080.246527:0:22645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246533:0:22645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246539:0:22645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246553:0:22645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246558:0:22645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111cc00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481080.246562:0:22645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246569:0:22645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246589:0:22645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481080.246598:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782481080.246626:0:22645:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:3650:x1869066301309824:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481080.246632:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782481080.246819:0:22639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:22639:1869066301309568:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782481080.246831:0:22639:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782481080.246834:0:22639:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782481080.246836:0:22639:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782481080.246844:0:22639:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782481080.246845:0:22639:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782481080.246846:0:22639:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782481080.246848:0:22639:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782481080.246849:0:22639:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782481080.246850:0:22639:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782481080.246852:0:22639:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782481080.246853:0:22639:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782481080.246864:0:22639:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1782481080.247415:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301309824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481080.247446:0:22675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481080.247456:0:22675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481080.247463:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4401 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782481080.273321:0:22639:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1782481080.273571:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1782481080.275047:0:22700:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1782481080.275425:0:22700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1782481080.277121:0:22699:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:0.0:1782481080.277128:0:22699:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:00080000:3.0:1782481080.277447:0:22700:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1782481080.277519:0:22700:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1782481080.281128:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1782481080.282385:0:22701:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9f5cb1dd9500 x1869066301309952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481080.282398:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00000040:01000000:2.0:1782481080.284551:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1782481080.284586:0:22639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782481080.285037:0:22639:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782481080.285044:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1782481080.285079:0:22639:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782481080.286066:0:22639:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782481080.286602:0:22639:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782481080.286632:0:22639:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1782481080.293949:0:22639:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1782481080.294625:0:22639:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1782481080.298066:0:22639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1782481080.304562:0:22639:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782481080.304604:0:22639:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdd14180b988 00100000:10000000:3.0:1782481080.304613:0:22639:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1782481080.306008:0:22639:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782481080.306026:0:22639:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782481080.306050:0:22639:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1782481080.306076:0:22639:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1782481080.310877:0:22639:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782481080.311113:0:22639:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782481080.732688:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782481081.248980:0:22695:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782481081.248990:0:22695:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782481081.253621:0:22695:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782481081.253647:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1782481081.312169:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 10000000:01000000:1.0:1782481081.510820:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782481081.510827:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f5cb59c2800 from 11 10000000:01000000:1.0:1782481081.510832:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782481081.510878:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481081.510889:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481081.510900:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481081.510925:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301310080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782481081.511002:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481081.511047:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9a780 going to sleep for 11 seconds 00000100:00100000:0.0:1782481081.511578:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301310080 00000100:00100000:0.0:1782481081.511588:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301310080 00000100:00100000:0.0:1782481081.511648:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782481081.511667:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+11:22656:x1869066301310080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481081.511681:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481081.511718:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4408 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481081.511740:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4408 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481081.511757:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4408 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481081.511766:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111d000, rc 0) 00000100:00100000:0.0:1782481081.511809:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22656:x1869066301310080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481081.511815:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782481081.513155:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301310080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782481081.513191:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481081.513206:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481081.513268:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301310208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1782481081.513342:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481081.513376:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9a780 going to sleep for 11 seconds 00000100:00100000:0.0:1782481081.513491:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301310208 00000100:00100000:0.0:1782481081.513498:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301310208 00000100:00100000:0.0:1782481081.513544:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782481081.513554:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22656:x1869066301310208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782481081.513581:0:22652:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782481081.513596:0:22652:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782481081.513599:0:22652:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1782481081.513688:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:22656:x1869066301310208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481081.513712:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782481081.513807:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301310208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782481081.513848:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782481081.513855:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481081.513864:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481081.758363:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782481082.268843:0:22695:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782481082.268854:0:22695:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782481082.269008:0:22695:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1782481082.269062:0:22695:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782481082.269257:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1782481082.337241:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:1.0:1782481082.780524:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481083.361152:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:0.0:1782481083.804135:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481084.381467:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:1.0:1782481084.828619:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782481085.202938:0:22944:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1782481085.408211:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782481085.408219:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1782481085.408223:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f5b86a63800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782481085.408239:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 696 00000100:00080000:3.0:1782481085.408246:0:38:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1782481085.408255:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f5b86a63800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481085.408281:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b88815c00 x1869066301310464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782481085.408297:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481085.408301:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481085.408304:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481085.408307:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481085.408309:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782481085.408312:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782481085.408314:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f5c9a380800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782481085.408318:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f5c9a380800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481085.408333:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b88814700 x1869066301310592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782481085.410448:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301310336:0@lo:400:kworker.0 00000100:00100000:3.0:1782481085.410519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481085.411790:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301310464:0@lo:38:kworker.0 00000100:00100000:2.0:1782481085.411893:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481085.411918:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869066301310592:0@lo:38:kworker.0 00000100:00100000:2.0:1782481085.411951:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481085.412000:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301310592 00000100:00100000:2.0:1782481085.412007:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301310592 00000100:00100000:2.0:1782481085.412042:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782481085.412048:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1869066301310592:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1782481085.412075:0:22661:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:2.0:1782481085.412108:0:22661:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x65dae4c042ee4416 00000004:00100000:2.0:1782481085.412123:0:22661:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782481085.412229:0:22661:0:(import.c:65:import_set_state_nolock()) ffff9f5b880be800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782481085.412277:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869066301310592:12345-0@lo:38:kworker.0 Request processed in 227us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481085.412284:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782481085.412326:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f5b88814700 x1869066301310592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782481095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782481085.412340:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1782481085.412348:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1782481085.412352:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782481085.412354:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c9a380800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782481085.412360:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869066301310592:0@lo:38:kworker.0 00000100:00100000:0.0:1782481085.415777:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00000100:00100000:2.0:1782481085.416175:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301310336 00000100:00100000:2.0:1782481085.416185:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301310336 00000100:00100000:2.0:1782481085.416241:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782481085.416250:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:3647:x1869066301310336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481085.416369:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:3647:x1869066301310336:12345-0@lo:400:kworker.0 Request processed in 119us (5849us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481085.416377:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782481085.421556:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301310336:0@lo:400:kworker.0 00000100:00100000:3.0:1782481085.421648:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301310464 00000100:00100000:3.0:1782481085.421655:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301310464 00000100:00100000:3.0:1782481085.421687:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782481085.421814:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1869066301310464:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1782481085.421834:0:22665:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782481085.421925:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1869066301310464:12345-0@lo:38:kworker.0 Request processed in 110us (10031us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782481085.421932:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1782481085.421977:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b86a63800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481085.421983:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782481085.421986:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301310464:0@lo:38:kworker.0 00010000:00010000:1.0:1782481085.860980:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782481086.312060:0:22996:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782481086.313641:0:22996:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782481086.432603:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:1.0:1782481086.883084:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782481087.218785:0:23046:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782481087.218961:0:23046:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1782481087.467784:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:1.0:1782481087.907759:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481088.486266:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:1.0:1782481088.924836:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481089.500730:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:0.0:1782481089.947953:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481090.523801:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481080/real 1782481080] req@ffff9f5cb1dd8380 x1869066301307520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481090 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481090.523847:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5cb1dd8380 x1869066301307520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481090 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481090.523858:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481080/real 1782481080] req@ffff9f5cb1dd9c00 x1869066301307392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481090 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481090.523871:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5cb1dd9c00 x1869066301307392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481090 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782481090.523888:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c9113a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782481090.523909:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782481090.523913:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301307520:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782481090.523918:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb654b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782481090.523923:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782481090.523925:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301307392:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1782481090.524155:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1782481090.524160:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1782481090.524163:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5b86a63800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481090.524167:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 701 00000100:00080000:2.0:1782481090.524185:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1782481090.524192:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f5b86a63800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481090.524211:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bdc00 x1869066301310848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782481090.524226:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481090.524229:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782481090.524231:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5cb654b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481090.524234:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 696 00000100:00080000:2.0:1782481090.524236:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782481090.524239:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f5cb654b000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481090.524248:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bc000 x1869066301310976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782481090.524255:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481090.524258:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782481090.524265:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5c9113a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481090.524267:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 696 00000100:00080000:2.0:1782481090.524270:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782481090.524273:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f5c9113a000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481090.524282:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bce00 x1869066301311104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782481090.524321:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301311232:0@lo:400:kworker.0 00000100:00100000:2.0:1782481090.524380:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481090.524446:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301311232 00000100:00100000:2.0:1782481090.524453:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301311232 00000100:00100000:2.0:1782481090.524501:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782481090.524510:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301311232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481090.524571:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301311232:12345-0@lo:400:kworker.0 Request processed in 61us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481090.524578:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782481090.524619:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f5b882bf100 x1869066301311232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481090.524642:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301311232:0@lo:400:kworker.0 00000100:00100000:2.0:1782481090.524659:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301310848:0@lo:38:kworker.0 00000100:00100000:2.0:1782481090.524683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481090.524724:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301310976:0@lo:8:kworker.0 00000400:00000100:2.0:1782481090.524745:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301310976 offset 0 length 520: 4 00000100:00100000:2.0:1782481090.524760:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301311104:0@lo:8:kworker.0 00000400:00000100:2.0:1782481090.524773:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301311104 offset 0 length 520: 4 00000100:00100000:0.0:1782481090.524931:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00000100:00100000:3.0:1782481090.525337:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301310720:0@lo:400:kworker.0 00000100:00100000:3.0:1782481090.525377:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481090.525428:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301310848 00000100:00100000:3.0:1782481090.525434:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301310848 00000100:00100000:3.0:1782481090.525464:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782481090.525470:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1869066301310848:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1782481090.525496:0:22665:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782481090.525536:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1869066301310848:12345-0@lo:38:kworker.0 Request processed in 63us (851us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782481090.525543:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782481090.525636:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301310720 00000100:00100000:0.0:1782481090.525640:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301310720 00000100:00100000:0.0:1782481090.525670:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782481090.525676:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:3648:x1869066301310720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481090.525736:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:3648:x1869066301310720:12345-0@lo:400:kworker.0 Request processed in 59us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481090.525742:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782481090.525920:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301310720:0@lo:400:kworker.0 00000100:00080000:3.0:1782481090.525947:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b86a63800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481090.525951:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1782481090.525954:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301310848:0@lo:38:kworker.0 00010000:00010000:2.0:1782481090.971897:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481091.547880:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:3.0:1782481091.999869:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782481092.508977:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782481092.575121:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:2.0:1782481093.021720:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481093.597255:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:0.0:1782481094.046424:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782481094.269987:0:23391:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782481094.269991:0:23391:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1782481094.269993:0:23391:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1782481094.270248:0:23391:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f5b85b56800 00000020:01000004:0.0:1782481094.270263:0:23391:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1782481094.270274:0:23391:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1782481094.270287:0:23391:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9f5b874e19c0) 00000020:00000080:0.0:1782481094.270301:0:23391:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782481094.363578:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1782481094.364529:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1782481094.365284:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1782481094.368851:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1782481094.369200:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1782481094.369948:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1782481094.370147:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1782481094.370506:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1782481094.370788:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1782481094.370987:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1782481094.371290:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1782481094.371593:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1782481094.371935:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1782481094.372331:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1782481094.375127:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.375497:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.375768:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.375958:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.376365:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.377307:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.377597:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.377874:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.378105:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.378535:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.378884:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.379137:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.383384:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.383719:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.384047:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.384800:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.385014:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.385310:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.385537:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.386476:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.386824:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.387019:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.387481:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.387824:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.388026:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.388489:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.388827:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.389414:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1782481094.389658:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.390333:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.390712:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1782481094.393913:0:23391:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00080000:01000000:3.0:1782481094.395645:0:23391:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782481094.396476:0:23391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1782481094.396488:0:23391:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782481094.396501:0:23391:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x65dae4c042ee4424 00000020:01000004:3.0:1782481094.396509:0:23391:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1782481094.396530:0:23391:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782481094.396534:0:23391:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782481094.396540:0:23391:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1782481094.396568:0:23391:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1782481094.396572:0:23391:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1782481094.408620:0:23391:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782481094.408685:0:23391:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.111@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1782481094.408690:0:23391:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782481094.408726:0:23391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782481094.408728:0:23391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481094.408729:0:23391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481094.408730:0:23391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481094.408732:0:23391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481094.408733:0:23391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782481094.408736:0:23391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481094.408737:0:23391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782481094.408742:0:23391:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1782481094.408744:0:23391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782481094.408745:0:23391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782481094.408747:0:23391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481094.408757:0:23391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481094.408757:0:23391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481094.408759:0:23391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481094.408760:0:23391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782481094.408761:0:23391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481094.408762:0:23391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782481094.408805:0:23391:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1782481094.408827:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782481094.408912:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481094.408955:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9a000 going to sleep for 11 seconds 00000100:00100000:0.0:1782481094.409027:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301311360 00000100:00100000:0.0:1782481094.409034:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301311360 00000100:00100000:0.0:1782481094.409101:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782481094.409111:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:23391:x1869066301311360:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782481094.409142:0:22652:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1782481094.409145:0:22652:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1782481094.409162:0:22652:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1782481094.409662:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:23391:x1869066301311360:12345-0@lo:253:mount.lustre.0 Request processed in 552us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.409670:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782481094.409951:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782481094.409962:0:23391:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1782481094.409964:0:23391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782481094.409965:0:23391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782481094.409967:0:23391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481094.409968:0:23391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481094.409969:0:23391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481094.409970:0:23391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481094.409972:0:23391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782481094.409974:0:23391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481094.409975:0:23391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782481094.409997:0:23391:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f5b85b56800 from lustre-MDT0001 10000000:01000000:2.0:1782481094.410028:0:23391:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1782481094.410031:0:23391:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1782481094.410039:0:23391:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f5cb5f799c0 local copy 00010000:00010000:2.0:1782481094.410052:0:23391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481094.410301:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782481094.410334:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481094.410361:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c84d16840 going to sleep for 11 seconds 00000100:00100000:0.0:1782481094.410674:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301311488 00000100:00100000:0.0:1782481094.410681:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301311488 00000100:00100000:0.0:1782481094.410748:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782481094.410757:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:23391:x1869066301311488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481094.411032:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:23391:x1869066301311488:12345-0@lo:501:mount.lustre.0 Request processed in 275us (696us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782481094.411040:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782481094.414003:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311488:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1782481094.414289:0:23391:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782481094.414344:0:23391:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782481094.414355:0:23391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.414454:0:23391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481094.414488:0:23391:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f5b85b56800 10000000:01000000:0.0:1782481094.414493:0:23391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782481094.414499:0:23391:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f5cb5f799c0 10000000:01000000:0.0:1782481094.414502:0:23391:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1782481094.414505:0:23391:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9f5cb5f799c0 from 1 10000000:01000000:0.0:1782481094.414508:0:23391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782481094.414542:0:23391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ce00/0x65dae4c042ee442b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.414550:0:23391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ce00/0x65dae4c042ee442b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.414561:0:23391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ce00/0x65dae4c042ee442b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481094.414583:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782481094.414644:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481094.415031:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f76a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782481094.415317:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301311616 00000100:00100000:1.0:1782481094.415325:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301311616 00000100:00100000:1.0:1782481094.415482:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782481094.415492:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+12:23391:x1869066301311616:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481094.415518:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481094.415533:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca7d75000/0x65dae4c042ee4432 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee442b expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.415555:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca7d75000/0x65dae4c042ee4432 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee442b expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.415565:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca7d75000/0x65dae4c042ee4432 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee442b expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.415574:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca7d75000, rc 0) 00000100:00100000:1.0:1782481094.415624:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+13:23391:x1869066301311616:12345-0@lo:101:mount.lustre.0 Request processed in 133us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.415630:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782481094.415729:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481094.415745:0:23391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ce00/0x65dae4c042ee442b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4432 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.415760:0:23391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ce00/0x65dae4c042ee442b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4432 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481094.415779:0:23391:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782481094.415804:0:23391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ce00/0x65dae4c042ee442b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4432 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.415811:0:23391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ce00/0x65dae4c042ee442b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4432 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481094.415821:0:23391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f5b85b56800 10000000:01000000:2.0:1782481094.415825:0:23391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1782481094.415828:0:23391:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9f5b85b56800 from 1 10000000:01000000:2.0:1782481094.415831:0:23391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1782481094.415848:0:23391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde800/0x65dae4c042ee4439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.415854:0:23391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde800/0x65dae4c042ee4439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.415861:0:23391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde800/0x65dae4c042ee4439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481094.415873:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782481094.415901:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481094.433635:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c84d16b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782481094.439424:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301311744 00000100:00100000:0.0:1782481094.439442:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301311744 00000100:00100000:0.0:1782481094.439513:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782481094.439523:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+13:23391:x1869066301311744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481094.439556:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481094.439599:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111d800/0x65dae4c042ee4440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4439 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.442359:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111d800/0x65dae4c042ee4440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4439 expref: 14 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.442382:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111d800/0x65dae4c042ee4440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4439 expref: 14 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.442392:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111d800, rc 0) 00000100:00100000:0.0:1782481094.442495:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+14:23391:x1869066301311744:12345-0@lo:101:mount.lustre.0 Request processed in 2973us (26592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.442504:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782481094.442592:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481094.442614:0:23391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde800/0x65dae4c042ee4439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4440 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.442632:0:23391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde800/0x65dae4c042ee4439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4440 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481094.442668:0:23391:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1782481094.442686:0:23391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde800/0x65dae4c042ee4439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4440 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.442718:0:23391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde800/0x65dae4c042ee4439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4440 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481094.442726:0:23391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1782481094.442732:0:23391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782481094.442739:0:23391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f5b85b56800 10000000:01000000:2.0:1782481094.442742:0:23391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1782481094.442747:0:23391:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1782481094.442750:0:23391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1782481094.442778:0:23391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddee00/0x65dae4c042ee4447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.442786:0:23391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddee00/0x65dae4c042ee4447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.442795:0:23391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddee00/0x65dae4c042ee4447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481094.442815:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782481094.442875:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481094.442917:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c84d16b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782481094.443537:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301311872 00000100:00100000:1.0:1782481094.443545:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301311872 00000100:00100000:1.0:1782481094.443598:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782481094.443607:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+14:23391:x1869066301311872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481094.443619:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481094.443633:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca7d74a00/0x65dae4c042ee444e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4447 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.443651:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca7d74a00/0x65dae4c042ee444e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4447 expref: 15 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.443662:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca7d74a00/0x65dae4c042ee444e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4447 expref: 15 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.443682:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca7d74a00, rc 0) 00000100:00100000:1.0:1782481094.443756:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301311872:12345-0@lo:101:mount.lustre.0 Request processed in 149us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.443763:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782481094.443833:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301311872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481094.443858:0:23391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddee00/0x65dae4c042ee4447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee444e expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.443869:0:23391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddee00/0x65dae4c042ee4447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee444e expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782481094.446963:0:23391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1782481094.452572:0:23391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782481094.459878:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1782481094.459954:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1782481094.459975:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1782481094.460318:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1782481094.460334:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1782481094.460348:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1782481094.460361:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1782481094.460374:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1782481094.460421:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1782481094.460438:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1782481094.460579:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1782481094.460594:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1782481094.460606:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1782481094.460628:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1782481094.460639:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1782481094.460650:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1782481094.460661:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1782481094.460672:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1782481094.460683:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1782481094.460712:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1782481094.460727:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1782481094.460739:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1782481094.460750:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1782481094.460761:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1782481094.460785:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1782481094.460801:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1782481094.460813:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1782481094.460824:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1782481094.460837:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1782481094.460864:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1782481094.460878:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1782481094.460892:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1782481094.460904:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1782481094.460917:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1782481094.460931:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1782481094.460959:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1782481094.460976:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1782481094.461648:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1782481094.461666:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1782481094.461680:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1782481094.461751:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1782481094.461768:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1782481094.461782:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1782481094.461796:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1782481094.461826:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1782481094.461832:0:23391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1782481094.461970:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301312000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481094.462589:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.462642:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb59bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.463116:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301312000 00000100:00100000:2.0:1782481094.463126:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301312000 00000100:00100000:2.0:1782481094.463182:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782481094.463192:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301312000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782481094.463358:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301312000:12345-0@lo:501:mount.lustre.0 Request processed in 167us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481094.463366:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782481094.463561:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301312000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481094.463602:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301312128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782481094.463648:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.463679:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb59bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.463812:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301312128 00000100:00100000:2.0:1782481094.463818:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301312128 00000100:00100000:2.0:1782481094.463853:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782481094.463860:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301312128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782481094.465474:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301312128:12345-0@lo:503:mount.lustre.0 Request processed in 1607us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481094.465486:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782481094.465760:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301312128:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782481094.466470:0:23391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782481094.466555:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301312256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481094.466616:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.466659:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb59bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.466906:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301312256 00000100:00100000:2.0:1782481094.466913:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301312256 00000100:00100000:2.0:1782481094.466961:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782481094.466970:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301312256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782481094.468024:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301312256:12345-0@lo:502:mount.lustre.0 Request processed in 1052us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481094.468158:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782481094.468333:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301312256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481094.468551:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1782481094.468582:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1782481094.468596:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1782481094.468610:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1782481094.468622:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1782481094.468634:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1782481094.468663:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1782481094.468678:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1782481094.468719:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1782481094.468950:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1782481094.468967:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1782481094.468979:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1782481094.468990:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1782481094.469002:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1782481094.469027:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1782481094.469039:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1782481094.469051:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1782481094.469062:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1782481094.469073:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1782481094.469098:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1782481094.469113:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1782481094.469125:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1782481094.469149:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1782481094.469176:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1782481094.469188:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1782481094.469199:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1782481094.469420:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1782481094.469438:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1782481094.469453:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1782481094.469466:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1782481094.469478:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1782481094.469488:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1782481094.469499:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1782481094.469512:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1782481094.469524:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1782481094.469536:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1782481094.469548:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1782481094.469560:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1782481094.469585:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1782481094.469600:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1782481094.469611:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1782481094.469623:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1782481094.469635:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1782481094.469648:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1782481094.471953:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301312384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481094.472056:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481094.472128:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301312384 00000100:00100000:2.0:1782481094.472137:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301312384 00000100:00100000:2.0:1782481094.472194:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782481094.472204:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301312384:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782481094.474568:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301312384:12345-0@lo:502:mount.lustre.0 Request processed in 2355us (2501us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481094.474582:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782481094.474993:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb59bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481094.475021:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301312384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481094.475117:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1782481094.475132:0:23391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1782481094.477487:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782481094.477503:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481094.477506:0:23395:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1782481094.477512:0:23395:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1782481094.477516:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782481094.477534:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9f5c8a173380) 00000020:00000080:3.0:1782481094.477560:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1782481094.477565:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782481094.477654:0:23395:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782481094.477665:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x65dae4c042ee445c 00000020:00000080:3.0:1782481094.479832:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1782481094.479840:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782481094.479845:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481094.479847:0:23395:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1782481094.479851:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782481094.479856:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481094.479857:0:23395:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1782481094.479861:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782481094.479873:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9f5c8a174d40) 00000020:00000080:3.0:1782481094.479891:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1782481094.479897:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782481094.479899:0:23395:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1782481094.479901:0:23395:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1782481094.479908:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782481094.479997:0:23395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5b85b56800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1782481094.480012:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9f5c8a170000) 00000020:00000080:3.0:1782481094.480021:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1782481094.480088:0:23395:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782481094.480099:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x65dae4c042ee4471 00000020:00000080:3.0:1782481094.482072:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1782481094.482087:0:23395:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1782481094.482097:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x65dae4c042ee4478 00080000:01000000:3.0:1782481094.482107:0:23395:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782481094.482111:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x65dae4c042ee447f 00010000:00010000:2.0:1782481094.572446:0:23395:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1782481094.573585:0:23395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1782481094.574650:0:23395:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1782481094.582284:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1782481094.582299:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481094.582306:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481094.582308:0:23395:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1782481094.582312:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481094.582318:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481094.582319:0:23395:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1782481094.582323:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1782481094.582328:0:23395:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:00000080:0.0:1782481094.582355:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782481094.582382:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9f5b874e0000) 00000020:00000080:0.0:1782481094.582413:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1782481094.582420:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1782481094.582499:0:23395:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1782481094.582507:0:23395:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782481094.582515:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x65dae4c042ee448d 00010000:00080000:0.0:1782481094.582548:0:23395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5b87a85000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1782481094.591662:0:23395:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1782481094.595745:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1782481094.595762:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1782481094.595798:0:23395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782481094.595820:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x65dae4c042ee4494 00000100:00080000:1.0:1782481094.595829:0:23395:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782481094.595835:0:23395:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f5b87a85000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481094.596112:0:23395:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ddad80 x1869066301312512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782481094.596141:0:23395:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1782481094.596260:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481094.596265:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.596267:0:23395:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1782481094.596271:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782481094.596273:0:23395:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1782481094.596274:0:23395:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782481094.596276:0:23395:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782481094.596277:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782481094.596280:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.596281:0:23395:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782481094.596283:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481094.596288:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.596289:0:23395:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1782481094.596293:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782481094.596326:0:23395:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782481094.596340:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481094.596343:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.596344:0:23395:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1782481094.596347:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782481094.596355:0:23395:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1782481094.596356:0:23395:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782481094.596358:0:23395:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782481094.596360:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782481094.596362:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.596363:0:23395:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782481094.596365:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782481094.597104:0:23395:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1782481094.597113:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.597114:0:23395:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782481094.597120:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782481094.597124:0:23395:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:1.0:1782481094.597146:0:23395:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1782481094.597149:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782481094.597164:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f5b86a2b380) 00000020:00000080:1.0:1782481094.597179:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1782481094.597185:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782481094.597604:0:23395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1782481094.597611:0:23395:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1782481094.597617:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x65dae4c042ee44a2 00010000:00080000:1.0:1782481094.597649:0:23395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5b8822f000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.111@tcp at head 00000100:00100000:3.0:1782481094.597971:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301312512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782481094.598039:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481094.598088:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301312512 00000100:00100000:0.0:1782481094.598102:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301312512 00000100:00100000:0.0:1782481094.598142:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782481094.598156:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1869066301312512:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1782481094.598201:0:22664:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:0.0:1782481094.598236:0:22664:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x65dae4c042ee44a9 00000004:00100000:0.0:1782481094.598250:0:22664:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1782481094.598256:0:22664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:1.0:1782481094.598539:0:23395:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1782481094.601367:0:23395:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:3.0:1782481094.602918:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782481094.602924:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1782481094.602927:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5b86a63800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782481094.602935:0:37:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 707 00000100:00080000:3.0:1782481094.602940:0:37:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1782481094.602948:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f5b86a63800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481094.602996:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b88817800 x1869066301312768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782481094.603028:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481094.603033:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481094.603036:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481094.603039:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782481094.603098:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301312640:0@lo:400:kworker.0 00000100:00100000:3.0:1782481094.603164:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.603213:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782481094.603221:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869066301312896:0@lo:400:kworker.0 00000100:00100000:3.0:1782481094.603253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.603291:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301312640 00000100:00100000:3.0:1782481094.603299:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301312640 00000100:00100000:3.0:1782481094.603342:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782481094.603351:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:3650:x1869066301312640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481094.603412:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:3650:x1869066301312640:12345-0@lo:400:kworker.0 Request processed in 50us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481094.603421:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782481094.603460:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301312896 00000100:00100000:3.0:1782481094.603464:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301312896 00000100:00100000:3.0:1782481094.603495:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782481094.603503:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869066301312896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481094.603541:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869066301312896:12345-0@lo:400:kworker.0 Request processed in 40us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481094.603547:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782481094.603581:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301312640:0@lo:400:kworker.0 00010000:00080000:3.0:1782481094.603612:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f5b88816d80 x1869066301312896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481094.603623:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869066301312896:0@lo:400:kworker.0 00000100:00100000:0.0:1782481094.603991:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301312768:0@lo:38:kworker.0 00000100:00100000:0.0:1782481094.604252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481094.604909:0:22665:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1782481094.604919:0:22665:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:0.0:1782481094.605895:0:23395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1782481094.606663:0:22664:0:(import.c:65:import_set_state_nolock()) ffff9f5b87a82000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481094.606785:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1869066301312512:12345-0@lo:38:llog_process_th.0 Request processed in 8627us (8744us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.606796:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782481094.606819:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301312768 00000100:00100000:0.0:1782481094.606826:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301312768 00000100:00100000:0.0:1782481094.606847:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782481094.606854:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1869066301312768:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1782481094.606911:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1869066301312768:12345-0@lo:38:kworker.0 Request processed in 56us (2659us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782481094.606919:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782481094.608587:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782481094.608599:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b86a63800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782481094.608606:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782481094.608610:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301312768:0@lo:38:kworker.0 00000100:00100000:0.0:1782481094.608629:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782481094.608636:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1782481094.608653:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1782481094.608659:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782481094.608661:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b87a85000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782481094.608676:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301312512:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782481094.612155:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782481094.612184:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301313024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782481094.612279:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.612343:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301313024 00000100:00100000:1.0:1782481094.612352:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301313024 00000100:00100000:1.0:1782481094.612416:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481094.612429:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1869066301313024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782481094.612467:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1782481094.612535:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1869066301313024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.612545:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481094.612609:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301313024:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1782481094.615480:0:23395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782481094.615887:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1782481094.616026:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1782481094.616635:0:23401:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1782481094.616641:0:23401:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1782481094.626250:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00000020:00000080:3.0:1782481094.627488:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1782481094.627505:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782481094.627558:0:23395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782481094.627585:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x65dae4c042ee44b0 00000100:00080000:3.0:1782481094.627598:0:23395:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782481094.627604:0:23395:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f5b8822f000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481094.627655:0:23395:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b88816d80 x1869066301313152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782481094.628163:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301313152:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1782481094.628245:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301313152 offset 0 length 520: 4 00000100:00080000:3.0:1782481094.628325:0:23395:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1782481094.628431:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782481094.628436:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481094.628438:0:23395:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1782481094.628441:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782481094.628444:0:23395:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1782481094.628446:0:23395:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782481094.628447:0:23395:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782481094.628449:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782481094.628451:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481094.628453:0:23395:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782481094.628455:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782481094.628459:0:23395:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1782481094.628463:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481094.628464:0:23395:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782481094.628467:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782481094.628471:0:23395:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:3.0:1782481094.628493:0:23395:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1782481094.628495:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782481094.628511:0:23395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f5c83fb99c0) 00000020:00000080:3.0:1782481094.628526:0:23395:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1782481094.628532:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782481094.628603:0:23395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1782481094.628612:0:23395:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782481094.628619:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x65dae4c042ee44be 00010000:00080000:3.0:1782481094.628668:0:23395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5b879a9000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.111@tcp at head 00010000:00010000:3.0:1782481094.628930:0:23395:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1782481094.629013:0:23395:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1782481094.629028:0:23395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1782481094.629150:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782481094.629156:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782481094.629158:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782481094.629161:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1782481094.636796:0:23395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782481094.637144:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1782481094.637269:0:23395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1782481094.637903:0:23403:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1782481094.637909:0:23403:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782481094.640156:0:23395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1782481094.640172:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782481094.640219:0:23395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1782481094.640242:0:23395:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x65dae4c042ee44c5 00000100:00080000:0.0:1782481094.640254:0:23395:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782481094.640261:0:23395:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f5b879a9000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1782481094.640298:0:23395:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ecdc00 x1869066301313280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782481094.640313:0:23395:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1782481094.640444:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481094.640449:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481094.640451:0:23395:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1782481094.640455:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481094.640458:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481094.640460:0:23395:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782481094.640462:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782481094.640464:0:23395:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782481094.640466:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481094.640468:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481094.640469:0:23395:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782481094.640481:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481094.640484:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481094.640485:0:23395:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782481094.640489:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782481094.640517:0:23395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481094.640520:0:23395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481094.640522:0:23395:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782481094.640525:0:23395:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1782481094.640582:0:23391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1782481094.640611:0:23391:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1782481094.640628:0:23391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddee00/0x65dae4c042ee4447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee444e expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.640639:0:23391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddee00/0x65dae4c042ee4447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee444e expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481094.640648:0:23391:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f5b85b56800 from 1 10000000:01000000:0.0:1782481094.640651:0:23391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782481094.640690:0:23391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.640718:0:23391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.640729:0:23391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481094.640749:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782481094.640827:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782481094.640876:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481094.640882:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481094.640885:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481094.640888:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782481094.642302:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb6570180 going to sleep for 11 seconds 00000100:00100000:1.0:1782481094.642670:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301313280:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1782481094.642756:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301313280 offset 0 length 520: 4 00000100:00100000:0.0:1782481094.642997:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301313408 00000100:00100000:0.0:1782481094.643019:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301313408 00000100:00100000:0.0:1782481094.643088:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782481094.643097:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+15:23391:x1869066301313408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481094.643114:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481094.643131:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee44cc expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.643158:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee44cc expref: 16 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.643168:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee44cc expref: 16 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.643177:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111de00, rc 0) 00000100:00100000:0.0:1782481094.643223:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+16:23391:x1869066301313408:12345-0@lo:101:mount.lustre.0 Request processed in 127us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.643230:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782481094.643284:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481094.643300:0:23391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.643308:0:23391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481094.644315:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313536:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1782481094.644361:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.644413:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbb840 going to sleep for 11 seconds 00000100:00100000:3.0:1782481094.644438:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301313536 00000100:00100000:3.0:1782481094.644447:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301313536 00000100:00100000:3.0:1782481094.644493:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782481094.644502:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+16:23391:x1869066301313536:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1782481094.644520:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782481094.644539:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782481094.644543:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1782481094.644651:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+16:23391:x1869066301313536:12345-0@lo:256:mount.lustre.0 Request processed in 149us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481094.644659:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782481094.644861:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313536:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1782481094.645643:0:23391:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782481094.645805:0:23391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.645817:0:23391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481094.645828:0:23391:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5b85b56800 from 1 10000000:01000000:1.0:1782481094.645831:0:23391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782481094.645881:0:23391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.645903:0:23391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.645913:0:23391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481094.645933:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782481094.645979:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.646011:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbb840 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.651869:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301313664 00000100:00100000:2.0:1782481094.651883:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301313664 00000100:00100000:2.0:1782481094.651952:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782481094.651962:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+16:23391:x1869066301313664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481094.651979:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481094.651998:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee44da expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.652026:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee44da expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.652038:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee44da expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.652064:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddf800, rc 0) 00000100:00100000:2.0:1782481094.652154:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301313664:12345-0@lo:101:mount.lustre.0 Request processed in 194us (6174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481094.652161:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782481094.652438:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481094.652458:0:23391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.652481:0:23391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782481094.654882:0:23391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1782481094.655198:0:23391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782481094.655472:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1782481094.655497:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1782481094.655513:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1782481094.655678:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1782481094.655723:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1782481094.655741:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1782481094.655757:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1782481094.655777:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1782481094.655794:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1782481094.655808:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1782481094.655820:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1782481094.655855:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1782481094.655928:0:23391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1782481094.656016:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481094.656154:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481094.656199:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb6570cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481094.657733:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301313792 00000100:00100000:3.0:1782481094.657746:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301313792 00000100:00100000:3.0:1782481094.657810:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782481094.657821:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301313792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481094.658340:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301313792:12345-0@lo:501:mount.lustre.0 Request processed in 520us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481094.658348:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782481094.658683:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481094.658767:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782481094.658827:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481094.658930:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb6570cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.659002:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301313920 00000100:00100000:2.0:1782481094.659008:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301313920 00000100:00100000:2.0:1782481094.659043:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782481094.659050:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301313920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782481094.659130:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301313920:12345-0@lo:503:mount.lustre.0 Request processed in 79us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481094.659137:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782481094.659143:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301313920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782481094.659733:0:23391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782481094.659811:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481094.659851:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481094.660151:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb6570180 going to sleep for 11 seconds 00000100:00100000:3.0:1782481094.660187:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301314048 00000100:00100000:3.0:1782481094.660199:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301314048 00000100:00100000:3.0:1782481094.660263:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782481094.660271:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301314048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481094.660388:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301314048:12345-0@lo:502:mount.lustre.0 Request processed in 116us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481094.660395:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782481094.660457:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481094.661118:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1782481094.661154:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1782481094.661168:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1782481094.661194:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1782481094.661208:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1782481094.661218:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1782481094.661231:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1782481094.661242:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1782481094.661255:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1782481094.661266:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1782481094.661277:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1782481094.661309:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481094.661362:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.661459:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.668819:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301314176 00000100:00100000:2.0:1782481094.668833:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301314176 00000100:00100000:0.0:1782481094.669016:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782481094.669027:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301314176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481094.669208:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301314176:12345-0@lo:502:mount.lustre.0 Request processed in 182us (7844us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.669216:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782481094.669309:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782481094.669412:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1782481094.669426:0:23391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1782481094.670222:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481094.670232:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.670234:0:23405:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782481094.670241:0:23405:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f5b85b56800 00000020:00000080:1.0:1782481094.670249:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481094.670258:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481094.670261:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.670262:0:23405:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782481094.670265:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481094.670268:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.670269:0:23405:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782481094.670272:0:23405:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f5b85b56800 00000020:00000080:1.0:1782481094.670274:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481094.670332:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481094.670336:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.670337:0:23405:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782481094.670340:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481094.670343:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.670344:0:23405:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782481094.670347:0:23405:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f5b85b56800 00000020:00000080:1.0:1782481094.670349:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481094.670368:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481094.670371:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.670372:0:23405:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782481094.670374:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481094.670376:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.670377:0:23405:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782481094.670381:0:23405:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f5b85b56800 00000020:00000080:1.0:1782481094.670383:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481094.670427:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481094.670431:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481094.670433:0:23405:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782481094.670491:0:23405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1782481094.670672:0:23391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1782481094.670728:0:23391:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782481094.670748:0:23391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.670758:0:23391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481094.670800:0:23391:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782481094.670803:0:23391:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f5b85b56800 10000000:01000000:2.0:1782481094.670811:0:23391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f5b85b56800 10000000:01000000:2.0:1782481094.670815:0:23391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782481094.670821:0:23391:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f5b85b56800 from 1 10000000:01000000:2.0:1782481094.670823:0:23391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782481094.670857:0:23391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde200/0x65dae4c042ee44e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.670865:0:23391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde200/0x65dae4c042ee44e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.670874:0:23391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde200/0x65dae4c042ee44e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481094.670896:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782481094.670953:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481094.670984:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90e9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.673616:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301314304 00000100:00100000:2.0:1782481094.673629:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301314304 00000100:00100000:2.0:1782481094.673684:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782481094.673707:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:23391:x1869066301314304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481094.673724:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481094.673742:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c8fdde000/0x65dae4c042ee44ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee44e8 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.673768:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c8fdde000/0x65dae4c042ee44ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee44e8 expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.673780:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c8fdde000/0x65dae4c042ee44ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee44e8 expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.673801:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fdde000, rc 0) 00000100:00100000:2.0:1782481094.673867:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314304:12345-0@lo:101:mount.lustre.0 Request processed in 175us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481094.673873:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782481094.673934:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481094.673952:0:23391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde200/0x65dae4c042ee44e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee44ef expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481094.673960:0:23391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde200/0x65dae4c042ee44e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee44ef expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782481094.682531:0:23391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1782481094.682849:0:23391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782481094.683079:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1782481094.683106:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1782481094.683119:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1782481094.683131:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1782481094.683142:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1782481094.683155:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1782481094.683169:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1782481094.683181:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1782481094.683193:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1782481094.683205:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1782481094.683219:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1782481094.683231:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1782481094.683243:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1782481094.683256:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1782481094.683285:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1782481094.683311:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1782481094.683324:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1782481094.683337:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1782481094.683350:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1782481094.683360:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1782481094.683372:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1782481094.683414:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1782481094.683429:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1782481094.683562:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1782481094.683582:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1782481094.683595:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1782481094.683609:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1782481094.683622:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1782481094.683636:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1782481094.683649:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1782481094.683677:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1782481094.683717:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1782481094.683734:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1782481094.683748:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1782481094.683761:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1782481094.683772:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1782481094.683787:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1782481094.683800:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1782481094.683814:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1782481094.683828:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1782481094.683843:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1782481094.683856:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1782481094.684067:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1782481094.684083:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1782481094.684095:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1782481094.684107:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1782481094.684134:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1782481094.684147:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1782481094.684300:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1782481094.684321:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1782481094.684337:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1782481094.684343:0:23391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1782481094.687253:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782481094.687320:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481094.687368:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b868b1480 going to sleep for 11 seconds 00000100:00100000:0.0:1782481094.693943:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301314432 00000100:00100000:0.0:1782481094.693957:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301314432 00000100:00100000:0.0:1782481094.694047:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782481094.694058:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481094.694229:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314432:12345-0@lo:501:mount.lustre.0 Request processed in 172us (6907us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.694238:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782481094.700545:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481094.700609:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782481094.700676:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.703594:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb5d08c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.704826:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301314560 00000100:00100000:2.0:1782481094.704837:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301314560 00000100:00100000:2.0:1782481094.704904:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782481094.704913:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314560:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782481094.705071:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314560:12345-0@lo:503:mount.lustre.0 Request processed in 158us (4393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481094.705080:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782481094.705184:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314560:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782481094.705634:0:23391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782481094.705766:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481094.705813:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.705835:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c834ab240 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.705905:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301314688 00000100:00100000:2.0:1782481094.705911:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301314688 00000100:00100000:2.0:1782481094.705932:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782481094.705939:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782481094.706029:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314688:12345-0@lo:502:mount.lustre.0 Request processed in 89us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481094.706036:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782481094.706110:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481094.706272:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1782481094.706299:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1782481094.706312:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1782481094.706324:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1782481094.706338:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1782481094.706352:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1782481094.706364:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1782481094.706376:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1782481094.706389:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1782481094.706413:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1782481094.706446:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1782481094.706461:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1782481094.706474:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1782481094.706485:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1782481094.706498:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1782481094.706512:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1782481094.706524:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1782481094.706536:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1782481094.706549:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1782481094.706561:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1782481094.706574:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1782481094.706587:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1782481094.706600:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1782481094.706615:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1782481094.706628:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1782481094.706642:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1782481094.706670:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1782481094.706687:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1782481094.706740:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1782481094.706753:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1782481094.706765:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1782481094.706776:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1782481094.706790:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1782481094.706803:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1782481094.706817:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1782481094.706829:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1782481094.706840:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1782481094.706850:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1782481094.706860:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1782481094.706870:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1782481094.706882:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1782481094.706893:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1782481094.706920:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1782481094.706944:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1782481094.706959:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1782481094.706973:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1782481094.706987:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1782481094.707000:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1782481094.707037:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481094.707086:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.707109:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c834ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1782481094.707184:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301314816 00000100:00100000:0.0:1782481094.707191:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301314816 00000100:00100000:0.0:1782481094.707224:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782481094.707231:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481094.707326:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314816:12345-0@lo:502:mount.lustre.0 Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.707334:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782481094.708983:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481094.709199:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1782481094.709227:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1782481094.709262:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481094.709322:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.709360:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c834ab240 going to sleep for 11 seconds 00000100:00100000:0.0:1782481094.710525:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301314944 00000100:00100000:0.0:1782481094.710536:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301314944 00000100:00100000:0.0:1782481094.710591:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782481094.710601:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481094.710756:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301314944:12345-0@lo:502:mount.lustre.0 Request processed in 156us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.710764:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782481094.710934:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301314944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481094.710995:0:23391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1782481094.711006:0:23391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1782481094.715388:0:23410:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1782481094.715420:0:23410:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9f5cb2e28000) 00000020:00000080:2.0:1782481094.715513:0:23410:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1782481094.716095:0:23410:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5b85b56800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1782481094.716099:0:23410:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5b85b56800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1782481094.716102:0:23410:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5b85b56800 3 00010000:00080000:1.0:1782481094.716135:0:23410:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5b8822d800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.111@tcp at head 00010000:00010000:1.0:1782481094.717723:0:23410:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1782481094.717819:0:23410:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1782481094.717870:0:23410:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782481094.717883:0:23410:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x65dae4c042ee44fd 00000100:00080000:1.0:1782481094.717893:0:23410:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782481094.717899:0:23410:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f5b8822d800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481094.717933:0:23410:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ddad80 x1869066301315072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782481094.717967:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869066301315072:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782481094.718032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.718088:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301315072 00000100:00100000:1.0:1782481094.718094:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301315072 00000100:00100000:1.0:1782481094.718125:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782481094.718132:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1869066301315072:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782481094.718154:0:22661:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:1.0:1782481094.718179:0:22661:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x65dae4c042ee4504 00000004:00100000:1.0:1782481094.718193:0:22661:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782481094.718220:0:22661:0:(import.c:65:import_set_state_nolock()) ffff9f5cb5b13000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782481094.718268:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869066301315072:12345-0@lo:38:llog_process_th.0 Request processed in 134us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.718275:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782481094.718313:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f5cb1ddad80 x1869066301315072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782481104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481094.718322:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782481094.718329:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1782481094.718336:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782481094.718346:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782481094.718348:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b8822d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782481094.718354:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869066301315072:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1782481094.718375:0:23410:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782481094.720438:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782481094.720449:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782481094.720452:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782481094.720455:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1782481094.720980:0:23410:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1782481094.721042:0:23391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1782481094.721074:0:23391:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782481094.721095:0:23391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde200/0x65dae4c042ee44e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee44ef expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481094.721107:0:23391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c8fdde200/0x65dae4c042ee44e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee44ef expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782481094.721223:0:23391:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782481094.721226:0:23391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782481094.721227:0:23391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782481094.721234:0:23391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782481094.721235:0:23391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782481094.721236:0:23391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782481094.721237:0:23391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782481094.721238:0:23391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782481094.721239:0:23391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782481094.721243:0:23391:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1782481094.721245:0:23391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782481094.721246:0:23391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1782481094.721247:0:23391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782481094.721248:0:23391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782481094.721249:0:23391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782481094.721250:0:23391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782481094.721250:0:23391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782481094.721251:0:23391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782481094.721252:0:23391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782481094.721276:0:23391:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1782481094.721296:0:23391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301315200:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782481094.721362:0:23391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481094.721411:0:23391:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cc1b9c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782481094.721532:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301315200 00000100:00100000:2.0:1782481094.721540:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301315200 00000100:00100000:2.0:1782481094.721584:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782481094.721600:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301315200:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782481094.721626:0:22653:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782481094.721638:0:22653:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1782481094.728040:0:22640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1782481094.728124:0:22653:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782481094.728140:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1782481094.728586:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:23391:x1869066301315200:12345-0@lo:253:mount.lustre.0 Request processed in 6982us (7219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.728598:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:1.0:1782481094.728608:0:22675:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782481094.728613:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782481094.728635:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.728650:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4408 expref: 17 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.728659:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee44cc expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.728667:0:22675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481094.728715:0:23391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:23391:1869066301315200:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1782481094.728723:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee44cc expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481094.728728:0:23391:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1782481094.728731:0:23391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782481094.728733:0:23391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1782481094.728734:0:23391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481094.728735:0:23391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481094.728737:0:23391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:1.0:1782481094.728737:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee44cc expref: 17 pid: 22652 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782481094.728738:0:23391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481094.728740:0:23391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782481094.728742:0:23391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481094.728743:0:23391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782481094.728758:0:23391:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1782481094.728761:0:22675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301315328:0@lo:104: 00000100:00100000:1.0:1782481094.728795:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782481094.728831:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee4408 expref: 17 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.728838:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee4408 expref: 17 pid: 22653 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481094.728845:0:22675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301315456:0@lo:104: 00000100:00100000:1.0:1782481094.728863:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.728877:0:22675:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782481094.728892:0:22644:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301315328 00000100:00100000:1.0:1782481094.728897:0:22644:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301315328 00000100:00100000:1.0:1782481094.728920:0:22644:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301315456 00000100:00100000:1.0:1782481094.728922:0:22644:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301315456 00000100:00100000:1.0:1782481094.728934:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782481094.728940:0:22644:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:22675:x1869066301315328:12345-0@lo:104: 00010000:00010000:1.0:1782481094.728952:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.728991:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782481094.728997:0:22644:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:22675:x1869066301315328:12345-0@lo:104: Request processed in 57us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.729002:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782481094.729014:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782481094.729020:0:22644:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:22675:x1869066301315456:12345-0@lo:104: 00010000:00010000:1.0:1782481094.729027:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729065:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782481094.729070:0:22644:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:22675:x1869066301315456:12345-0@lo:104: Request processed in 50us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.729076:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1782481094.729234:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782481094.729240:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729247:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111cc00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1782481094.729251:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729260:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782481094.729267:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481094.729273:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782481094.729301:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729307:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782481094.729327:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729334:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111cc00/0x65dae4c042ee44cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee44d3 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729351:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481094.729354:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729359:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d75a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1782481094.729362:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729368:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782481094.729375:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481094.729380:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782481094.729395:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729411:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782481094.729418:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729425:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee440f expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.729438:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481094.729440:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481094.729442:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481094.729448:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481094.729467:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301315584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782481094.729496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.729516:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782481094.729522:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301315712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782481094.730783:0:22675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301315328:0@lo:104: 00000100:00100000:0.0:1782481094.730796:0:22675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301315456:0@lo:104: 00010000:00010000:0.0:1782481094.730819:0:22675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481094.732925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.733001:0:22645:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301315584 00000100:00100000:1.0:1782481094.733008:0:22645:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301315584 00010000:00010000:1.0:1782481094.733045:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee44cc expref: 18 pid: 22652 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481094.733071:0:22645:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301315712 00000100:00100000:1.0:1782481094.733074:0:22645:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301315712 00010000:00010000:1.0:1782481094.733085:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4408 expref: 19 pid: 22653 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481094.733098:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782481094.733106:0:22645:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:3649:x1869066301315584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481094.733119:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481094.733124:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee44cc expref: 19 pid: 22652 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733135:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee44cc expref: 19 pid: 22652 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733152:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111de00/0x65dae4c042ee44d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee44cc expref: 19 pid: 22652 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733165:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481094.733201:0:22645:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:3649:x1869066301315584:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (3704us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.733219:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782481094.733235:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782481094.733240:0:22645:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:3649:x1869066301315712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481094.733247:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481094.733252:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4408 expref: 17 pid: 22653 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733261:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee4408 expref: 17 pid: 22653 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733272:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111d000/0x65dae4c042ee440f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee4408 expref: 17 pid: 22653 timeout: 811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733283:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733291:0:22645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782481094.733306:0:22645:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004693051s 00010000:00010000:1.0:1782481094.733310:0:22645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733318:0:22645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733325:0:22645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733332:0:22645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733343:0:22645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d74200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481094.733348:0:22645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733357:0:22645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733372:0:22645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481094.733382:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481094.733417:0:22645:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+16:3649:x1869066301315712:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.733424:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:2.0:1782481094.733777:0:23391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1782481094.733925:0:23415:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1782481094.733929:0:23415:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:0.0:1782481094.734288:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301315712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782481094.734297:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301315584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782481094.734751:0:22675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.734762:0:22675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481094.734768:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca7d74200/0x65dae4c042ee450b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1782481094.737300:0:23416:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782481094.737324:0:23391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1782481094.739302:0:23416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782481094.742271:0:23416:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782481094.742349:0:23416:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1782481094.743354:0:23391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1782481094.743420:0:23391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782481094.743880:0:23391:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782481094.743888:0:23391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1782481094.743924:0:23391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782481094.744357:0:23417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23417:1869066301315840:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782481094.744438:0:23417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.744473:0:23417:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782481094.744673:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301315840 00000100:00100000:0.0:1782481094.744682:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301315840 00000100:00100000:0.0:1782481094.744756:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782481094.744773:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23417:x1869066301315840:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1782481094.744848:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23417:x1869066301315840:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 76us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481094.744857:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782481094.744970:0:23417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23417:1869066301315840:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1782481094.745001:0:23417:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1782481094.745025:0:23417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23417:1869066301315968:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782481094.745052:0:23417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.745064:0:23417:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1782481094.745581:0:23400:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301315968 00000100:00100000:3.0:1782481094.745599:0:23400:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301315968 00000100:00100000:3.0:1782481094.745640:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481094.745648:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23417:x1869066301315968:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1782481094.745793:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23417:x1869066301315968:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 145us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481094.745800:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782481094.747468:0:23417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23417:1869066301315968:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782481094.747588:0:23417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23417:1869066301316096:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1782481094.747638:0:23417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.747684:0:22670:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301316096 00000100:00100000:1.0:1782481094.747690:0:22670:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301316096 00000100:00100000:1.0:1782481094.747753:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782481094.747761:0:22670:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23417:x1869066301316096:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1782481094.747765:0:22671:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:3.0:1782481094.747774:0:22671:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00100000:1.0:1782481094.747807:0:22670:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23417:x1869066301316096:12345-0@lo:900:lod0001_rec0000.0 Request processed in 45us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.747814:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782481094.747887:0:23417:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbb9c0 going to sleep for 11 seconds 00010000:00080000:1.0:1782481094.747906:0:23417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f5cb1ddb100 x1869066301316096/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782481110 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481094.747918:0:23417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23417:1869066301316096:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1782481094.747967:0:23417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23417:1869066301316224:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782481094.747994:0:23417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481094.748014:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301316224 00000100:00100000:1.0:1782481094.748018:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301316224 00000100:00100000:1.0:1782481094.748048:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782481094.748055:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23417:x1869066301316224:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1782481094.748103:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23417:x1869066301316224:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 49us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481094.748109:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782481094.748124:0:23417:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c83dbbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782481094.748136:0:23417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23417:1869066301316224:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1782481094.748385:0:23417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782481094.750337:0:23391:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1782481094.752063:0:23417:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782481094.752146:0:23417:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1782481094.755252:0:23391:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782481094.755320:0:23391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1782481094.755541:0:23391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1782481094.756087:0:23391:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000004:00080000:1.0:1782481094.759830:0:23417:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1782481094.763609:0:23391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1782481094.765580:0:23391:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782481094.765618:0:23391:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbdd14553b988 00100000:10000000:3.0:1782481094.765626:0:23391:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1782481094.766335:0:23391:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782481094.766366:0:23391:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782481094.766387:0:23391:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1782481094.766422:0:23391:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1782481094.769872:0:23391:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782481094.771254:0:23391:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782481095.068867:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481095.646583:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00000040:00080000:3.0:1782481095.772312:0:23418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1782481095.842199:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782481095.842207:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f5b85b56800 from 12 10000000:01000000:1.0:1782481095.842213:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782481095.842259:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481095.842270:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481095.842281:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481095.842305:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301316352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782481095.842368:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481095.842428:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c84b8c600 going to sleep for 11 seconds 00000100:00100000:0.0:1782481095.842790:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301316352 00000100:00100000:0.0:1782481095.842799:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301316352 00000100:00100000:0.0:1782481095.842854:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782481095.842863:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+16:22656:x1869066301316352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481095.842877:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481095.842890:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4512 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481095.842913:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4512 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481095.842923:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4512 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481095.842932:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111dc00, rc 0) 00000100:00100000:0.0:1782481095.844723:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301316352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1853us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481095.844734:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782481095.848028:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301316352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481095.848065:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481095.848079:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481095.848171:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301316480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782481095.848237:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481095.848312:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c85200f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782481095.851969:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301316480 00000100:00100000:1.0:1782481095.851985:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301316480 00000100:00100000:1.0:1782481095.852088:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782481095.852107:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301316480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782481095.852132:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782481095.852148:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782481095.852151:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1782481095.852285:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301316480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 180us (4047us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481095.852292:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782481095.852395:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301316480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782481095.852445:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782481095.852455:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481095.852475:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481095.852485:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782481095.852487:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f5cb59c2800 from 12 10000000:01000000:0.0:1782481095.852490:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782481095.852518:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481095.852526:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481095.852535:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481095.852555:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301316608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782481095.852587:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481095.861258:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87fc9480 going to sleep for 11 seconds 00000100:00100000:2.0:1782481095.861430:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301316608 00000100:00100000:2.0:1782481095.861440:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301316608 00000100:00100000:2.0:1782481095.861539:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782481095.861549:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301316608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782481095.861580:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481095.861600:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4520 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481095.861626:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4520 expref: 18 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481095.861636:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4520 expref: 18 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481095.861645:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddfe00, rc 0) 00000100:00100000:2.0:1782481095.861723:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:22656:x1869066301316608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (9135us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481095.861730:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782481095.861793:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301316608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782481095.861809:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481095.861818:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481095.861881:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301316736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782481095.861915:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481095.861934:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90fa5300 going to sleep for 11 seconds 00000100:00100000:2.0:1782481095.861944:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301316736 00000100:00100000:2.0:1782481095.861947:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301316736 00000100:00100000:2.0:1782481095.861963:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782481095.861969:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:22656:x1869066301316736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782481095.861988:0:22652:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782481095.862002:0:22652:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782481095.862005:0:22652:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1782481095.862079:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:22656:x1869066301316736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481095.862086:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782481095.862127:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301316736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782481095.862167:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782481095.862173:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481095.862181:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481096.094524:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481096.667784:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00000040:00080000:3.0:1782481096.798219:0:23418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782481097.117968:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481097.694644:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:0.0:1782481098.142620:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481098.715912:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00010000:00010000:2.0:1782481099.165351:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782481099.202254:0:23662:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1782481099.740255:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301316864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782481099.740340:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782481099.740599:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782481099.740604:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1782481099.740607:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f5b86a63800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782481099.740617:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f5b86a63800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481099.740637:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b88814380 x1869066301317120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782481099.740669:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481099.740672:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481099.740674:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481099.740677:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481099.740728:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481099.740731:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481099.740734:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481099.740737:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782481099.740840:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301316992:0@lo:400:kworker.0 00000100:00100000:2.0:1782481099.740873:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481099.740923:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301316992 00000100:00100000:2.0:1782481099.740929:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301316992 00000100:00100000:2.0:1782481099.740971:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782481099.740979:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:3648:x1869066301316992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481099.741026:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:3648:x1869066301316992:12345-0@lo:400:kworker.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481099.741043:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782481099.741124:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301316992:0@lo:400:kworker.0 00000100:00100000:3.0:1782481099.741598:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301317120:0@lo:38:kworker.0 00000100:00100000:3.0:1782481099.741634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481099.741677:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869066301317376:0@lo:400:kworker.0 00000100:00100000:3.0:1782481099.741728:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481099.741961:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301316864 00000100:00100000:2.0:1782481099.741967:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301316864 00000100:00100000:2.0:1782481099.741999:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301317120 00000100:00100000:2.0:1782481099.742003:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301317120 00000100:00100000:2.0:1782481099.742019:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782481099.742021:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 0 seconds 00000100:00100000:2.0:1782481099.742028:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301316864:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782481099.742044:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301317248:0@lo:400:kworker.0 00000100:00100000:0.0:1782481099.742083:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1782481099.742122:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782481099.742163:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301316864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481099.742170:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782481099.742184:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782481099.742189:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1869066301317120:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1782481099.742210:0:22665:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1782481099.742240:0:22665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x65dae4c042ee452e 00000004:00100000:2.0:1782481099.742253:0:22665:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1782481099.742253:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301317376 00000100:00100000:0.0:1782481099.742260:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301317376 00000001:00000004:2.0:1782481099.742261:0:22665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1782481099.742311:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301317248 00000100:00100000:0.0:1782481099.742326:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301317248 00000100:00100000:0.0:1782481099.742350:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782481099.742357:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869066301317376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481099.742395:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869066301317376:12345-0@lo:400:kworker.0 Request processed in 38us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481099.742404:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782481099.742419:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782481099.742424:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301317248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481099.742465:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301317248:12345-0@lo:400:kworker.0 Request processed in 40us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481099.742471:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782481099.742577:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5b88815500 x1869066301317248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481099.742589:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301317248:0@lo:400:kworker.0 00010000:00080000:3.0:1782481099.742838:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5b88816300 x1869066301317376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481099.742848:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869066301317376:0@lo:400:kworker.0 00000100:00100000:3.0:1782481099.742889:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301316864:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1782481099.749557:0:22665:0:(import.c:65:import_set_state_nolock()) ffff9f5b869ea800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782481099.749658:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1869066301317120:12345-0@lo:38:kworker.0 Request processed in 7465us (8021us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481099.749668:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1782481099.749936:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1782481099.749947:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1782481099.749952:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1782481099.749955:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b86a63800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1782481099.749981:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a7c46118): req@ffff9f5cb1dd9500 x1869066301309952/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481099.750019:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301317120:0@lo:38:kworker.0 00000100:00100000:0.0:1782481099.750350:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481099.750383:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1782481099.750533:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301309952 00000100:00100000:3.0:1782481099.750540:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301309952 00000100:00100000:3.0:1782481099.750588:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782481099.750599:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22701:x1869066301309952:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782481099.750680:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782481099.750682:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22701:x1869066301309952:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481099.750715:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301317504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782481099.750717:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782481099.750759:0:22701:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1869066301309952:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1782481099.750790:0:22701:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1782481099.750823:0:22701:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1869066301317632:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782481099.754835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481099.754912:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301317504 00000100:00100000:2.0:1782481099.754921:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301317504 00000100:00100000:3.0:1782481099.754964:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481099.754978:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301317632 00000100:00100000:3.0:1782481099.754989:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c891f5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782481099.754989:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301317632 00000100:00100000:3.0:1782481099.755016:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782481099.755024:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782481099.755029:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1869066301317504:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782481099.755039:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22701:x1869066301317632:12345-0@lo:1000:lod0000_rec0001.0 00000004:00000024:3.0:1782481099.755066:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1782481099.755560:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1869066301317504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 419us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481099.755570:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782481099.755583:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22701:x1869066301317632:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 472us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481099.755592:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782481099.755622:0:22701:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1869066301317632:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1782481099.755746:0:22701:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1869066301317760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782481099.755755:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301317504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782481099.755784:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481099.755898:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301317760 00000100:00100000:2.0:1782481099.755903:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301317760 00000100:00100000:2.0:1782481099.755927:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782481099.755933:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22701:x1869066301317760:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1782481099.755965:0:22701:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c891f5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782481099.755992:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22701:x1869066301317760:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 57us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481099.755994:0:22701:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1869066301317760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1782481099.756006:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:3.0:1782481099.756039:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782481099.765000:0:22701:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1782481099.765086:0:22701:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1782481099.765091:0:22701:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1782481100.188638:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782481100.303995:0:23714:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782481100.305781:0:23714:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1782481101.211912:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782481101.464559:0:23764:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782481101.464805:0:23764:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782481102.236401:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782481102.738161:0:23812:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed3519fc0 20000000:00000080:1.0:1782481102.738182:0:23812:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f5ca5cf4c00 uarg=0000000000000000 20000000:01000000:1.0:1782481102.739709:0:23812:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1782481102.739719:0:23812:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1782481102.739724:0:23812:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1782481102.747843:0:23813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1782481102.747987:0:23812:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 00000040:00080000:3.0:1782481102.748520:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1782481102.757978:0:23812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782481102.758011:0:23812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481102.758031:0:23812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee43d7 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481102.758039:0:23812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee44da expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481102.758047:0:23812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481102.758092:0:23812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee44da expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481102.758120:0:23812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee44da expref: 17 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481102.758137:0:23812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23812:1869066301317888:0@lo:104: 00000100:00100000:0.0:1782481102.758202:0:23812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782481102.758566:0:23812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee43d7 expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481102.758575:0:23812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee43d7 expref: 17 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481102.758584:0:23812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23812:1869066301318016:0@lo:104: 00000100:00100000:0.0:1782481102.758607:0:23812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481102.762747:0:23812:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87fc96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481102.762838:0:22643:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301317888 00000100:00100000:3.0:1782481102.762848:0:22643:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301317888 00000100:00100000:2.0:1782481102.763108:0:22644:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301318016 00000100:00100000:2.0:1782481102.763113:0:22644:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301318016 00000100:00100000:2.0:1782481102.763145:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782481102.763153:0:22644:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:23812:x1869066301317888:12345-0@lo:104: 00010000:00010000:2.0:1782481102.763170:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481102.763560:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782481102.763568:0:22644:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:23812:x1869066301317888:12345-0@lo:104: Request processed in 415us (5366us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481102.763595:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782481102.763623:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782481102.763630:0:22644:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:23812:x1869066301318016:12345-0@lo:104: 00010000:00010000:1.0:1782481102.763643:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481102.763646:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763650:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763658:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d75800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1782481102.763662:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763670:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782481102.763677:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481102.763683:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782481102.763688:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782481102.763716:0:22644:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:23812:x1869066301318016:12345-0@lo:104: Request processed in 64us (5086us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481102.763721:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782481102.763734:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763751:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782481102.763782:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763790:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75800/0x65dae4c042ee44da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee44e1 expref: -99 pid: 23391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763803:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481102.763806:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763812:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111c000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:1.0:1782481102.763815:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763822:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782481102.763829:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481102.763833:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782481102.763848:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763853:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782481102.763868:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.763874:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c000/0x65dae4c042ee43d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee43de expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481102.763883:0:23812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23812:1869066301317888:0@lo:104: 00000100:00100000:0.0:1782481102.763893:0:23812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23812:1869066301318016:0@lo:104: 00010000:00010000:1.0:1782481102.763894:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481102.763895:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481102.763897:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481102.763903:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481102.763917:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1782481102.763921:0:23812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481102.763929:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301318144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782481102.763970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481102.764006:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301318272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782481102.764028:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481102.764086:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301318144 00000100:00100000:1.0:1782481102.764091:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301318144 00010000:00010000:1.0:1782481102.764109:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee44da expref: 18 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481102.764128:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301318272 00000100:00100000:1.0:1782481102.764131:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301318272 00010000:00010000:1.0:1782481102.764141:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee43d7 expref: 19 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481102.764153:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782481102.764159:0:22646:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:3647:x1869066301318144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481102.764170:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481102.764174:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee44da expref: 19 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764183:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee44da expref: 19 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764207:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c8fddf800/0x65dae4c042ee44e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee44da expref: 19 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764220:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481102.764259:0:22646:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:3647:x1869066301318144:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481102.764266:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782481102.764279:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782481102.764285:0:22646:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:3649:x1869066301318272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481102.764292:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481102.764296:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee43d7 expref: 17 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764305:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee43d7 expref: 17 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764315:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee43de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee43d7 expref: 17 pid: 22654 timeout: 819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764327:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764335:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764350:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764358:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764370:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764376:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764381:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111ca00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481102.764386:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764393:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764404:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481102.764413:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481102.764441:0:22646:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+16:3649:x1869066301318272:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (412us total) trans 0 rc 0/0 00010000:00010000:0.0:1782481102.764446:0:23812:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481102.764447:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1782481102.764454:0:23812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481102.764460:0:23812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111ca00/0x65dae4c042ee4535 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481102.764470:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301318272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782481102.764490:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301318144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481103.262035:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782481104.095296:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782481104.095305:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5b85b56800 from 13 10000000:01000000:0.0:1782481104.095311:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782481104.095364:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.095377:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.095390:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481104.095419:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.095492:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481104.095538:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87fc96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481104.095559:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301318400 00000100:00100000:0.0:1782481104.095565:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301318400 00000100:00100000:0.0:1782481104.095612:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782481104.095620:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+16:22656:x1869066301318400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481104.095634:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481104.095647:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee453c expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.095670:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee453c expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.095681:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee453c expref: 17 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.095744:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111c000, rc 0) 00000100:00100000:0.0:1782481104.095780:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301318400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481104.095787:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782481104.095841:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481104.095855:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.095863:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481104.095919:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.095943:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481104.095959:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87fc96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481104.095971:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301318528 00000100:00100000:0.0:1782481104.095974:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301318528 00000100:00100000:0.0:1782481104.095996:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782481104.096002:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301318528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.096107:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301318528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481104.096113:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782481104.096142:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.096167:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.096206:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481104.096243:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87fc96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481104.096255:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301318656 00000100:00100000:0.0:1782481104.096258:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301318656 00000100:00100000:0.0:1782481104.096280:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782481104.096286:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301318656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.096363:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301318656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481104.096370:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782481104.096415:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782481104.097150:0:23873:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1782481104.097209:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1782481104.097241:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782481104.097251:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.097259:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481104.097268:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782481104.097271:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5cb59c2800 from 13 10000000:01000000:0.0:1782481104.097273:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782481104.097298:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.097305:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.097314:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481104.097343:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.097380:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481104.097397:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87fc9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782481104.097412:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301318784 00000100:00100000:0.0:1782481104.097417:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301318784 00000100:00100000:0.0:1782481104.097443:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782481104.097450:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+17:22656:x1869066301318784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481104.097459:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481104.097470:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee454a expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.097487:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee454a expref: 18 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.097496:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee454a expref: 18 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.097505:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111cc00, rc 0) 00000100:00100000:0.0:1782481104.097532:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:22656:x1869066301318784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481104.097538:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782481104.097572:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481104.097584:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.097592:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481104.097636:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.097657:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481104.097667:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87fc9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782481104.097677:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301318912 00000100:00100000:0.0:1782481104.097680:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301318912 00000100:00100000:0.0:1782481104.097718:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782481104.097724:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:22656:x1869066301318912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.097804:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:22656:x1869066301318912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481104.097810:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782481104.097835:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301318912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.097855:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301319040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.097884:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481104.097894:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87fc9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782481104.097904:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301319040 00000100:00100000:0.0:1782481104.097907:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301319040 00000100:00100000:0.0:1782481104.097927:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782481104.097932:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:22656:x1869066301319040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481104.097993:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:22656:x1869066301319040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481104.098000:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782481104.098033:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301319040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782481104.109598:0:23874:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1782481104.114963:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1782481104.115006:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782481104.115018:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481104.115031:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481104.284404:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481104.861534:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782481104.861565:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301319168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782481104.861636:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481104.861994:0:23400:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301319168 00000100:00100000:2.0:1782481104.862002:0:23400:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301319168 00000100:00100000:2.0:1782481104.862055:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782481104.862064:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1869066301319168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782481104.862097:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782481104.862143:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1869066301319168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481104.862150:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782481104.862192:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301319168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782481104.862413:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481094/real 1782481094] req@ffff9f5cb1ecdc00 x1869066301313280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481104.862431:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5cb1ecdc00 x1869066301313280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481104.862441:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481094/real 1782481094] req@ffff9f5b88816d80 x1869066301313152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481104 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481104.862454:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5b88816d80 x1869066301313152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481104 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782481104.862466:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b879a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481104.862472:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782481104.862476:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301313280:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1782481104.862480:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b8822f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481104.862484:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782481104.862486:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301313152:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1782481104.862506:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301319296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782481104.862533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481104.863300:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301319296 00000100:00100000:1.0:1782481104.863308:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301319296 00000100:00100000:1.0:1782481104.863343:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782481104.863351:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301319296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782481104.863377:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1782481104.863436:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301319296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481104.863443:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782481104.863478:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301319296:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1782481104.863755:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481104.863760:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481104.863763:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481104.863766:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481104.863788:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481104.863798:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782481104.863802:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5b8822f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481104.863806:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 711 00000100:00080000:2.0:1782481104.863810:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782481104.863814:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f5b8822f000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481104.863833:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bed80 x1869066301319680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782481104.863847:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481104.863850:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782481104.863852:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5b879a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481104.863855:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 711 00000100:00080000:2.0:1782481104.863858:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782481104.863861:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f5b879a9000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481104.863869:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b882bc700 x1869066301319808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782481104.863896:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301319424:0@lo:400:kworker.0 00000100:00100000:2.0:1782481104.863929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481104.863970:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869066301319936:0@lo:400:kworker.0 00000100:00100000:2.0:1782481104.863996:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481104.864011:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782481104.864015:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301319552:0@lo:400:kworker.0 00000100:00100000:2.0:1782481104.864030:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481104.864049:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301319424 00000100:00100000:2.0:1782481104.864053:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301319424 00000100:00100000:2.0:1782481104.864078:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782481104.864089:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:3648:x1869066301319424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481104.864121:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:3648:x1869066301319424:12345-0@lo:400:kworker.0 Request processed in 32us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481104.864127:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782481104.864159:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301319936 00000100:00100000:2.0:1782481104.864162:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301319936 00000100:00100000:2.0:1782481104.864180:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301319552 00000100:00100000:2.0:1782481104.864182:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301319552 00000100:00100000:2.0:1782481104.864192:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782481104.864213:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869066301319936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481104.864246:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1869066301319936:12345-0@lo:400:kworker.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481104.864252:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782481104.864263:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782481104.864268:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301319552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481104.864292:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301319552:12345-0@lo:400:kworker.0 Request processed in 23us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481104.864297:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782481104.864330:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301319424:0@lo:400:kworker.0 00010000:00080000:2.0:1782481104.864352:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5b882bd500 x1869066301319552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481104.864361:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301319552:0@lo:400:kworker.0 00010000:00080000:2.0:1782481104.864370:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5b882bfb80 x1869066301319936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481104.864376:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1869066301319936:0@lo:400:kworker.0 00000100:00100000:2.0:1782481104.864418:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301319680:0@lo:8:kworker.0 00000400:00000100:2.0:1782481104.864443:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301319680 offset 0 length 520: 4 00000100:00100000:2.0:1782481104.864456:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301319808:0@lo:8:kworker.0 00000400:00000100:2.0:1782481104.864473:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301319808 offset 0 length 520: 4 00010000:00010000:1.0:1782481105.311155:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782481105.374083:0:23392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1782481105.883831:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481090/real 1782481090] req@ffff9f5b882bc000 x1869066301310976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481105 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481105.883861:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5b882bc000 x1869066301310976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481105 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481105.883871:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481090/real 1782481090] req@ffff9f5b882bce00 x1869066301311104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481105 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481105.883883:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5b882bce00 x1869066301311104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481105 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782481105.883902:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb654b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782481105.883924:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782481105.883928:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301310976:0@lo:8:kworker.0 00000100:00080000:2.0:1782481105.883934:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c9113a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782481105.883939:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782481105.883941:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301311104:0@lo:8:kworker.0 00000100:00080000:1.0:1782481105.884061:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782481105.884065:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1782481105.884067:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f5cb654b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782481105.884072:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 707 00000100:00080000:1.0:1782481105.884077:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782481105.884084:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f5cb654b000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481105.884104:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1dd9500 x1869066301320320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782481105.884118:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782481105.884120:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782481105.884122:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f5c9113a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782481105.884125:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 707 00000100:00080000:1.0:1782481105.884128:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782481105.884131:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f5c9113a000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1782481105.884141:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ddb100 x1869066301320448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782481105.884211:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782481105.884214:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782481105.884217:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782481105.884220:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782481105.884336:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301320192:0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.884398:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481105.884434:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782481105.884449:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301320064:0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.884478:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481105.884507:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869066301320832:0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.884530:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481105.884555:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301320576:0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.884577:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481105.884593:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782481105.884599:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301320704:0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.884620:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481105.884648:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301320064 00000100:00100000:2.0:1782481105.884655:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301320064 00000100:00100000:2.0:1782481105.884728:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782481105.884736:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:3648:x1869066301320064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.884783:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:3648:x1869066301320064:12345-0@lo:400:kworker.0 Request processed in 47us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481105.884790:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782481105.884823:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301320832 00000100:00100000:2.0:1782481105.884827:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301320832 00000100:00100000:2.0:1782481105.884849:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301320576 00000100:00100000:2.0:1782481105.884852:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301320576 00000100:00100000:2.0:1782481105.884865:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782481105.884871:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869066301320832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.884903:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869066301320832:12345-0@lo:400:kworker.0 Request processed in 32us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481105.884909:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782481105.884920:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782481105.884927:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301320576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.884968:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301320576:12345-0@lo:400:kworker.0 Request processed in 41us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481105.884974:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782481105.884995:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301320192 00000100:00100000:2.0:1782481105.884998:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301320192 00000100:00100000:2.0:1782481105.885018:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301320704 00000100:00100000:2.0:1782481105.885020:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301320704 00000100:00100000:2.0:1782481105.885030:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782481105.885036:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301320192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.885066:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301320192:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481105.885072:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782481105.885084:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782481105.885090:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301320704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.885114:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301320704:12345-0@lo:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481105.885120:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782481105.885159:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301320704:0@lo:400:kworker.0 00010000:00080000:2.0:1782481105.885170:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5b87a3ad80 x1869066301320576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481105.885321:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301320576:0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.885348:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301320320:0@lo:8:kworker.0 00000400:00000100:2.0:1782481105.885371:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301320320 offset 0 length 520: 4 00000100:00100000:2.0:1782481105.885391:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301320448:0@lo:8:kworker.0 00000400:00000100:2.0:1782481105.885415:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066301320448 offset 0 length 520: 4 00000100:00100000:2.0:1782481105.885438:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301320064:0@lo:400:kworker.0 00010000:00080000:2.0:1782481105.885448:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5b87a3bb80 x1869066301320832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481105.885456:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869066301320832:0@lo:400:kworker.0 00000100:00100000:2.0:1782481105.885464:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301320192:0@lo:400:kworker.0 00000040:00080000:2.0:1782481106.012541:0:23418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782481106.337501:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481107.357259:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481108.380982:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782481109.275640:0:24160:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782481109.275644:0:24160:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1782481109.275645:0:24160:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782481109.276530:0:24160:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f5cb8c99800 00000020:01000004:1.0:1782481109.276547:0:24160:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1782481109.276561:0:24160:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782481109.276576:0:24160:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f5b86a2cd40) 00000020:00000080:1.0:1782481109.276593:0:24160:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782481109.351744:0:24160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1782481109.355844:0:24160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1782481109.356342:0:24160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1782481109.356802:0:24160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1782481109.357130:0:24160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1782481109.357361:0:24160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1782481109.357785:0:24160:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1782481109.358996:0:24160:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1782481109.359225:0:24160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1782481109.359238:0:24160:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782481109.359249:0:24160:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x65dae4c042ee455f 00000020:01000004:2.0:1782481109.359256:0:24160:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1782481109.359278:0:24160:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782481109.359282:0:24160:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782481109.359288:0:24160:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1782481109.359293:0:24160:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1782481109.359304:0:24160:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f5cb2e299c0) 00000020:00000080:2.0:1782481109.359314:0:24160:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1782481109.360502:0:24160:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782481109.360659:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1782481109.360664:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1782481109.371587:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1782481109.371603:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1782481109.371937:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1782481109.371943:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1782481109.378156:0:24160:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782481109.378369:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1782481109.378376:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782481109.389671:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782481109.389686:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1782481109.403867:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481109.422668:0:24160:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782481109.424478:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782481109.424487:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1782481109.432295:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782481109.432312:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1782481109.433313:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782481109.433323:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1782481109.448256:0:24160:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782481109.448461:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1782481109.448468:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782481109.452776:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782481109.452791:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1782481109.504934:0:24160:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782481109.505142:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1782481109.505149:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1782481109.506955:0:24160:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1782481109.506967:0:24160:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782481109.507991:0:24160:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782481109.508021:0:24160:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1782481109.508027:0:24160:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1782481109.534690:0:24160:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782481109.534991:0:24160:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.111@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1782481109.534995:0:24160:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782481109.534997:0:24160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782481109.534999:0:24160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481109.535000:0:24160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481109.535001:0:24160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481109.535003:0:24160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481109.535004:0:24160:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782481109.535006:0:24160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481109.535007:0:24160:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782481109.535010:0:24160:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1782481109.535012:0:24160:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782481109.535014:0:24160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782481109.535016:0:24160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481109.535017:0:24160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481109.535018:0:24160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481109.535019:0:24160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481109.535020:0:24160:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782481109.535021:0:24160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481109.535022:0:24160:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782481109.535048:0:24160:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782481109.535069:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301320960:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782481109.535163:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481109.535291:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded480 going to sleep for 11 seconds 00000100:00100000:0.0:1782481109.536215:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301320960 00000100:00100000:0.0:1782481109.536227:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301320960 00000100:00100000:0.0:1782481109.536286:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782481109.536298:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:24160:x1869066301320960:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782481109.536455:0:22652:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782481109.536459:0:22652:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1782481109.536463:0:22652:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1782481109.536824:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:24160:x1869066301320960:12345-0@lo:253:mount.lustre.0 Request processed in 527us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481109.536835:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782481109.536935:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301320960:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782481109.536948:0:24160:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782481109.536951:0:24160:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782481109.536952:0:24160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782481109.536960:0:24160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481109.536961:0:24160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481109.536963:0:24160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481109.536964:0:24160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481109.536965:0:24160:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782481109.536967:0:24160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481109.536968:0:24160:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782481109.536987:0:24160:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f5cb8c99800 from lustre-OST0000 10000000:01000000:2.0:1782481109.537024:0:24160:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1782481109.537028:0:24160:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782481109.537035:0:24160:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f5cb5f799c0 local copy 00010000:00010000:2.0:1782481109.537045:0:24160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481109.537176:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782481109.537213:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481109.537254:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded600 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.537605:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301321088 00000100:00100000:3.0:1782481109.537611:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301321088 00000100:00100000:3.0:1782481109.537652:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782481109.537672:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:24160:x1869066301321088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481109.537772:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:24160:x1869066301321088:12345-0@lo:501:mount.lustre.0 Request processed in 102us (559us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782481109.537780:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782481109.538784:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321088:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782481109.538805:0:24160:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782481109.538840:0:24160:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782481109.538849:0:24160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481109.538859:0:24160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481109.538894:0:24160:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f5cb8c99800 10000000:01000000:1.0:1782481109.538899:0:24160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782481109.538905:0:24160:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782481109.538908:0:24160:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782481109.538912:0:24160:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782481109.538915:0:24160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782481109.538943:0:24160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75600/0x65dae4c042ee456d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481109.538952:0:24160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75600/0x65dae4c042ee456d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481109.538963:0:24160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75600/0x65dae4c042ee456d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481109.538981:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782481109.539026:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.539132:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782481109.541509:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301321216 00000100:00100000:2.0:1782481109.541524:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301321216 00000100:00100000:2.0:1782481109.541606:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782481109.541616:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+18:24160:x1869066301321216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481109.541634:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481109.541650:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c8fddec00/0x65dae4c042ee4574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee456d expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.541678:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c8fddec00/0x65dae4c042ee4574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee456d expref: 19 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.541689:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c8fddec00/0x65dae4c042ee4574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee456d expref: 19 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.541728:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddec00, rc 0) 00000100:00100000:2.0:1782481109.541818:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321216:12345-0@lo:101:mount.lustre.0 Request processed in 203us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.541827:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782481109.541947:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481109.541967:0:24160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75600/0x65dae4c042ee456d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4574 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481109.541976:0:24160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75600/0x65dae4c042ee456d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4574 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782481109.547467:0:24160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1782481109.548617:0:24160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782481109.551545:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1782481109.551608:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1782481109.551624:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1782481109.551638:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1782481109.551650:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1782481109.551665:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1782481109.551679:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1782481109.551690:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1782481109.552225:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1782481109.552243:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1782481109.552256:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1782481109.552269:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1782481109.552294:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1782481109.552300:0:24160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1782481109.552422:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481109.552494:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.552594:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4c480 going to sleep for 11 seconds 00000100:00100000:2.0:1782481109.558872:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301321344 00000100:00100000:2.0:1782481109.558887:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301321344 00000100:00100000:0.0:1782481109.559251:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782481109.559262:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481109.560207:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321344:12345-0@lo:501:mount.lustre.0 Request processed in 943us (7708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481109.560218:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782481109.562820:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481109.562894:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481109.562988:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.564376:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4c480 going to sleep for 11 seconds 00000100:00100000:2.0:1782481109.566385:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301321472 00000100:00100000:2.0:1782481109.566401:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301321472 00000100:00100000:2.0:1782481109.566536:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782481109.566548:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782481109.567804:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321472:12345-0@lo:503:mount.lustre.0 Request processed in 1252us (4810us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.567817:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1782481109.567961:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321472:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782481109.568439:0:24160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782481109.568522:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481109.568579:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.569488:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.569570:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301321600 00000100:00100000:3.0:1782481109.569578:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301321600 00000100:00100000:3.0:1782481109.569620:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782481109.569628:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481109.570042:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321600:12345-0@lo:502:mount.lustre.0 Request processed in 413us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.570050:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782481109.570337:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481109.570552:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1782481109.570585:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1782481109.570601:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1782481109.570616:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1782481109.570631:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1782481109.570644:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1782481109.570658:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1782481109.570674:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1782481109.570688:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1782481109.570741:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1782481109.570760:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1782481109.570776:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1782481109.570811:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481109.570860:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.570890:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782481109.570949:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301321728 00000100:00100000:2.0:1782481109.570955:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301321728 00000100:00100000:2.0:1782481109.570991:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782481109.570999:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782481109.571211:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321728:12345-0@lo:502:mount.lustre.0 Request processed in 212us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.571219:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782481109.571302:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481109.571346:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1782481109.571353:0:24160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1782481109.572229:0:24177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782481109.572238:0:24177:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1782481109.572246:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481109.572248:0:24177:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1782481109.572255:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782481109.572275:0:24177:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f5c83fbb380) 00000020:00000080:3.0:1782481109.572298:0:24177:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782481109.572304:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782481109.572390:0:24177:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5cb8c99800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1782481109.572398:0:24177:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782481109.572412:0:24177:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x65dae4c042ee4582 00010000:00010000:3.0:1782481109.578601:0:24177:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1782481109.579267:0:24177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1782481109.581387:0:24177:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1782481109.583258:0:24177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1782481109.583269:0:24177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782481109.583287:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481109.583290:0:24177:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1782481109.583293:0:24177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782481109.583296:0:24177:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1782481109.583297:0:24177:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782481109.583299:0:24177:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782481109.583300:0:24177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782481109.583303:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481109.583304:0:24177:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782481109.583306:0:24177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782481109.583309:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481109.583311:0:24177:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782481109.583313:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782481109.583315:0:24177:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1782481109.583317:0:24177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782481109.583319:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481109.583320:0:24177:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1782481109.583322:0:24177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782481109.583325:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481109.583326:0:24177:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782481109.583329:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1782481109.583356:0:24177:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782481109.583359:0:24177:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782481109.583365:0:24177:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782481109.583369:0:24177:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1782481109.583640:0:24160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1782481109.583678:0:24160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782481109.583724:0:24160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75600/0x65dae4c042ee456d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4574 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481109.583736:0:24160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75600/0x65dae4c042ee456d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4574 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481109.583744:0:24160:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5cb8c99800 from 1 10000000:01000000:1.0:1782481109.583747:0:24160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782481109.583782:0:24160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481109.583789:0:24160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481109.583799:0:24160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481109.583824:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782481109.583893:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.583933:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.584070:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301321856 00000100:00100000:3.0:1782481109.584186:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301321856 00000100:00100000:3.0:1782481109.584233:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782481109.584241:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:24160:x1869066301321856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782481109.584254:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481109.584265:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4589 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481109.584393:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4589 expref: 20 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481109.584405:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4589 expref: 20 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481109.584414:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4000, rc 0) 00000100:00100000:3.0:1782481109.584458:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301321856:12345-0@lo:101:mount.lustre.0 Request processed in 218us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.584465:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782481109.584547:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481109.584563:0:24160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481109.584570:0:24160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782481109.585632:0:24160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1782481109.585905:0:24160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782481109.586393:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1782481109.586423:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1782481109.586440:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1782481109.586454:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1782481109.586468:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1782481109.586482:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1782481109.586496:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1782481109.586510:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1782481109.586529:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1782481109.586560:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1782481109.586577:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1782481109.586595:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1782481109.586600:0:24160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1782481109.586680:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481109.587478:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.587562:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4c480 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.590201:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301321984 00000100:00100000:3.0:1782481109.590216:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301321984 00000100:00100000:3.0:1782481109.590290:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782481109.590301:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301321984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481109.590479:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301321984:12345-0@lo:501:mount.lustre.0 Request processed in 180us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.590487:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782481109.590721:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301321984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481109.590778:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481109.590834:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.590864:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4c480 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.590989:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301322112 00000100:00100000:3.0:1782481109.590995:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301322112 00000100:00100000:3.0:1782481109.591039:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782481109.591045:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301322112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782481109.591254:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301322112:12345-0@lo:503:mount.lustre.0 Request processed in 207us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.591261:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782481109.591373:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782481109.591935:0:24160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782481109.592014:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481109.592065:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.592768:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.592837:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301322240 00000100:00100000:3.0:1782481109.592844:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301322240 00000100:00100000:2.0:1782481109.598169:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782481109.598197:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301322240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782481109.598471:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301322240:12345-0@lo:502:mount.lustre.0 Request processed in 286us (6405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.598481:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782481109.599265:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481109.599499:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1782481109.599538:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1782481109.599554:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1782481109.599569:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1782481109.599583:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1782481109.599596:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1782481109.599609:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1782481109.599621:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1782481109.599635:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1782481109.599647:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1782481109.599676:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1782481109.599735:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481109.599792:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.599841:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782481109.600174:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301322368 00000100:00100000:2.0:1782481109.600182:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301322368 00000100:00100000:2.0:1782481109.600231:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782481109.600251:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301322368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782481109.600879:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301322368:12345-0@lo:502:mount.lustre.0 Request processed in 630us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.600889:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782481109.601354:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481109.601423:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1782481109.601436:0:24160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1782481109.608518:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481109.608534:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481109.608536:0:24181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782481109.608545:0:24181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f5cb8c99800 00000020:00000080:0.0:1782481109.608548:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782481109.608557:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481109.608560:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481109.608561:0:24181:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782481109.608563:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481109.608580:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481109.608582:0:24181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782481109.608587:0:24181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f5cb8c99800 00000020:00000080:0.0:1782481109.608588:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782481109.618470:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481109.621770:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481109.621779:0:24181:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782481109.621790:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481109.621797:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481109.621798:0:24181:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782481109.621803:0:24181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f5cb8c99800 00000020:00000080:0.0:1782481109.621806:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782481109.621860:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481109.621864:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481109.621865:0:24181:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782481109.621867:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481109.621869:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481109.621871:0:24181:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1782481109.621874:0:24181:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f5cb8c99800 00000020:00000080:0.0:1782481109.621876:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782481109.621915:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481109.621919:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481109.621921:0:24181:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1782481109.621924:0:24181:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1782481109.622048:0:24160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1782481109.622084:0:24160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782481109.622121:0:24160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.622133:0:24160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481109.622185:0:24160:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782481109.622189:0:24160:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f5cb8c99800 10000000:01000000:2.0:1782481109.622192:0:24160:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f5cb8c99800 10000000:01000000:2.0:1782481109.622196:0:24160:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782481109.622202:0:24160:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f5cb8c99800 from 1 10000000:01000000:2.0:1782481109.622205:0:24160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782481109.622243:0:24160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddf000/0x65dae4c042ee4597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.622251:0:24160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddf000/0x65dae4c042ee4597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.622262:0:24160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddf000/0x65dae4c042ee4597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481109.622287:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782481109.622359:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481109.622419:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded240 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.622494:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301322496 00000100:00100000:3.0:1782481109.622503:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301322496 00000100:00100000:3.0:1782481109.622556:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782481109.622568:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:24160:x1869066301322496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782481109.622582:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481109.622595:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca6eb4600/0x65dae4c042ee459e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4597 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481109.622618:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca6eb4600/0x65dae4c042ee459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4597 expref: 21 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481109.622630:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca6eb4600/0x65dae4c042ee459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4597 expref: 21 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481109.622638:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4600, rc 0) 00000100:00100000:3.0:1782481109.622690:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301322496:12345-0@lo:101:mount.lustre.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.622716:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782481109.622790:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481109.622815:0:24160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddf000/0x65dae4c042ee4597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee459e expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.622824:0:24160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddf000/0x65dae4c042ee4597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee459e expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782481109.633822:0:24160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1782481109.635264:0:24160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782481109.635577:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1782481109.635605:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1782481109.635619:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1782481109.635633:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1782481109.635648:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1782481109.635660:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1782481109.635673:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1782481109.635685:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1782481109.635721:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1782481109.635735:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1782481109.635753:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1782481109.635767:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1782481109.635779:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1782481109.635816:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1782481109.635830:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1782481109.635843:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1782481109.635855:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1782481109.635866:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1782481109.635879:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1782481109.635893:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1782481109.635906:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1782481109.635917:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1782481109.635929:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1782481109.635941:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1782481109.635953:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1782481109.635966:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1782481109.635979:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1782481109.635991:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1782481109.636004:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1782481109.636030:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1782481109.636045:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1782481109.636056:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1782481109.636068:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1782481109.638439:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1782481109.638488:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1782481109.638505:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1782481109.638520:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1782481109.638534:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1782481109.638549:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1782481109.638563:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1782481109.638576:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1782481109.638589:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1782481109.638603:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1782481109.638617:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1782481109.638631:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1782481109.638669:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1782481109.638715:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1782481109.638733:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1782481109.638894:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1782481109.638915:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1782481109.638933:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1782481109.638939:0:24160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1782481109.639051:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481109.641946:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.642002:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1c78b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.643236:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301322624 00000100:00100000:3.0:1782481109.643247:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301322624 00000100:00100000:3.0:1782481109.643372:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782481109.643381:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301322624:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481109.645212:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301322624:12345-0@lo:501:mount.lustre.0 Request processed in 1824us (3265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.645226:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782481109.646833:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481109.646924:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481109.646992:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.647088:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1c78b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.652963:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301322752 00000100:00100000:3.0:1782481109.652979:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301322752 00000100:00100000:3.0:1782481109.653043:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782481109.653054:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301322752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782481109.653393:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301322752:12345-0@lo:503:mount.lustre.0 Request processed in 340us (6400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.653402:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782481109.653900:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782481109.662515:0:24160:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782481109.663662:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481109.663787:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.663840:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1c78b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.665399:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301322880 00000100:00100000:3.0:1782481109.665410:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301322880 00000100:00100000:3.0:1782481109.665473:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782481109.665484:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301322880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481109.666115:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301322880:12345-0@lo:502:mount.lustre.0 Request processed in 620us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.666123:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782481109.666382:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301322880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782481109.666673:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1782481109.666744:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1782481109.666761:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1782481109.666776:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1782481109.666790:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1782481109.666801:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1782481109.666813:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1782481109.666841:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1782481109.666856:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1782481109.666868:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1782481109.666882:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1782481109.666895:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1782481109.666907:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1782481109.666920:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1782481109.666932:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1782481109.666943:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1782481109.666956:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1782481109.667068:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1782481109.667085:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1782481109.667098:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1782481109.667122:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1782481109.667135:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1782481109.667147:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1782481109.667230:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1782481109.667252:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1782481109.667263:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1782481109.667273:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1782481109.667286:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1782481109.667298:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1782481109.667310:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1782481109.667335:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1782481109.667349:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1782481109.667362:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1782481109.667390:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1782481109.667405:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1782481109.667416:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1782481109.667428:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1782481109.667438:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1782481109.667447:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1782481109.667457:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1782481109.667468:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1782481109.667481:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1782481109.667493:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1782481109.667505:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1782481109.667516:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1782481109.667528:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1782481109.667540:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1782481109.667552:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1782481109.667613:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301323008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782481109.667686:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481109.667768:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.668001:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301323008 00000100:00100000:3.0:1782481109.668008:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301323008 00000100:00100000:3.0:1782481109.668052:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782481109.668061:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301323008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481109.668204:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301323008:12345-0@lo:502:mount.lustre.0 Request processed in 143us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.668212:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782481109.668437:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301323008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782481109.668653:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1782481109.668679:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1782481109.668905:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301323136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481109.668954:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481109.669148:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301323136 00000100:00100000:3.0:1782481109.669154:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301323136 00000100:00100000:0.0:1782481109.669324:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8512ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481109.669414:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782481109.669421:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301323136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481109.669510:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301323136:12345-0@lo:502:mount.lustre.0 Request processed in 89us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.669517:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782481109.669743:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301323136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782481109.669800:0:24160:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1782481109.669811:0:24160:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1782481109.672486:0:24186:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782481109.672514:0:24186:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f5c83fbcd40) 00000020:00000080:3.0:1782481109.672543:0:24186:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1782481109.673124:0:24186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5cb8c99800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782481109.673128:0:24186:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5cb8c99800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782481109.673131:0:24186:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5cb8c99800 3 00010000:00080000:3.0:1782481109.673160:0:24186:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5b88066800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.111@tcp at head 00010000:00010000:3.0:1782481109.682042:0:24186:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1782481109.682247:0:24186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1782481109.682296:0:24186:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782481109.682310:0:24186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x65dae4c042ee45ac 00000100:00080000:3.0:1782481109.682321:0:24186:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782481109.682327:0:24186:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f5b88066800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481109.682363:0:24186:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b88815f80 x1869066301323264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782481109.682402:0:24186:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782481109.682751:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1869066301323264:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782481109.682824:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481109.682940:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301323264 00000100:00100000:3.0:1782481109.682948:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301323264 00000100:00100000:3.0:1782481109.682999:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782481109.683008:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1869066301323264:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1782481109.683033:0:22661:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:3.0:1782481109.683086:0:22661:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x65dae4c042ee45b3 00000004:00100000:3.0:1782481109.683117:0:22661:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782481109.683156:0:22661:0:(import.c:65:import_set_state_nolock()) ffff9f5c83dd0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782481109.683222:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869066301323264:12345-0@lo:38:llog_process_th.0 Request processed in 214us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481109.683230:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782481109.683507:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5b88815f80 x1869066301323264/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782481119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481109.683519:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782481109.683527:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1782481109.683534:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782481109.683539:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782481109.683547:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b88066800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782481109.683554:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1869066301323264:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1782481109.684023:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481109.684028:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481109.684031:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481109.684034:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481109.684060:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481109.684064:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481109.684067:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481109.684070:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782481109.684098:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301323776:0@lo:400:kworker.0 00000100:00100000:2.0:1782481109.684148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481109.684183:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782481109.684189:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301323392:0@lo:400:kworker.0 00000100:00100000:2.0:1782481109.684216:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481109.684244:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301323520:0@lo:400:kworker.0 00000100:00100000:2.0:1782481109.684265:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481109.684281:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782481109.684286:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301323648:0@lo:400:kworker.0 00000100:00100000:2.0:1782481109.684305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481109.684339:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301323776 00000100:00100000:2.0:1782481109.684344:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301323776 00000100:00100000:2.0:1782481109.684385:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301323520 00000100:00100000:2.0:1782481109.684395:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301323520 00000100:00100000:2.0:1782481109.684415:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782481109.684422:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301323776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481109.684469:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301323776:12345-0@lo:400:kworker.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.684476:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782481109.684493:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782481109.684499:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301323520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481109.684549:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301323520:12345-0@lo:400:kworker.0 Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.684556:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782481109.684589:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301323392 00000100:00100000:2.0:1782481109.684593:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301323392 00000100:00100000:2.0:1782481109.684618:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301323648 00000100:00100000:2.0:1782481109.684620:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301323648 00000100:00100000:2.0:1782481109.684636:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782481109.684642:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301323392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481109.684689:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301323392:12345-0@lo:400:kworker.0 Request processed in 47us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.684717:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782481109.684730:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782481109.684736:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301323648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481109.684761:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301323648:12345-0@lo:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.684767:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782481109.684800:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301323392:0@lo:400:kworker.0 00010000:00080000:2.0:1782481109.684839:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5cb1dd8a80 x1869066301323776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481109.684850:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301323776:0@lo:400:kworker.0 00000100:00100000:2.0:1782481109.684884:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301323648:0@lo:400:kworker.0 00010000:00080000:2.0:1782481109.684895:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5b882bea00 x1869066301323520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481109.684904:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301323520:0@lo:400:kworker.0 00000020:01000004:0.0:1782481109.686670:0:24186:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1782481109.686690:0:24186:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f5c88570000) 00000020:00000080:0.0:1782481109.686745:0:24186:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1782481109.686988:0:24186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5cb8c99800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782481109.686993:0:24186:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5cb8c99800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782481109.686995:0:24186:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5cb8c99800 3 00010000:00080000:1.0:1782481109.687026:0:24186:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5cc1c29000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1782481109.692039:0:24186:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1782481109.692168:0:24186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1782481109.692212:0:24186:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782481109.692238:0:24186:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x65dae4c042ee45c1 00000100:00080000:0.0:1782481109.692248:0:24186:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782481109.692253:0:24186:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f5cc1c29000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1782481109.692292:0:24186:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ecd880 x1869066301323904/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782481109.692319:0:24186:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1782481109.693013:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1869066301323904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782481109.693078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782481109.693952:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481109.693958:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481109.693961:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481109.693964:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481109.693967:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481109.693970:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481109.693972:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481109.693975:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782481109.693994:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301323904 00000100:00100000:2.0:1782481109.694003:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301323904 00000100:00100000:2.0:1782481109.694037:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782481109.694044:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1869066301323904:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782481109.694352:0:22660:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 726 last 0 00000020:00000080:2.0:1782481109.695064:0:22660:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x65dae4c042ee45c8 00000004:00100000:2.0:1782481109.695217:0:22660:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782481109.695748:0:22660:0:(import.c:65:import_set_state_nolock()) ffff9f5b875e9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782481109.696674:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869066301323904:12345-0@lo:38:llog_process_th.0 Request processed in 2626us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.696686:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1782481109.696779:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f5cb1ecd880 x1869066301323904/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782481119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481109.696791:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782481109.696801:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1782481109.696808:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782481109.696814:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1782481109.696816:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cc1c29000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000040:00080000:0.0:1782481109.697199:0:24186:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1782481109.697451:0:24160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1782481109.697487:0:24160:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782481109.697691:0:24160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddf000/0x65dae4c042ee4597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee459e expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481109.697733:0:24160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddf000/0x65dae4c042ee4597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee459e expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782481109.697786:0:24160:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782481109.697788:0:24160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782481109.697790:0:24160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782481109.697792:0:24160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782481109.697793:0:24160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782481109.697795:0:24160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782481109.697797:0:24160:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782481109.697799:0:24160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782481109.697800:0:24160:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782481109.697804:0:24160:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1782481109.697806:0:24160:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782481109.697808:0:24160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782481109.697809:0:24160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782481109.697810:0:24160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782481109.697812:0:24160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782481109.697813:0:24160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782481109.697814:0:24160:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782481109.697815:0:24160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782481109.697816:0:24160:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1782481109.698444:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1869066301323904:0@lo:38:llog_process_th.0 10000000:01000000:1.0:1782481109.698750:0:24160:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1782481109.698770:0:24160:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301324032:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782481109.698851:0:24160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.698892:0:24160:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1c78900 going to sleep for 11 seconds 00000100:00100000:2.0:1782481109.699189:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301324032 00000100:00100000:2.0:1782481109.699198:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301324032 00000100:00100000:2.0:1782481109.699246:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782481109.699255:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301324032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782481109.699479:0:22652:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782481109.699494:0:22652:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782481109.716065:0:22652:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782481109.716088:0:22652:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782481109.716780:0:22675:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782481109.716787:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782481109.716816:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.716910:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4512 expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.716928:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4520 expref: 21 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.716937:0:22675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481109.716943:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24160:x1869066301324032:12345-0@lo:253:mount.lustre.0 Request processed in 17687us (18091us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481109.716953:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1782481109.717361:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee4520 expref: 20 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.717447:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee4520 expref: 20 pid: 22652 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481109.717461:0:22675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301324160:0@lo:104: 00000100:00100000:2.0:1782481109.717511:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782481109.717625:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee4512 expref: 20 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.717634:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee4512 expref: 20 pid: 22654 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481109.717642:0:22675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301324288:0@lo:104: 00000100:00100000:2.0:1782481109.717667:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.717804:0:24160:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24160:1869066301324032:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782481109.717816:0:24160:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782481109.717830:0:24160:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782481109.717832:0:24160:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782481109.717834:0:24160:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782481109.717835:0:24160:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782481109.717836:0:24160:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782481109.717846:0:24160:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782481109.717847:0:24160:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782481109.717849:0:24160:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782481109.717850:0:24160:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782481109.717865:0:24160:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1782481109.719654:0:22675:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded840 going to sleep for 11 seconds 00000001:00000004:1.0:1782481109.721621:0:24160:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1782481109.725133:0:22644:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782481109.725182:0:22644:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301324160 00000100:00100000:0.0:1782481109.725191:0:22644:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301324160 00000100:00100000:0.0:1782481109.725231:0:22644:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301324288 00000100:00100000:0.0:1782481109.725235:0:22644:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301324288 00000100:00100000:0.0:1782481109.725253:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782481109.725263:0:22644:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:22675:x1869066301324160:12345-0@lo:104: 00010000:00010000:0.0:1782481109.725282:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.725393:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782481109.725401:0:22644:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:22675:x1869066301324160:12345-0@lo:104: Request processed in 140us (7890us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481109.725409:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782481109.725429:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782481109.725437:0:22644:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b869e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:22675:x1869066301324288:12345-0@lo:104: 00010000:00010000:0.0:1782481109.725446:0:22644:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.725479:0:22644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782481109.725486:0:22644:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b869e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:22675:x1869066301324288:12345-0@lo:104: Request processed in 50us (7818us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481109.725492:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782481109.725616:0:22675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301324160:0@lo:104: 00000100:00100000:2.0:1782481109.725628:0:22675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301324288:0@lo:104: 00010000:00010000:2.0:1782481109.725650:0:22675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.725854:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782481109.725860:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.725867:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111c800 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1782481109.725872:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.725892:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481109.725899:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481109.725905:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782481109.725939:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.725946:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782481109.726207:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.726217:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c800/0x65dae4c042ee4520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4527 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.726229:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481109.726232:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.726239:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d75a00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:0.0:1782481109.726242:0:22649:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.726249:0:22649:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782481109.726255:0:22649:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481109.726267:0:22649:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782481109.726283:0:22649:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.726289:0:22649:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782481109.726314:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.726321:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75a00/0x65dae4c042ee4512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4519 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481109.726335:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481109.726336:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481109.726338:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481109.726358:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301324416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782481109.726400:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481109.726447:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782481109.726455:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301324544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782481109.726478:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782481109.727317:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481109.727338:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301324416 00000100:00100000:1.0:1782481109.727345:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301324416 00010000:00010000:1.0:1782481109.727374:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4520 expref: 21 pid: 22652 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1782481109.727507:0:24160:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782481109.727513:0:24160:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782481109.727550:0:24160:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782481109.727607:0:24160:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782481109.727627:0:24160:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1782481109.727652:0:24160:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000100:00100000:1.0:1782481109.727986:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301324544 00000100:00100000:1.0:1782481109.727991:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301324544 00010000:00010000:1.0:1782481109.728008:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4512 expref: 22 pid: 22654 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481109.728083:0:22643:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000020:00000004:0.0:1782481109.733081:0:24160:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782481109.733314:0:24160:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1782481109.736274:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782481109.736292:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:3648:x1869066301324416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782481109.736311:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481109.736320:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4520 expref: 22 pid: 22652 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736335:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee4520 expref: 22 pid: 22652 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736351:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c8fddfe00/0x65dae4c042ee4527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee4520 expref: 22 pid: 22652 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736366:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481109.736439:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:3648:x1869066301324416:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (10038us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.736447:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782481109.736473:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782481109.736481:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c8944f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:3650:x1869066301324544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782481109.736490:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481109.736495:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4512 expref: 20 pid: 22654 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736503:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee4512 expref: 20 pid: 22654 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736513:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee4519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee4512 expref: 20 pid: 22654 timeout: 826 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736543:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736551:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782481109.736566:0:22647:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.019779990s 00010000:00010000:2.0:1782481109.736584:0:22647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736591:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736597:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736603:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736609:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481109.736613:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736621:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736634:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736644:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481109.736680:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c8944f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:3650:x1869066301324544:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (10200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.736687:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1782481109.736757:0:22675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736766:0:22675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481109.736773:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c8fddf200/0x65dae4c042ee45cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481109.749772:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:93f44a9c-11b5-4eed-b910-753bd776bd7b:3648:1869066301324416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782481109.749834:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301324544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782481109.981117:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782481109.981143:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301324672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782481109.981211:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481109.981581:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301324672 00000100:00100000:2.0:1782481109.981589:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301324672 00000100:00100000:2.0:1782481109.981634:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782481109.981643:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301324672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782481109.981677:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782481109.981742:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301324672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481109.981750:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782481109.981797:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301324672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782481109.985331:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301324800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782481109.985396:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481109.985450:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301324800 00000100:00100000:1.0:1782481109.985457:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301324800 00000100:00100000:1.0:1782481109.986344:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782481109.986356:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301324800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782481109.986390:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1782481109.986446:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301324800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481109.986454:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782481109.987566:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301324800:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782481110.428600:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782481110.588429:0:24239:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782481110.588644:0:24239:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1782481111.015573:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782481111.015581:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f5b85b56800 from 13 10000000:01000000:2.0:1782481111.015587:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782481111.015639:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481111.015666:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481111.015678:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481111.015732:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301324928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782481111.015806:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481111.015855:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481111.015970:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301324928 00000100:00100000:3.0:1782481111.015978:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301324928 00000100:00100000:3.0:1782481111.016039:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782481111.016049:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c837ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+19:22656:x1869066301324928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481111.016062:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481111.016086:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee45d6 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481111.016110:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee45d6 expref: 20 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481111.016130:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee45d6 expref: 20 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481111.016139:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb5c00, rc 0) 00000100:00100000:3.0:1782481111.016186:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c837ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:22656:x1869066301324928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481111.016194:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782481111.016348:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301324928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782481111.016363:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481111.016372:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481111.016425:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301325056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782481111.016457:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481111.016483:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481111.017058:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301325056 00000100:00100000:0.0:1782481111.017065:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301325056 00000100:00100000:0.0:1782481111.017112:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782481111.017132:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c837ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:22656:x1869066301325056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782481111.017219:0:22652:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782481111.017242:0:22652:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782481111.017245:0:22652:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1782481111.017334:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c837ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:22656:x1869066301325056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 215us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481111.017341:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782481111.017660:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301325056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782481111.017795:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782481111.017804:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481111.017812:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481111.017832:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782481111.017834:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f5cb59c2800 from 13 10000000:01000000:2.0:1782481111.017836:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782481111.017863:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481111.017883:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481111.017892:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481111.017906:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301325184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782481111.017939:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481111.017974:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481111.018112:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301325184 00000100:00100000:0.0:1782481111.018128:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301325184 00000100:00100000:0.0:1782481111.018929:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782481111.018940:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:22656:x1869066301325184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481111.018953:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481111.018968:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee45e4 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481111.018991:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee45e4 expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481111.019002:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee45e4 expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481111.019010:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111d400, rc 0) 00000100:00100000:0.0:1782481111.019061:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:22656:x1869066301325184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481111.019095:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782481111.019187:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301325184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782481111.019202:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481111.019211:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481111.019262:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301325312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1782481111.019297:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481111.026390:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782481111.035852:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301325312 00000100:00100000:1.0:1782481111.035869:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301325312 00000100:00100000:1.0:1782481111.035941:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782481111.035951:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:22656:x1869066301325312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782481111.035979:0:22652:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782481111.035996:0:22652:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782481111.035999:0:22652:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1782481111.037520:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:22656:x1869066301325312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1565us (18216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481111.037531:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782481111.037609:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301325312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1782481111.037680:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782481111.037712:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481111.037724:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481111.452948:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481112.475942:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782481112.991178:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782481113.501147:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481114.529669:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782481115.099871:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481115.099878:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481115.099882:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481115.099886:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782481115.099886:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301325440:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1782481115.099906:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481115.099910:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481115.099913:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481115.099916:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782481115.099975:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481115.099984:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301325568:0@lo:400:kworker.0 00000100:00100000:0.0:1782481115.100198:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301325952:0@lo:400:kworker.0 00000100:00100000:1.0:1782481115.101323:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869066301325824:0@lo:400:kworker.0 00000100:00100000:2.0:1782481115.102440:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481115.102454:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481115.102498:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301326336:0@lo:400:kworker.0 00000100:00100000:2.0:1782481115.102499:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301326080:0@lo:400:kworker.0 00000100:00100000:1.0:1782481115.102556:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301325568 00000100:00100000:1.0:1782481115.102565:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301325568 00000100:00100000:0.0:1782481115.102730:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481115.102753:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301326464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782481115.102791:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481115.102836:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301325440 00000100:00100000:0.0:1782481115.102840:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301325440 00000100:00100000:0.0:1782481115.102872:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301325952 00000100:00100000:0.0:1782481115.102874:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301325952 00000100:00100000:0.0:1782481115.102885:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301326464 00000100:00100000:0.0:1782481115.102887:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301326464 00000100:00100000:1.0:1782481115.103254:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782481115.103262:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:3649:x1869066301325568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481115.103317:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:3649:x1869066301325568:12345-0@lo:400:kworker.0 Request processed in 55us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481115.103335:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782481115.103370:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301325824 00000100:00100000:1.0:1782481115.103374:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301325824 00000100:00100000:1.0:1782481115.103399:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782481115.103405:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869066301325824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481115.103456:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869066301325824:12345-0@lo:400:kworker.0 Request processed in 50us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481115.103463:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782481115.103522:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782481115.103533:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301325440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782481115.103560:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782481115.103594:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481115.103638:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301325568:0@lo:400:kworker.0 00000100:00100000:2.0:1782481115.103653:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782481115.103661:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301325696:0@lo:400:kworker.0 00000100:00100000:2.0:1782481115.103688:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481115.103722:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301326208:0@lo:400:kworker.0 00000100:00100000:0.0:1782481115.103748:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301325440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 216us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481115.103755:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481115.103772:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782481115.103790:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301325696 00000100:00100000:0.0:1782481115.103794:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301325696 00000100:00100000:2.0:1782481115.103797:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782481115.103806:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1869066301325952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481115.103840:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782481115.103845:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1869066301325952:12345-0@lo:400:kworker.0 Request processed in 38us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481115.103851:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1869066301326464:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782481115.103864:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00000024:0.0:1782481115.103869:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782481115.103881:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782481115.103889:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301325696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481115.103907:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301326464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481115.103924:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782481115.103930:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301325696:12345-0@lo:400:kworker.0 Request processed in 41us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481115.103937:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782481115.103960:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301326080 00000100:00100000:2.0:1782481115.103963:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301326080 00000100:00100000:2.0:1782481115.103981:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301326208 00000100:00100000:2.0:1782481115.103984:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301326208 00000100:00100000:2.0:1782481115.104027:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782481115.104033:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869066301326080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782481115.104039:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782481115.104221:0:22659:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782481115.104230:0:22659:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1782481115.104340:0:22661:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782481115.104349:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782481115.104356:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869066301326208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481115.104400:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301325952:0@lo:400:kworker.0 00000100:00100000:0.0:1782481115.107300:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301326464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782481115.107323:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301325440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782481115.108147:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481115.114596:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301325696:0@lo:400:kworker.0 00010000:00080000:3.0:1782481115.114624:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b87a01f80 x1869066301326208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481115.114649:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301326208:0@lo:400:kworker.0 00010000:00080000:3.0:1782481115.114664:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b87a03800 x1869066301326080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481115.114672:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301326080:0@lo:400:kworker.0 00000100:00100000:2.0:1782481115.116191:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869066301326080:12345-0@lo:400:kworker.0 Request processed in 12149us (13639us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481115.116191:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869066301326208:12345-0@lo:400:kworker.0 Request processed in 11825us (12428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481115.116211:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1782481115.116275:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b87a00a80 x1869066301325824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481115.116287:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869066301325824:0@lo:400:kworker.0 00000100:00100000:1.0:1782481115.116382:0:22661:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782481115.116391:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301326336 00000100:00100000:1.0:1782481115.116398:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301326336 00000100:00100000:2.0:1782481115.116515:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1782481115.116516:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782481115.116560:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782481115.116568:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301326336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481115.117131:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301326336:12345-0@lo:400:kworker.0 Request processed in 561us (8984us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481115.117138:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1782481115.117178:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b87a02300 x1869066301326336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481115.117189:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301326336:0@lo:400:kworker.0 00010000:00010000:1.0:1782481115.549266:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782481115.868623:0:24530:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1782481116.254132:0:23418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782481116.572888:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782481116.788401:0:24582:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782481116.788590:0:24582:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1782481117.596897:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782481117.663645:0:24632:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782481117.666056:0:24632:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1782481118.620449:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481119.643957:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481119.964794:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481104/real 1782481104] req@ffff9f5b882bed80 x1869066301319680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481119.964825:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5b882bed80 x1869066301319680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481119.964835:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481104/real 1782481104] req@ffff9f5b882bc700 x1869066301319808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481119 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481119.964846:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5b882bc700 x1869066301319808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481119 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782481119.964867:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b8822f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481119.964898:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782481119.964914:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301319680:0@lo:8:kworker.0 00000100:00080000:3.0:1782481119.964920:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b879a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481119.964925:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782481119.964928:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301319808:0@lo:8:kworker.0 00000100:00080000:3.0:1782481119.965018:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481119.965022:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481119.965032:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481119.965035:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481119.965070:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481119.965073:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1782481119.965075:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5b8822f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782481119.965080:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 721 00000100:00080000:3.0:1782481119.965084:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782481119.965090:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f5b8822f000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481119.965108:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b88815180 x1869066301327104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782481119.965120:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481119.965123:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1782481119.965124:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5b879a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782481119.965127:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 721 00000100:00080000:3.0:1782481119.965130:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1782481119.965133:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f5b879a9000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481119.965143:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b88817b80 x1869066301327232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782481119.965181:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301326592:0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.965247:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481119.965291:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301327360:0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.965317:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481119.965338:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782481119.965344:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301326720:0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.965378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481119.965399:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301327488:0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.965418:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481119.965445:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869066301326848:0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.965467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481119.965483:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301327616:0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.965505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481119.965521:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782481119.965527:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301326976:0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.965546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481119.965575:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301326592 00000100:00100000:3.0:1782481119.965581:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301326592 00000100:00100000:3.0:1782481119.965637:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782481119.965646:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:3649:x1869066301326592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.966046:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:3649:x1869066301326592:12345-0@lo:400:kworker.0 Request processed in 400us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481119.966055:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782481119.966092:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301327360 00000100:00100000:3.0:1782481119.966097:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301327360 00000100:00100000:3.0:1782481119.966116:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301327488 00000100:00100000:3.0:1782481119.966119:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301327488 00000100:00100000:3.0:1782481119.966142:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301326848 00000100:00100000:3.0:1782481119.966144:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301326848 00000100:00100000:3.0:1782481119.966155:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301327616 00000100:00100000:3.0:1782481119.966158:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301327616 00000100:00100000:3.0:1782481119.966173:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782481119.966179:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869066301327360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.966222:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869066301327360:12345-0@lo:400:kworker.0 Request processed in 43us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481119.966229:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782481119.966243:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782481119.966249:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869066301327488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.966277:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869066301327488:12345-0@lo:400:kworker.0 Request processed in 28us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481119.966283:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782481119.966294:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782481119.966299:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869066301326848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.966330:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869066301326848:12345-0@lo:400:kworker.0 Request processed in 30us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481119.966336:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782481119.966348:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782481119.966354:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301327616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.966381:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869066301327616:12345-0@lo:400:kworker.0 Request processed in 27us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481119.966386:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782481119.966405:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301326720 00000100:00100000:3.0:1782481119.966408:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301326720 00000100:00100000:3.0:1782481119.966430:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301326976 00000100:00100000:3.0:1782481119.966433:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301326976 00000100:00100000:3.0:1782481119.966443:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782481119.966447:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301326720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.966473:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301326720:12345-0@lo:400:kworker.0 Request processed in 25us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481119.966485:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782481119.966496:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782481119.966502:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301326976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.966530:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301326976:12345-0@lo:400:kworker.0 Request processed in 29us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481119.966535:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1782481119.966563:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782481119.966567:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782481119.966596:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301326976:0@lo:400:kworker.0 00010000:00080000:3.0:1782481119.966609:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b88817800 x1869066301326848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481119.966619:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869066301326848:0@lo:400:kworker.0 00010000:00080000:3.0:1782481119.966628:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b88814000 x1869066301327616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481119.966635:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1869066301327616:0@lo:400:kworker.0 00000100:00100000:3.0:1782481119.966660:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301327104:0@lo:8:kworker.0 00000100:00100000:3.0:1782481119.966710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481119.966745:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301327232:0@lo:8:kworker.0 00000100:00100000:3.0:1782481119.966768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481119.966809:0:24164:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301327104 00000100:00100000:3.0:1782481119.966813:0:24164:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301327104 00000100:00100000:3.0:1782481119.966827:0:24164:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301327232 00000100:00100000:3.0:1782481119.966829:0:24164:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301327232 00000100:00100000:3.0:1782481119.966837:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782481119.966847:0:24164:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1869066301327104:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1782481119.967660:0:24164:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 736 last 0 00000020:00000080:3.0:1782481119.967717:0:24164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x65dae4c042ee45f2 00002000:00100000:3.0:1782481119.967732:0:24164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f5cbdf1a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211365f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1782481119.967735:0:24164:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1782481119.967738:0:24164:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782481119.967988:0:24164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1782481119.968014:0:24164:0:(import.c:65:import_set_state_nolock()) ffff9f5cbdf1a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782481119.968075:0:24164:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1869066301327104:12345-0@lo:8:kworker.0 Request processed in 1227us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481119.968083:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782481119.968103:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782481119.968108:0:24164:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1869066301327232:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1782481119.968123:0:24164:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1782481119.971991:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301326720:0@lo:400:kworker.0 00010000:00080000:1.0:1782481119.972018:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b88814a80 x1869066301327488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481119.972030:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301327488:0@lo:400:kworker.0 00000100:00100000:1.0:1782481119.972043:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301326592:0@lo:400:kworker.0 00010000:00080000:1.0:1782481119.972054:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b88817100 x1869066301327360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481119.972063:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301327360:0@lo:400:kworker.0 00010000:00080000:1.0:1782481119.972113:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b88815180 x1869066301327104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782481139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481119.972122:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782481119.972131:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1782481119.972140:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782481119.972146:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1782481119.972150:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b8822f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782481119.972161:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782481119.972167:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301327104:0@lo:8:kworker.0 00000100:00100000:1.0:1782481119.973516:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301327744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782481119.973577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481119.973620:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301327744 00000100:00100000:2.0:1782481119.973628:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301327744 00000100:00100000:2.0:1782481119.973687:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782481119.973712:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869066301327744:12345-0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1782481119.973713:0:23402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1782481119.973736:0:23402:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1869066301327872:0@lo:7:osp-pre-0-1.0 00002000:00000024:2.0:1782481119.973740:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1782481119.973762:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481119.973779:0:23402:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded540 going to sleep for 11 seconds 00000004:00080000:0.0:1782481119.973794:0:23401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782481119.973880:0:23401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 736489185930ns, next at 0ns, rc = 0 00080000:00080000:0.0:1782481119.973886:0:23401:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1782481119.973926:0:24166:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1782481119.973932:0:24166:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1782481119.974156:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301327872 00000100:00100000:0.0:1782481119.974160:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301327872 00000100:00100000:0.0:1782481119.976460:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782481119.976484:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23402:x1869066301327872:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1782481119.978545:0:23392:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1782481119.979711:0:24746:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1782481119.979728:0:24746:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1782481119.979826:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23402:x1869066301327872:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3349us (6058us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481119.979838:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1782481119.979938:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5cb1ecdf80 x1869066301327872/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782481135 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481119.979953:0:23402:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1869066301327872:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1782481119.979966:0:23402:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1782481119.980006:0:23402:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1869066301328000:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1782481119.980040:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481119.980061:0:23402:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1ded540 going to sleep for 11 seconds 00000100:00100000:0.0:1782481119.980081:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301328000 00000100:00100000:0.0:1782481119.980087:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301328000 00000100:00100000:0.0:1782481119.980124:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782481119.980132:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:23402:x1869066301328000:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1782481119.980159:0:24166:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1782481119.980188:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:23402:x1869066301328000:12345-0@lo:5:osp-pre-0-1.0 Request processed in 57us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481119.980195:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782481119.980223:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5cb1ecdf80 x1869066301328000/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782481135 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481119.980232:0:23402:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1869066301328000:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1782481119.980240:0:23402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1782481119.980321:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869066301327744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6625us (6741us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481119.980340:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782481119.980877:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5cb1ecfb80 x1869066301327744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782481135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481119.980897:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301327744:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782481119.981742:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782481119.996008:0:24164:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1869066301327232:12345-0@lo:8:kworker.0 Request processed in 27888us (29228us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782481119.996037:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1782481119.996128:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b879a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782481119.996135:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782481119.996139:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301327232:0@lo:8:kworker.0 00000100:00100000:1.0:1782481120.223325:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301328128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782481120.223396:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481120.223822:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301328128 00000100:00100000:3.0:1782481120.223830:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301328128 00000100:00100000:3.0:1782481120.223930:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782481120.223940:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301328128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782481120.223979:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1782481120.224035:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301328128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481120.224042:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782481120.224091:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301328128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782481120.227398:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301328256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782481120.227477:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481120.227584:0:23400:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301328256 00000100:00100000:1.0:1782481120.227592:0:23400:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301328256 00000100:00100000:1.0:1782481120.227641:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782481120.227651:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301328256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782481120.227686:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782481120.234755:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301328256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7096us (7269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481120.234770:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782481120.235176:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301328256:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782481120.668912:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481121.692371:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782481122.204348:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782481122.718503:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481123.744840:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782481124.273540:0:24979:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782481124.273544:0:24979:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1782481124.273546:0:24979:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1782481124.273750:0:24979:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9f5ca5d2c000 00000020:01000004:1.0:1782481124.273767:0:24979:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1782481124.273784:0:24979:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1782481124.276002:0:24979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f5b86a299c0) 00000020:00000080:1.0:1782481124.276031:0:24979:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1782481124.364246:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1782481124.366944:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1782481124.367808:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1782481124.368134:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1782481124.368972:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1782481124.369277:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1782481124.370248:0:24979:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1782481124.382091:0:24979:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1782481124.382506:0:24979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782481124.382520:0:24979:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782481124.382532:0:24979:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x65dae4c042ee4600 00000020:01000004:3.0:1782481124.382539:0:24979:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1782481124.382559:0:24979:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782481124.382562:0:24979:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782481124.382568:0:24979:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782481124.382608:0:24979:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1782481124.382612:0:24979:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782481124.417617:0:24979:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782481124.417688:0:24979:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.111@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1782481124.417738:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782481124.417740:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782481124.417742:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782481124.417743:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782481124.417744:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782481124.417746:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782481124.417748:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782481124.417750:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782481124.417751:0:24979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782481124.417755:0:24979:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1782481124.417758:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782481124.417759:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782481124.417760:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782481124.417761:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782481124.417762:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782481124.417763:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782481124.417764:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782481124.417765:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782481124.417766:0:24979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782481124.417808:0:24979:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782481124.417841:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90299880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328384:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782481124.417922:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481124.417964:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8973b600 going to sleep for 11 seconds 00000100:00100000:0.0:1782481124.418068:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301328384 00000100:00100000:0.0:1782481124.418076:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301328384 00000100:00100000:0.0:1782481124.418139:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782481124.418148:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24979:x1869066301328384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782481124.418179:0:22654:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1782481124.418182:0:22654:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1782481124.418186:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782481124.418536:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24979:x1869066301328384:12345-0@lo:253:mount.lustre.0 Request processed in 388us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481124.418545:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782481124.418675:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90299880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328384:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782481124.418684:0:24979:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1782481124.418686:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782481124.418688:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782481124.418689:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782481124.418719:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782481124.418720:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782481124.418721:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782481124.418722:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782481124.418724:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782481124.418725:0:24979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782481124.418742:0:24979:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f5ca5d2c000 from lustre-OST0001 10000000:01000000:1.0:1782481124.418776:0:24979:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1782481124.418779:0:24979:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782481124.418796:0:24979:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f5cb5f799c0 local copy 00010000:00010000:1.0:1782481124.418808:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481124.418903:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481124.418935:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.418963:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb8cdb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481124.419025:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301328512 00000100:00100000:0.0:1782481124.419031:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301328512 00000100:00100000:0.0:1782481124.419062:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782481124.419068:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24979:x1869066301328512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481124.419125:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24979:x1869066301328512:12345-0@lo:501:mount.lustre.0 Request processed in 57us (189us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782481124.419131:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782481124.419249:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328512:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1782481124.419261:0:24979:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782481124.419277:0:24979:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782481124.419283:0:24979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481124.419291:0:24979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75400/0x65dae4c042ee431a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4321 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481124.419327:0:24979:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f5ca5d2c000 10000000:01000000:1.0:1782481124.419332:0:24979:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782481124.419337:0:24979:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1782481124.419340:0:24979:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782481124.419344:0:24979:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1782481124.419346:0:24979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782481124.419371:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74200/0x65dae4c042ee4607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481124.419379:0:24979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74200/0x65dae4c042ee4607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481124.419388:0:24979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74200/0x65dae4c042ee4607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481124.419398:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782481124.419423:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.419451:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb8cdb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481124.419560:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301328640 00000100:00100000:0.0:1782481124.419565:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301328640 00000100:00100000:0.0:1782481124.419591:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782481124.419596:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:24979:x1869066301328640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481124.419605:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481124.419615:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee460e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4607 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481124.419634:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee460e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4607 expref: 22 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481124.419651:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111dc00/0x65dae4c042ee460e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4607 expref: 22 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481124.419659:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111dc00, rc 0) 00000100:00100000:0.0:1782481124.419683:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301328640:12345-0@lo:101:mount.lustre.0 Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481124.419689:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782481124.419925:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481124.419937:0:24979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74200/0x65dae4c042ee4607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee460e expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481124.419946:0:24979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74200/0x65dae4c042ee4607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee460e expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782481124.421163:0:24979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1782481124.425186:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782481124.429985:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1782481124.430058:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1782481124.430073:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1782481124.430085:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1782481124.430097:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1782481124.430107:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1782481124.430119:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1782481124.430131:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1782481124.430146:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1782481124.430184:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1782481124.430190:0:24979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1782481124.430305:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481124.430447:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.430554:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f76480 going to sleep for 11 seconds 00000100:00100000:0.0:1782481124.430603:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301328768 00000100:00100000:0.0:1782481124.430611:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301328768 00000100:00100000:0.0:1782481124.430689:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1782481124.430724:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301328768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481124.430888:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301328768:12345-0@lo:501:mount.lustre.0 Request processed in 166us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481124.430895:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782481124.430990:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481124.431022:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481124.431062:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.431502:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f76480 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.431587:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301328896 00000100:00100000:3.0:1782481124.431594:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301328896 00000100:00100000:3.0:1782481124.431623:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782481124.431631:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301328896:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782481124.432452:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301328896:12345-0@lo:503:mount.lustre.0 Request processed in 819us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.432461:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782481124.432552:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301328896:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782481124.433052:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782481124.433130:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481124.433180:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.433208:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f76480 going to sleep for 11 seconds 00000100:00100000:0.0:1782481124.433283:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301329024 00000100:00100000:0.0:1782481124.433290:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301329024 00000100:00100000:0.0:1782481124.433341:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782481124.433350:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301329024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481124.434110:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301329024:12345-0@lo:502:mount.lustre.0 Request processed in 757us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481124.434119:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782481124.434211:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481124.434480:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1782481124.434510:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1782481124.434521:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1782481124.434532:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1782481124.434544:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1782481124.434558:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1782481124.434571:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1782481124.434583:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1782481124.434594:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1782481124.434622:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329152:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481124.434663:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.434833:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f76480 going to sleep for 11 seconds 00000100:00100000:2.0:1782481124.434954:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301329152 00000100:00100000:2.0:1782481124.434961:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301329152 00000100:00100000:3.0:1782481124.435052:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782481124.435065:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301329152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481124.435173:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301329152:12345-0@lo:502:mount.lustre.0 Request processed in 111us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.435181:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782481124.435261:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481124.435304:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1782481124.435378:0:24979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1782481124.436207:0:24983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782481124.436215:0:24983:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1782481124.436221:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481124.436224:0:24983:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1782481124.436230:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782481124.436247:0:24983:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f5c88573380) 00000020:00000080:0.0:1782481124.436269:0:24983:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782481124.436275:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782481124.436406:0:24983:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5ca5d2c000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1782481124.436414:0:24983:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782481124.436422:0:24983:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x65dae4c042ee461c 00010000:00010000:0.0:1782481124.439753:0:24983:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1782481124.447226:0:24983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:0.0:1782481124.448752:0:24983:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1782481124.462339:0:24983:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1782481124.462353:0:24983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782481124.462359:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782481124.462362:0:24983:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1782481124.462366:0:24983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782481124.462370:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782481124.462371:0:24983:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782481124.462375:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782481124.462377:0:24983:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782481124.462379:0:24983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782481124.462381:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782481124.462383:0:24983:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782481124.462386:0:24983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782481124.462388:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782481124.462403:0:24983:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782481124.462408:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1782481124.462441:0:24983:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782481124.462444:0:24983:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782481124.462445:0:24983:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782481124.462448:0:24983:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1782481124.462635:0:24979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1782481124.462666:0:24979:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782481124.462715:0:24979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74200/0x65dae4c042ee4607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee460e expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.462727:0:24979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74200/0x65dae4c042ee4607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee460e expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481124.462736:0:24979:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5ca5d2c000 from 1 10000000:01000000:3.0:1782481124.462739:0:24979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782481124.462777:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.462796:0:24979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.462822:0:24979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481124.462849:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782481124.462916:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481124.462960:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c84d16d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782481124.465237:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301329280 00000100:00100000:0.0:1782481124.465251:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301329280 00000100:00100000:0.0:1782481124.465627:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782481124.465637:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:24979:x1869066301329280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481124.465655:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481124.465671:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4623 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481124.465715:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4623 expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481124.465727:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4623 expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481124.465736:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111c800, rc 0) 00000100:00100000:0.0:1782481124.465887:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329280:12345-0@lo:101:mount.lustre.0 Request processed in 178us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481124.465896:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782481124.465985:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481124.466005:0:24979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481124.466015:0:24979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782481124.467027:0:24979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1782481124.467269:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782481124.467430:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1782481124.467455:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1782481124.467469:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1782481124.467481:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1782481124.467492:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1782481124.467504:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1782481124.467516:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1782481124.467530:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1782481124.467542:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1782481124.467556:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1782481124.467588:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1782481124.467608:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1782481124.467613:0:24979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1782481124.467675:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481124.469099:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.469189:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f76900 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.471517:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301329408 00000100:00100000:3.0:1782481124.471533:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301329408 00000100:00100000:3.0:1782481124.471605:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782481124.471616:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329408:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481124.472172:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329408:12345-0@lo:501:mount.lustre.0 Request processed in 556us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.472180:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782481124.472759:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481124.472859:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481124.472914:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.472954:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f76900 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.473202:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301329536 00000100:00100000:3.0:1782481124.473208:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301329536 00000100:00100000:3.0:1782481124.473251:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782481124.473259:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782481124.473383:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329536:12345-0@lo:503:mount.lustre.0 Request processed in 123us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.473390:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782481124.473585:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782481124.474135:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782481124.474206:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481124.474251:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.474287:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f76480 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.474483:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301329664 00000100:00100000:3.0:1782481124.474489:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301329664 00000100:00100000:3.0:1782481124.474529:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782481124.474536:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481124.478235:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329664:12345-0@lo:502:mount.lustre.0 Request processed in 3690us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481124.478249:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782481124.478419:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481124.480021:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1782481124.480081:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1782481124.480096:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1782481124.480111:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1782481124.480124:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1782481124.480140:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1782481124.480154:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1782481124.480173:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1782481124.480187:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1782481124.480202:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1782481124.480216:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1782481124.480259:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481124.480338:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.480376:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f76480 going to sleep for 11 seconds 00000100:00100000:0.0:1782481124.480631:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301329792 00000100:00100000:0.0:1782481124.480638:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301329792 00000100:00100000:0.0:1782481124.480718:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782481124.480729:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481124.480936:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329792:12345-0@lo:502:mount.lustre.0 Request processed in 208us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481124.480944:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782481124.482024:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481124.482110:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1782481124.482124:0:24979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1782481124.485494:0:24987:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481124.485508:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481124.485510:0:24987:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782481124.485518:0:24987:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f5ca5d2c000 00000020:00000080:1.0:1782481124.485521:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481124.485528:0:24987:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481124.485530:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481124.485532:0:24987:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782481124.485534:0:24987:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481124.485536:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481124.485538:0:24987:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782481124.485541:0:24987:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f5ca5d2c000 00000020:00000080:1.0:1782481124.485543:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481124.485638:0:24987:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481124.485642:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481124.485644:0:24987:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782481124.485647:0:24987:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481124.485650:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481124.485651:0:24987:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782481124.485654:0:24987:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f5ca5d2c000 00000020:00000080:1.0:1782481124.485656:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481124.491055:0:24987:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481124.491086:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481124.491089:0:24987:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782481124.491094:0:24987:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481124.491098:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481124.491100:0:24987:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1782481124.491104:0:24987:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f5ca5d2c000 00000020:00000080:1.0:1782481124.491107:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481124.491165:0:24987:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481124.491169:0:24987:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481124.491170:0:24987:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1782481124.491173:0:24987:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1782481124.491970:0:24979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1782481124.492006:0:24979:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782481124.492031:0:24979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.492043:0:24979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481124.492108:0:24979:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782481124.492112:0:24979:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f5ca5d2c000 10000000:01000000:3.0:1782481124.492115:0:24979:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f5ca5d2c000 10000000:01000000:3.0:1782481124.492118:0:24979:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782481124.492123:0:24979:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9f5ca5d2c000 from 1 10000000:01000000:3.0:1782481124.492126:0:24979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782481124.492163:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb5200/0x65dae4c042ee4631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.492171:0:24979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb5200/0x65dae4c042ee4631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.492182:0:24979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb5200/0x65dae4c042ee4631 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481124.492206:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782481124.492275:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481124.492311:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8a6a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1782481124.492935:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301329920 00000100:00100000:1.0:1782481124.492949:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301329920 00000100:00100000:1.0:1782481124.493000:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1782481124.493008:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:24979:x1869066301329920:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481124.493021:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481124.493034:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca7d74400/0x65dae4c042ee4638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4631 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481124.493057:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca7d74400/0x65dae4c042ee4638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4631 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481124.493067:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca7d74400/0x65dae4c042ee4638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4631 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481124.493076:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca7d74400, rc 0) 00000100:00100000:1.0:1782481124.493117:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301329920:12345-0@lo:101:mount.lustre.0 Request processed in 110us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481124.493124:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782481124.493215:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301329920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782481124.493228:0:24979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb5200/0x65dae4c042ee4631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4638 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.493237:0:24979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb5200/0x65dae4c042ee4631 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4638 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782481124.500647:0:24979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1782481124.501020:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782481124.501246:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1782481124.501272:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1782481124.501287:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1782481124.501301:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1782481124.501313:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1782481124.501327:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1782481124.501339:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1782481124.501351:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1782481124.501362:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1782481124.501374:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1782481124.501387:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1782481124.501413:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1782481124.501429:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1782481124.501442:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1782481124.501453:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1782481124.501481:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1782481124.501495:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1782481124.501505:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1782481124.501517:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1782481124.501529:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1782481124.501542:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1782481124.501553:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1782481124.501565:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1782481124.501582:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1782481124.501609:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1782481124.501624:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1782481124.501637:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1782481124.501648:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1782481124.501661:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1782481124.501681:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1782481124.501720:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1782481124.501750:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1782481124.501765:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1782481124.501778:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1782481124.501791:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1782481124.501802:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1782481124.501829:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1782481124.501845:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1782481124.501858:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1782481124.501870:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1782481124.501883:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1782481124.501895:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1782481124.501907:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1782481124.501919:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1782481124.501930:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1782481124.501940:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1782481124.501952:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1782481124.501978:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1782481124.502098:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1782481124.502118:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1782481124.502135:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1782481124.502139:0:24979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1782481124.502224:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481124.502287:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481124.502337:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301330048 00000100:00100000:3.0:1782481124.502343:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301330048 00000100:00100000:3.0:1782481124.502388:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782481124.502397:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481124.502506:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330048:12345-0@lo:501:mount.lustre.0 Request processed in 109us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.502523:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782481124.502572:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8a6a8600 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.502594:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481124.502624:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782481124.502660:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481124.502682:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301330176 00000100:00100000:3.0:1782481124.502685:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301330176 00000100:00100000:3.0:1782481124.502728:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782481124.502734:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330176:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782481124.502800:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf439850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330176:12345-0@lo:503:mount.lustre.0 Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.502807:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782481124.502852:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8a6a8600 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.502865:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330176:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782481124.503193:0:24979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782481124.503248:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481124.503285:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481124.503313:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301330304 00000100:00100000:3.0:1782481124.503318:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301330304 00000100:00100000:3.0:1782481124.503340:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782481124.503346:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481124.503414:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf439c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330304:12345-0@lo:502:mount.lustre.0 Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.503420:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782481124.503458:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8a6a8900 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.503470:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481124.503597:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1782481124.503621:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1782481124.503636:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1782481124.503648:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1782481124.503660:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1782481124.503671:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1782481124.503684:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1782481124.503724:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1782481124.503737:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1782481124.503764:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1782481124.503778:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1782481124.503791:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1782481124.503804:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1782481124.515090:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1782481124.515148:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1782481124.515165:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1782481124.515181:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1782481124.515196:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1782481124.515210:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1782481124.515226:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1782481124.515243:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1782481124.515258:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1782481124.515272:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1782481124.515288:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1782481124.515304:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1782481124.515338:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1782481124.515354:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1782481124.515369:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1782481124.515383:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1782481124.515414:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1782481124.515442:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1782481124.515459:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1782481124.515473:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1782481124.515489:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1782481124.515505:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1782481124.515520:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1782481124.515533:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1782481124.515548:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1782481124.515563:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1782481124.515577:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1782481124.515590:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1782481124.515622:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1782481124.515638:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1782481124.515650:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1782481124.515663:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1782481124.515676:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1782481124.515711:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1782481124.515730:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1782481124.515788:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481124.515994:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481124.516043:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301330432 00000100:00100000:3.0:1782481124.516050:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301330432 00000100:00100000:3.0:1782481124.516096:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782481124.516106:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481124.516220:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330432:12345-0@lo:502:mount.lustre.0 Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.516228:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782481124.516291:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8a6a8900 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.516314:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481124.516636:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1782481124.516657:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1782481124.516682:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481124.516749:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481124.516773:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301330560 00000100:00100000:3.0:1782481124.516777:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301330560 00000100:00100000:3.0:1782481124.516822:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782481124.517147:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481124.517225:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf438450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301330560:12345-0@lo:502:mount.lustre.0 Request processed in 83us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.517232:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782481124.517270:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8a6a8900 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.517284:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301330560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481124.517324:0:24979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1782481124.517332:0:24979:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1782481124.520128:0:24992:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782481124.520146:0:24992:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f5c83fb8000) 00000020:00000080:3.0:1782481124.520173:0:24992:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1782481124.520353:0:24992:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5ca5d2c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782481124.520358:0:24992:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5ca5d2c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782481124.520361:0:24992:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5ca5d2c000 3 00010000:00080000:3.0:1782481124.521102:0:24992:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5b818e0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.111@tcp at head 00010000:00010000:3.0:1782481124.533308:0:24992:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1782481124.533431:0:24992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782481124.533482:0:24992:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782481124.533498:0:24992:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x65dae4c042ee4646 00000100:00080000:3.0:1782481124.533511:0:24992:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782481124.533525:0:24992:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f5b818e0800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481124.533570:0:24992:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5c90299500 x1869066301330688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782481124.533606:0:24992:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782481124.533895:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1869066301330688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782481124.533969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481124.534031:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301330688 00000100:00100000:0.0:1782481124.534037:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301330688 00000100:00100000:0.0:1782481124.534071:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782481124.534079:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1869066301330688:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1782481124.534102:0:22660:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 741 last 0 00000020:00000080:0.0:1782481124.534135:0:22660:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x65dae4c042ee464d 00000004:00100000:0.0:1782481124.534150:0:22660:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782481124.534181:0:22660:0:(import.c:65:import_set_state_nolock()) ffff9f5b88067000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481124.534229:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869066301330688:12345-0@lo:38:llog_process_th.0 Request processed in 149us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481124.534236:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782481124.534274:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5c90299500 x1869066301330688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782481134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481124.534284:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782481124.534291:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1782481124.534298:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782481124.534302:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782481124.534311:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b818e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782481124.534318:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1869066301330688:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1782481124.535617:0:24992:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782481124.535636:0:24992:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f5b86bab380) 00000020:00000080:3.0:1782481124.535659:0:24992:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1782481124.535926:0:24992:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f5ca5d2c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782481124.535931:0:24992:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f5ca5d2c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782481124.535933:0:24992:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9f5ca5d2c000 3 00010000:00080000:3.0:1782481124.535961:0:24992:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f5b818e7800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.111@tcp at head 00000100:00080000:2.0:1782481124.537573:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481124.537579:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481124.537582:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481124.537585:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782481124.537618:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782481124.537621:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782481124.537625:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f5b879a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782481124.537633:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 736 00000100:00080000:2.0:1782481124.537639:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1782481124.537645:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f5b879a9000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1782481124.537671:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5b87a03800 x1869066301331328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782481124.537745:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869066301330944:0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.537899:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.537932:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1869066301331584:0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.537953:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.537976:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782481124.537981:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301330816:0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.538006:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.538023:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869066301331456:0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.538053:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.538079:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301331072:0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.538102:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.538117:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1869066301331712:0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.538138:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.538154:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782481124.538159:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301331200:0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.538180:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.538215:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301330944 00000100:00100000:2.0:1782481124.538222:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301330944 00000100:00100000:2.0:1782481124.538258:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301331584 00000100:00100000:2.0:1782481124.538262:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301331584 00000100:00100000:2.0:1782481124.538288:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301331456 00000100:00100000:2.0:1782481124.538291:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301331456 00000100:00100000:2.0:1782481124.538303:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301331712 00000100:00100000:2.0:1782481124.538305:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301331712 00000100:00100000:2.0:1782481124.538322:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782481124.538331:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869066301330944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.538385:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869066301330944:12345-0@lo:400:kworker.0 Request processed in 54us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481124.538392:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782481124.539614:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782481124.539631:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869066301331584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481124.539759:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782481124.539771:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869066301331456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481124.539833:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869066301331456:12345-0@lo:400:kworker.0 Request processed in 66us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481124.539840:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782481124.539855:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782481124.539862:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869066301331712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481124.539895:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869066301331712:12345-0@lo:400:kworker.0 Request processed in 34us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481124.539901:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782481124.539935:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301331328:0@lo:8:kworker.0 00000100:00100000:1.0:1782481124.539972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.541973:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869066301331584:12345-0@lo:400:kworker.0 Request processed in 2334us (4005us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481124.541989:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782481124.542043:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301330816 00000100:00100000:2.0:1782481124.542059:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301330816 00000100:00100000:2.0:1782481124.542105:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301331072 00000100:00100000:2.0:1782481124.542109:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301331072 00000100:00100000:2.0:1782481124.542127:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782481124.542135:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301330816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.542212:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301330816:12345-0@lo:400:kworker.0 Request processed in 79us (4205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481124.542218:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782481124.542230:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782481124.542235:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301331072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.542263:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301331072:12345-0@lo:400:kworker.0 Request processed in 28us (4161us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481124.542268:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782481124.542311:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301330816:0@lo:400:kworker.0 00010000:00080000:2.0:1782481124.542327:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b87a01f80 x1869066301331456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481124.542337:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869066301331456:0@lo:400:kworker.0 00010000:00080000:2.0:1782481124.542349:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b87a01880 x1869066301330944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481124.542357:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869066301330944:0@lo:400:kworker.0 00010000:00080000:2.0:1782481124.542367:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b87a03b80 x1869066301331584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481124.542375:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1869066301331584:0@lo:400:kworker.0 00000100:00100000:2.0:1782481124.542433:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301331072:0@lo:400:kworker.0 00010000:00080000:2.0:1782481124.542457:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b87a00e00 x1869066301331712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481124.542466:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1869066301331712:0@lo:400:kworker.0 00000100:00100000:1.0:1782481124.544775:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301331200 00000100:00100000:1.0:1782481124.544802:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301331200 00000100:00100000:1.0:1782481124.544969:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301331328 00000100:00100000:1.0:1782481124.544975:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301331328 00000100:00100000:1.0:1782481124.544996:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782481124.545006:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1869066301331200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481124.545112:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1869066301331200:12345-0@lo:400:kworker.0 Request processed in 108us (6931us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481124.545119:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782481124.545136:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782481124.545141:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1869066301331328:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1782481124.545194:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1869066301331328:12345-0@lo:8:kworker.0 Request processed in 52us (5221us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782481124.545200:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782481124.545241:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782481124.545250:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b879a9000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782481124.545254:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782481124.545257:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301331328:0@lo:8:kworker.0 00010000:00010000:3.0:1782481124.546007:0:24992:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1782481124.546121:0:24992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1782481124.546171:0:24992:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782481124.546188:0:24992:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x65dae4c042ee465b 00000100:00080000:3.0:1782481124.546196:0:24992:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782481124.546202:0:24992:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f5b818e7800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1782481124.546238:0:24992:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5c90298a80 x1869066301331840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782481124.546262:0:24992:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1782481124.546409:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481124.546414:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782481124.546417:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782481124.546419:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1782481124.548020:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5b87a00a80 x1869066301331200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782481140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481124.548039:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301331200:0@lo:400:kworker.0 00000100:00100000:1.0:1782481124.549405:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1869066301331840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782481124.549486:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481124.549546:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301331840 00000100:00100000:1.0:1782481124.549553:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301331840 00000100:00100000:1.0:1782481124.549584:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782481124.549601:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1869066301331840:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782481124.549628:0:22660:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 741 last 0 00000020:00000080:1.0:1782481124.549668:0:22660:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x65dae4c042ee4662 00000004:00100000:1.0:1782481124.549683:0:22660:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782481124.549736:0:22660:0:(import.c:65:import_set_state_nolock()) ffff9f5ca5d29000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782481124.549795:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869066301331840:12345-0@lo:38:llog_process_th.0 Request processed in 203us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481124.549803:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782481124.549931:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f5c90298a80 x1869066301331840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782481134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481124.549941:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782481124.549948:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1782481124.549957:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782481124.549961:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1782481124.549964:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b818e7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782481124.549968:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1869066301331840:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1782481124.553132:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782481124.553142:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782481124.553146:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1782481124.554534:0:24992:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1782481124.556030:0:24979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1782481124.556070:0:24979:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782481124.556092:0:24979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb5200/0x65dae4c042ee4631 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4638 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.556105:0:24979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb5200/0x65dae4c042ee4631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4638 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782481124.556154:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782481124.556156:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782481124.556158:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481124.556159:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481124.556160:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481124.556162:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481124.556163:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782481124.556165:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481124.556166:0:24979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782481124.556170:0:24979:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1782481124.556173:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782481124.556174:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782481124.556175:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481124.556176:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481124.556177:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481124.556179:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481124.556180:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782481124.556184:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481124.556185:0:24979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782481124.556209:0:24979:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782481124.556230:0:24979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301331968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782481124.556296:0:24979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.556334:0:24979:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5ca12c5900 going to sleep for 11 seconds 00000100:00100000:3.0:1782481124.557360:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301331968 00000100:00100000:3.0:1782481124.557379:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301331968 00000100:00100000:3.0:1782481124.557434:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782481124.557444:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301331968:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782481124.557476:0:22654:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1782481124.557490:0:22654:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782481124.565729:0:22654:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782481124.565745:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1782481124.566027:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:24979:x1869066301331968:12345-0@lo:253:mount.lustre.0 Request processed in 8579us (9724us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.566041:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 20000000:01000000:2.0:1782481124.566120:0:22675:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782481124.566125:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782481124.566146:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.566161:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee45d6 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.566169:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee45e4 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.566176:0:22675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.566213:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee45e4 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.566227:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee45e4 expref: 23 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481124.566239:0:22675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301332096:0@lo:104: 00000100:00100000:2.0:1782481124.566274:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782481124.566324:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee45d6 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.566332:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee45d6 expref: 23 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481124.566353:0:22675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301332224:0@lo:104: 00000100:00100000:2.0:1782481124.566375:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.566395:0:22675:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5ca12c5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481124.566429:0:24979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:93f44a9c-11b5-4eed-b910-753bd776bd7b:24979:1869066301331968:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782481124.566440:0:24979:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782481124.566443:0:24979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782481124.566445:0:24979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782481124.566446:0:24979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481124.566447:0:24979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481124.566449:0:24979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481124.566450:0:24979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481124.566452:0:24979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782481124.566454:0:24979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481124.566455:0:24979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782481124.566469:0:24979:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1782481124.566893:0:22643:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301332096 00000100:00100000:3.0:1782481124.566900:0:22643:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301332096 00000100:00100000:3.0:1782481124.566931:0:22643:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301332224 00000100:00100000:3.0:1782481124.566934:0:22643:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301332224 00000100:00100000:3.0:1782481124.566950:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481124.566959:0:22643:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:22675:x1869066301332096:12345-0@lo:104: 00010000:00010000:3.0:1782481124.566973:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567026:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782481124.567032:0:22643:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:22675:x1869066301332096:12345-0@lo:104: Request processed in 74us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.567039:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481124.567053:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782481124.567060:0:22643:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:22675:x1869066301332224:12345-0@lo:104: 00010000:00010000:3.0:1782481124.567067:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567097:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782481124.567110:0:22643:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:22675:x1869066301332224:12345-0@lo:104: Request processed in 51us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.567115:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1782481124.567133:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481124.567139:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567147:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddea00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481124.567150:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567160:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481124.567167:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481124.567172:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782481124.567199:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567206:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481124.567225:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567233:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddea00/0x65dae4c042ee45e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee45eb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567246:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481124.567249:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567266:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddfc00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481124.567270:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567277:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481124.567284:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481124.567289:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782481124.567302:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567308:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481124.567323:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567329:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c8fddfc00/0x65dae4c042ee45d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee45dd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567342:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481124.567344:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481124.567346:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481124.567364:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301332480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481124.567394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481124.567433:0:22645:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301332480 00000100:00100000:3.0:1782481124.567437:0:22645:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301332480 00010000:00010000:3.0:1782481124.567454:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee45d6 expref: 24 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481124.567482:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481124.567489:0:22645:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301332480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481124.567499:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481124.567504:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee45d6 expref: 24 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567513:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee45d6 expref: 24 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481124.567526:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481124.567553:0:22645:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301332480:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481124.567560:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481124.567586:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301332480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782481124.567993:0:22675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301332096:0@lo:104: 00010000:00010000:2.0:1782481124.568004:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca6eb5c00/0x65dae4c042ee45dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee45d6 expref: 23 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481124.568015:0:22675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1869066301332224:0@lo:104: 00010000:00010000:2.0:1782481124.568031:0:22675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568048:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481124.568057:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c9029b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301332352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782481124.568083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481124.568119:0:22647:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301332352 00000100:00100000:2.0:1782481124.568122:0:22647:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301332352 00010000:00010000:2.0:1782481124.568136:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee45e4 expref: 23 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481124.568163:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782481124.568169:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:3650:x1869066301332352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782481124.568178:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481124.568182:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee45e4 expref: 23 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568191:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee45e4 expref: 23 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568201:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111d400/0x65dae4c042ee45eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee45e4 expref: 23 pid: 22654 timeout: 841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568211:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568219:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782481124.568231:0:22647:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.019779990s 00010000:00010000:2.0:1782481124.568235:0:22647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568242:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568248:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568254:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568265:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf600 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481124.568269:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568277:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568288:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568297:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481124.568323:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:3650:x1869066301332352:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481124.568331:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1782481124.568378:0:22675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568384:0:22675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481124.568390:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c8fddf600/0x65dae4c042ee4669 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481124.568412:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c9029b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301332352:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1782481124.574263:0:24979:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1782481124.577242:0:24979:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1782481124.577254:0:24979:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1782481124.577299:0:24979:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1782481124.577350:0:24979:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1782481124.577376:0:24979:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1782481124.577393:0:24979:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1782481124.578246:0:24979:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782481124.578474:0:24979:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782481124.764834:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481125.340742:0:23402:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90298e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1869066301332736:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1782481125.340836:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481125.340865:0:23402:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb65703c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481125.340884:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c90298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301332608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782481125.340909:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481125.340954:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301332608 00000100:00100000:3.0:1782481125.340962:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301332608 00000100:00100000:3.0:1782481125.341007:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782481125.341016:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869066301332608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782481125.341045:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782481125.341104:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869066301332608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481125.341113:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782481125.341152:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5c90298380 x1869066301332608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481125.341170:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301332608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782481125.341349:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782481125.341358:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301332864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782481125.341388:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481125.341415:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301332864 00000100:00100000:0.0:1782481125.341419:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301332864 00000100:00100000:0.0:1782481125.341448:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782481125.341455:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301332864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782481125.341480:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782481125.341515:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301332864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481125.341521:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782481125.341553:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301332864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782481125.342107:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301332736 00000100:00100000:1.0:1782481125.342113:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301332736 00000100:00100000:1.0:1782481125.342144:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481125.342151:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23402:x1869066301332736:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1782481125.342182:0:24166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:0.0:1782481125.342757:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301332992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782481125.342822:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481125.342981:0:23400:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301332992 00000100:00100000:1.0:1782481125.342987:0:23400:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301332992 00000100:00100000:1.0:1782481125.343021:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782481125.343028:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301332992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782481125.343051:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1782481125.343099:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301332992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481125.343119:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782481125.343189:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301332992:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1782481125.344387:0:24161:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1782481125.368123:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23402:x1869066301332736:12345-0@lo:5:osp-pre-0-1.0 Request processed in 25962us (27277us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1782481125.368140:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782481125.368482:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5c90298e00 x1869066301332736/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782481141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481125.368503:0:23402:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c90298e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1869066301332736:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1782481125.368518:0:23402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1782481125.368563:0:23402:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1869066301333120:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1782481125.368611:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481125.368652:0:23402:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c84b8c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782481125.372058:0:22671:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301333120 00000100:00100000:2.0:1782481125.372077:0:22671:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301333120 00000100:00100000:2.0:1782481125.372252:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782481125.372263:0:22671:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1869066301333120:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1782481125.372374:0:22671:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1869066301333120:12345-0@lo:900:osp-pre-0-1.0 Request processed in 113us (3762us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481125.372381:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782481125.372453:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb1ecf100 x1869066301333120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782481141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481125.372469:0:23402:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecf100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1869066301333120:0@lo:900:osp-pre-0-1.0 00000020:00000004:0.0:1782481125.578578:0:25047:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782481125.578852:0:25047:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1782481125.596159:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481105/real 1782481105] req@ffff9f5cb1dd9500 x1869066301320320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481125.596190:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5cb1dd9500 x1869066301320320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481125.596200:0:3646:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782481105/real 1782481105] req@ffff9f5cb1ddb100 x1869066301320448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481125.596212:0:3646:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f5cb1ddb100 x1869066301320448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782481125.596231:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb654b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481125.596252:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782481125.596256:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301320320:0@lo:8:kworker.0 00000100:00080000:3.0:1782481125.596261:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c9113a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1782481125.596265:0:3646:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1782481125.596268:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301320448:0@lo:8:kworker.0 00000100:00080000:0.0:1782481125.596384:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782481125.596388:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782481125.596391:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f5cb654b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782481125.596395:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 722 00000100:00080000:0.0:1782481125.596400:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782481125.596407:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f5cb654b000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1782481125.596424:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ecd500 x1869066301333504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782481125.596438:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782481125.596441:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782481125.596443:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f5c9113a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782481125.596447:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 722 00000100:00080000:0.0:1782481125.596449:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782481125.596452:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f5c9113a000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1782481125.596480:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb1ecf100 x1869066301333632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782481125.596519:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782481125.596522:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782481125.596524:0:38:0:(import.c:65:import_set_state_nolock()) ffff9f5b879a9000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782481125.596529:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f5b879a9000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1782481125.596540:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f5cb7a31f80 x1869066301334144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782481125.596588:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301333504:0@lo:8:kworker.0 00000100:00100000:0.0:1782481125.596665:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481125.596728:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301333632:0@lo:8:kworker.0 00000100:00100000:0.0:1782481125.596773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481125.596800:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301334144:0@lo:8:kworker.0 00000100:00100000:0.0:1782481125.596826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481125.596856:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301333760:0@lo:400:kworker.0 00000100:00100000:0.0:1782481125.596883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481125.596902:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301334400:0@lo:400:kworker.0 00000100:00100000:0.0:1782481125.596924:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481125.596941:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782481125.596947:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301333888:0@lo:400:kworker.0 00000100:00100000:0.0:1782481125.596969:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481125.596984:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1869066301334528:0@lo:400:kworker.0 00000100:00100000:0.0:1782481125.597006:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481125.597036:0:24746:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301333504 00000100:00100000:0.0:1782481125.597044:0:24746:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301333504 00000100:00100000:0.0:1782481125.597074:0:24746:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301333632 00000100:00100000:0.0:1782481125.597077:0:24746:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301333632 00000100:00100000:0.0:1782481125.597085:0:24746:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301334144 00000100:00100000:0.0:1782481125.597087:0:24746:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301334144 00000100:00100000:0.0:1782481125.597100:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782481125.597107:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1869066301333504:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782481125.597135:0:24746:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:0.0:1782481125.597175:0:24746:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x65dae4c042ee4670 00002000:00100000:0.0:1782481125.597189:0:24746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f5b88061000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211365f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1782481125.597193:0:24746:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1782481125.597201:0:24746:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782481125.597263:0:24746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782481125.597286:0:24746:0:(import.c:65:import_set_state_nolock()) ffff9f5b88066000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481125.597333:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1869066301333504:12345-0@lo:8:kworker.0 Request processed in 224us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481125.597339:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782481125.597355:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782481125.597359:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1869066301333632:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782481125.597374:0:24746:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:0.0:1782481125.597388:0:24746:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x65dae4c042ee4677 00002000:00100000:0.0:1782481125.597393:0:24746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f5b88067800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211365f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782481125.597396:0:24746:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1782481125.597398:0:24746:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782481125.597520:0:24746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782481125.597532:0:24746:0:(import.c:65:import_set_state_nolock()) ffff9f5b88060000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481125.597560:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1869066301333632:12345-0@lo:8:kworker.0 Request processed in 199us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481125.597566:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782481125.597579:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782481125.597583:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1869066301334144:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782481125.597597:0:24746:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 742 last 0 00000020:00000080:0.0:1782481125.597621:0:24746:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x65dae4c042ee467e 00002000:00100000:0.0:1782481125.597627:0:24746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f5cbdfaa800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211365f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1782481125.597630:0:24746:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1782481125.597632:0:24746:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782481125.597651:0:24746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1782481125.597666:0:24746:0:(import.c:65:import_set_state_nolock()) ffff9f5cbdfaa000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481125.597714:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1869066301334144:12345-0@lo:8:kworker.0 Request processed in 108us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481125.597721:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782481125.597746:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301333760 00000100:00100000:0.0:1782481125.597751:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301333760 00000100:00100000:0.0:1782481125.597777:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301334400 00000100:00100000:0.0:1782481125.597780:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301334400 00000100:00100000:0.0:1782481125.597806:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301334528 00000100:00100000:0.0:1782481125.597810:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301334528 00000100:00100000:0.0:1782481125.597824:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782481125.597830:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301333760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481125.597865:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869066301333760:12345-0@lo:400:kworker.0 Request processed in 35us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481125.597871:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782481125.597886:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782481125.597891:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869066301334400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481125.597918:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869066301334400:12345-0@lo:400:kworker.0 Request processed in 27us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481125.597924:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782481125.597936:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782481125.597942:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869066301334528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481125.597967:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869066301334528:12345-0@lo:400:kworker.0 Request processed in 26us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481125.597973:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782481125.597995:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301333888 00000100:00100000:0.0:1782481125.598000:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301333888 00000100:00100000:0.0:1782481125.598024:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782481125.598038:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301333888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481125.598067:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301333888:12345-0@lo:400:kworker.0 Request processed in 31us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481125.598072:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782481125.598120:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301333888:0@lo:400:kworker.0 00010000:00080000:0.0:1782481125.598132:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a32680 x1869066301334528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481125.598141:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1869066301334528:0@lo:400:kworker.0 00010000:00080000:0.0:1782481125.598152:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a30380 x1869066301333760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481125.598159:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869066301333760:0@lo:400:kworker.0 00010000:00080000:0.0:1782481125.598167:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a33100 x1869066301334400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481125.598174:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301334400:0@lo:400:kworker.0 00010000:00080000:0.0:1782481125.598211:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb1ecd500 x1869066301333504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782481150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481125.598218:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782481125.598223:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1782481125.598230:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782481125.598235:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1782481125.598237:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5cb654b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782481125.598247:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782481125.598252:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301333504:0@lo:8:kworker.0 00010000:00080000:0.0:1782481125.598272:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb1ecf100 x1869066301333632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782481150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481125.598278:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782481125.598282:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1782481125.598287:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782481125.598290:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782481125.598292:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5c9113a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782481125.598458:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301333248:0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.598494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481125.598525:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301334016:0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.598556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481125.598574:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1869066301334656:0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.598598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481125.598616:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782481125.598622:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301333376:0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.598642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481125.598656:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301334272:0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.598672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481125.598687:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301334784:0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.598728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481125.598755:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301333248 00000100:00100000:3.0:1782481125.598759:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301333248 00000100:00100000:3.0:1782481125.598786:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782481125.598802:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:3647:x1869066301333248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.598835:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf439450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:3647:x1869066301333248:12345-0@lo:400:kworker.0 Request processed in 42us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481125.598841:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782481125.598877:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301333248:0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.598895:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301334656 00000100:00100000:3.0:1782481125.598898:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301334656 00000100:00100000:3.0:1782481125.598924:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301334272 00000100:00100000:3.0:1782481125.598927:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301334272 00000100:00100000:3.0:1782481125.598937:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301334784 00000100:00100000:3.0:1782481125.598940:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301334784 00000100:00100000:3.0:1782481125.598954:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782481125.598959:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869066301334656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.599000:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869066301334656:12345-0@lo:400:kworker.0 Request processed in 40us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481125.599007:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782481125.599020:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782481125.599025:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301334272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.599050:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301334272:12345-0@lo:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481125.599056:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782481125.599067:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782481125.599072:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869066301334784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.599098:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869066301334784:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481125.599104:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1782481125.599129:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a31180 x1869066301334272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481125.599138:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301334272:0@lo:400:kworker.0 00010000:00080000:3.0:1782481125.599147:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a30a80 x1869066301334784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481125.599156:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301334784:0@lo:400:kworker.0 00010000:00080000:3.0:1782481125.599164:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a31880 x1869066301334656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481125.599172:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1869066301334656:0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.599194:0:24746:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301334016 00000100:00100000:3.0:1782481125.599201:0:24746:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301334016 00000100:00100000:3.0:1782481125.599227:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782481125.599234:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3647:x1869066301334016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481125.599266:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90298380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3647:x1869066301334016:12345-0@lo:400:kworker.0 Request processed in 33us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481125.599272:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782481125.599295:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a30700 x1869066301334016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481125.599304:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301334016:0@lo:400:kworker.0 00000004:00080000:1.0:1782481125.599746:0:22684:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:1.0:1782481125.599765:0:22684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22684:1869066301335040:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1782481125.599806:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481125.599823:0:22684:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8a68af00 going to sleep for 11 seconds 00000004:00080000:1.0:1782481125.599837:0:22683:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782481125.599912:0:22683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 742115218191ns, next at 0ns, rc = 0 00080000:00080000:1.0:1782481125.599919:0:22683:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1782481125.599945:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301333376 00000100:00100000:1.0:1782481125.599949:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301333376 00000100:00100000:1.0:1782481125.599976:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782481125.599982:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301333376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481125.600016:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301333376:12345-0@lo:400:kworker.0 Request processed in 35us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481125.600022:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782481125.600219:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301333376:0@lo:400:kworker.0 00000100:00100000:1.0:1782481125.600244:0:24167:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301335040 00000100:00100000:1.0:1782481125.600247:0:24167:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301335040 00000100:00100000:1.0:1782481125.600273:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782481125.600279:0:24167:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22684:x1869066301335040:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1782481125.600475:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782481125.600486:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301334912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782481125.600516:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481125.600547:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301334912 00000100:00100000:1.0:1782481125.600551:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301334912 00000100:00100000:1.0:1782481125.600576:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782481125.600582:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1869066301334912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782481125.600596:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782481125.600628:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1869066301334912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481125.600634:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782481125.600659:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b87a3aa00 x1869066301334912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481125.600673:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301334912:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1782481125.601160:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782481125.601171:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1869066301333632:0@lo:8:kworker.0 00010000:00080000:0.0:1782481125.601192:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a31f80 x1869066301334144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782481150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782481125.601204:0:3646:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1782481125.601211:0:3646:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782481125.601217:0:3646:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782481125.601220:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9f5b879a9000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782481125.601230:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782481125.601233:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1869066301334144:0@lo:8:kworker.0 00000100:00080000:0.0:1782481125.601262:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782481125.601267:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782481125.601269:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1782481125.601403:0:22686:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1782481125.601420:0:22686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22686:1869066301335296:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782481125.601454:0:22686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481125.601484:0:22686:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8344ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1782481125.601499:0:24746:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301335296 00000100:00100000:2.0:1782481125.601503:0:24746:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301335296 00000100:00100000:2.0:1782481125.601536:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782481125.601543:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22686:x1869066301335296:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1782481125.601728:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782481125.601865:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301335168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782481125.601893:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782481125.601987:0:22685:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782481125.602061:0:22685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 742117366619ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782481125.602067:0:22685:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1782481125.602082:0:23403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782481125.602119:0:23403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 742117425087ns, next at 0ns, rc = 0 00080000:00080000:3.0:1782481125.602123:0:23403:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1782481125.604660:0:23404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1782481125.604688:0:23404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1869066301335552:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1782481125.604769:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481125.604808:0:23404:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8a68a600 going to sleep for 11 seconds 00000100:00100000:1.0:1782481125.604826:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301335424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782481125.604850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481125.604887:0:24169:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301335168 00000100:00100000:1.0:1782481125.604894:0:24169:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301335168 00000100:00100000:1.0:1782481125.604924:0:24169:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301335424 00000100:00100000:1.0:1782481125.604927:0:24169:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301335424 00000100:00100000:1.0:1782481125.604954:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782481125.604962:0:24169:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1869066301335168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782481125.604996:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1782481125.605043:0:24169:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1869066301335168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481125.605050:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782481125.605067:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782481125.605073:0:24169:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869066301335424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782481125.605082:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1782481125.605107:0:24169:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1869066301335424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481125.605113:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782481125.605127:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782481125.605152:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b87a3aa00 x1869066301335424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481125.605170:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301335424:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1782481125.605204:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b87a00e00 x1869066301335168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782481141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481125.605216:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301335168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782481125.605233:0:24164:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1782481125.605240:0:24164:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1782481125.605331:0:24164:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301335552 00000100:00100000:1.0:1782481125.605334:0:24164:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301335552 00000100:00100000:1.0:1782481125.605408:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782481125.605415:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23404:x1869066301335552:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:0.0:1782481125.610168:0:24746:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1782481125.610179:0:24746:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1782481125.610186:0:24746:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:1.0:1782481125.613944:0:24167:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1782481125.613962:0:24167:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1782481125.613985:0:24167:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000004:00080000:3.0:1782481125.620073:0:22640:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1782481125.621599:0:22640:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1782481125.623102:0:25048:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1782481125.623109:0:25048:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1782481125.623209:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23404:x1869066301335552:12345-0@lo:7:osp-pre-1-1.0 Request processed in 17789us (18434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481125.623220:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1782481125.623560:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b87a3a300 x1869066301335552/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782481141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481125.623582:0:23404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1869066301335552:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1782481125.623596:0:23404:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1782481125.623639:0:23404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a33100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1869066301335680:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1782481125.623676:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1782481125.624080:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.624089:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624104:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.624108:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.624122:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624140:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624150:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624157:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624177:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782481125.624602:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.624609:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624618:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.624621:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.624625:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624635:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624643:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624662:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624675:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782481125.624686:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481125.624711:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624720:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5400 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:3.0:1782481125.624725:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624733:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624750:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624757:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee4685 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624786:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481125.624797:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624814:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:3.0:1782481125.624817:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624826:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624838:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624845:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003acd7a06/0x65dae4c042ee468c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.624859:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.624860:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.624862:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.625173:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.625179:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625187:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.625190:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.625194:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625204:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625219:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625226:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625239:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782481125.625247:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481125.625250:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625257:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5a00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:3.0:1782481125.625260:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625267:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625278:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625285:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b6f6e8f/0x65dae4c042ee4693 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.625298:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.625305:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.625306:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481125.625664:0:23404:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c84b8c180 going to sleep for 11 seconds 00000004:00080000:0.0:1782481125.625721:0:23392:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1782481125.627016:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.627024:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.627038:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.627041:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.627047:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.627061:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.627071:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.627079:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.627097:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782481125.627974:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.627982:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.627993:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.627997:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.628001:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.628011:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.628019:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.628027:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.628036:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782481125.628331:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481125.628338:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628347:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111d400 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:3.0:1782481125.628351:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628361:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628379:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628386:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041caae3f/0x65dae4c042ee469a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628404:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481125.628408:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628414:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111da00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:3.0:1782481125.628417:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628437:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628446:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628468:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072c4879e/0x65dae4c042ee46a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.628481:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.628482:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.628484:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.629985:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.629996:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630011:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.630015:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.630020:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630046:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630057:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630064:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630082:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.630095:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.630099:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630106:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111de00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.630110:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630118:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630130:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630137:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075599eac/0x65dae4c042ee46a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.630169:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.630171:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.630172:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.634159:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.634174:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634191:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.634195:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.634202:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634217:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634227:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634235:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634259:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.634275:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.634281:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634306:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111d000 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.634311:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634320:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634337:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634343:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057e03aa5/0x65dae4c042ee46af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.634359:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.634360:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.634362:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.637326:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.642312:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.642327:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.642357:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.642362:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.642369:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.642384:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.642395:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.642414:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.642460:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782481125.643039:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.643046:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643057:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.643060:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.643064:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643073:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643080:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643086:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643107:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1782481125.643718:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.643724:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643741:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.643744:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.643748:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643757:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643776:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643782:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.643799:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1782481125.644261:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.644267:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644277:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.644280:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.644284:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644294:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644312:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644320:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644329:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1782481125.644835:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.644842:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644851:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.644854:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.644858:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644867:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644875:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644881:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.644900:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1782481125.645160:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.645166:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.645174:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.645177:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.645181:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.645189:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.645196:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.645204:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.645213:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1782481125.645611:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1782481125.645619:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645640:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.645645:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645654:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645673:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645681:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef5561d/0x65dae4c042ee46b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645718:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1782481125.645723:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645729:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4a00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.645733:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645740:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645750:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645775:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d722d8f/0x65dae4c042ee46bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645801:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782481125.645805:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645812:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.645815:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645823:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645836:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645844:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee46c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645856:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782481125.645860:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645866:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5c00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.645876:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645884:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645894:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645901:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e475491/0x65dae4c042ee46cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645914:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782481125.645917:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645922:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79ab800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.645925:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645931:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645939:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645944:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3be8370/0x65dae4c042ee46d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645960:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.645963:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645968:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa600 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.645971:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645978:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645986:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.645992:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000433e028e/0x65dae4c042ee46d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.646001:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.646002:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.646004:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.646085:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.646092:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.646101:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.646111:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.646116:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.646126:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.646134:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.646142:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.646161:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782481125.646426:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.646432:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.646441:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.646443:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.646447:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.647703:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.647715:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.647734:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.647744:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1782481125.648686:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.648719:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.648733:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.648737:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.648744:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.648755:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481125.649125:0:24164:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301335680 00000100:00100000:1.0:1782481125.649135:0:24164:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301335680 00000100:00100000:1.0:1782481125.649193:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782481125.649204:0:24164:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23404:x1869066301335680:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1782481125.649240:0:24164:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1782481125.649318:0:24164:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23404:x1869066301335680:12345-0@lo:5:osp-pre-1-1.0 Request processed in 116us (25641us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481125.649325:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782481125.649373:0:23404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a33100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1869066301335680:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1782481125.649384:0:23404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1782481125.649424:0:23404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1869066301335808:0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1782481125.649610:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.649619:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.649631:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1782481125.649894:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782481125.649902:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.649912:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79ab000 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.649927:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.649937:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.649954:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.649962:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c74ab01d/0x65dae4c042ee46e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.649983:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782481125.649987:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.649993:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.649997:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.650004:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.650012:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.650018:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014ff7481/0x65dae4c042ee46e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.650037:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.650039:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.650045:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.650048:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.650055:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.650065:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.650072:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc3907c8/0x65dae4c042ee46ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.650082:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.650084:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.650085:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.650436:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.650443:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.650675:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.650679:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.650685:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.650759:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.650862:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.651276:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.651284:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481125.651391:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481125.651426:0:23404:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c8a68a240 going to sleep for 11 seconds 00010000:00010000:3.0:1782481125.651603:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782481125.651750:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301335808 00000100:00100000:3.0:1782481125.651758:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301335808 00000100:00100000:3.0:1782481125.651813:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782481125.651822:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23404:x1869066301335808:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1782481125.651862:0:25048:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1782481125.653727:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.653737:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.653752:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.653756:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.654262:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.654295:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.654305:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.654312:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782481125.654416:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782481125.654423:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.654432:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=742s v=(0 0) 00010000:00010000:1.0:1782481125.654436:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481125.654440:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.654463:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.654484:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.654492:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657124:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782481125.657136:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657149:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79abc00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.657160:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657172:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657192:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657200:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094634ebd/0x65dae4c042ee46f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657221:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782481125.657224:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657230:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80031c00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.657233:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657239:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657250:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657256:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.657265:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657271:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d75800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.657273:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657282:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657291:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.657298:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.657300:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.657301:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.659892:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782481125.659906:0:24167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee46fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.660317:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.660883:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.660890:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.660904:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.660913:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.660919:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.660934:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.660944:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.660952:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.660969:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.661216:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.661223:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661233:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aaa00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.661237:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661247:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661265:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661278:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a4f50af/0x65dae4c042ee470a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661293:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.661295:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.661296:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.661873:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.661880:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661890:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.661894:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.661898:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661908:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661916:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661923:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.661938:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782481125.662177:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481125.662183:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.662192:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80031000 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:3.0:1782481125.662196:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.662205:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.662216:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.662234:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd8190a6/0x65dae4c042ee4711 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.662249:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.662251:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.662252:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.663158:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.663166:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.663177:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.663180:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.663185:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.663196:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.663204:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.663211:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.663226:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.663377:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.663390:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.663398:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79abe00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.663402:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.663410:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.663422:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.663428:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000603767a1/0x65dae4c042ee4718 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.663443:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.663445:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.663447:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.665774:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782481125.665786:0:24746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000980ff44a/0x65dae4c042ee4703 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782481125.666343:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782481125.666350:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.666363:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=742s v=(0 0) 00010000:00010000:1.0:1782481125.666367:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481125.666373:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.666387:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.666397:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.666416:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.666430:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.666628:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.666636:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.666645:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d74800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.666649:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.666671:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.666688:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.666713:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fb60de5/0x65dae4c042ee471f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.666728:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.666729:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.666731:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.666736:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.666918:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.666925:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.666933:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.666936:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.666940:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.666950:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.666970:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.666978:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.666999:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.667051:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.667055:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.667062:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.667065:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.667072:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.667082:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.667094:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4726 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.667107:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.667108:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.667109:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.671026:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.671039:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.671057:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.671061:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.671067:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.671082:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.671091:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.671099:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.671130:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.671443:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.671463:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.671474:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fdde400 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.671478:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.671488:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.671505:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.671512:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee472d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.671528:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.671530:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.671531:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.672278:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.672286:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672298:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.672301:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.672306:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672317:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672326:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672332:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672349:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782481125.672770:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.672776:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672784:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.672787:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.672800:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672822:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672831:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672838:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672853:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782481125.672863:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782481125.672867:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672875:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030e00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.672878:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672886:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672899:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672907:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672930:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.672933:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672941:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.672944:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672952:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672961:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672967:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007be879d6/0x65dae4c042ee473b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.672978:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.672979:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.672981:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.673289:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.673296:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673305:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.673315:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.673319:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673330:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673338:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673345:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673358:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.673366:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.673370:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673377:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.673380:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673388:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673398:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673419:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4742 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.673433:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.673435:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.673436:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.673653:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481125.675346:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782481125.675357:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.675372:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=742s v=(0 0) 00010000:00010000:1.0:1782481125.675376:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481125.675382:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.675395:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.675405:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.675413:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.675432:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.676103:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.676111:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.676122:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d75c00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.676126:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.676135:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.676154:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.676161:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c36f778/0x65dae4c042ee4749 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.676180:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.676182:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.676183:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.676295:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.676303:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676314:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.676318:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.676322:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676333:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676342:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676349:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676365:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.676373:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.676377:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676384:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fdde600 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.676394:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676401:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676412:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676419:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee4750 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.676431:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.676432:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.676434:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481125.676686:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782481125.676718:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.676732:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=742s v=(0 0) 00010000:00010000:1.0:1782481125.676735:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481125.676739:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.676748:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.676756:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.676773:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.676785:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.676950:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.676955:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.676963:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d74600 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.676967:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.676975:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.676987:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.676993:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027833897/0x65dae4c042ee4757 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.677007:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.677009:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.677010:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.680279:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.680292:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.680310:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.680314:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.680320:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.680347:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.680358:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.680366:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.680388:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481125.684173:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481125.684188:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.684206:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80031c00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481125.684211:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.684224:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.684266:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.684272:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef3bdc6d/0x65dae4c042ee475e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.684289:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.684291:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.684293:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.685889:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.685909:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.685929:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.685933:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.685939:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.685954:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.685964:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.685970:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.685996:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481125.686255:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481125.686263:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.686272:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa000 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481125.686276:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.686285:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.686303:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.686311:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da4a2914/0x65dae4c042ee4765 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.686340:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.686342:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.686343:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.686449:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.686456:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.686464:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.686467:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.686472:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.686481:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.686495:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.686502:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.686546:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782481125.687061:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.687068:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687077:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.687080:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.687084:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687092:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687099:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687111:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687125:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782481125.687133:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782481125.687137:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687145:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79ab200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.687148:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687156:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687167:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687173:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948fb235/0x65dae4c042ee476c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687187:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.687190:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687206:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf400 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.687209:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687217:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687227:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687232:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee4773 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.687243:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.687244:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.687246:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.687374:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.690079:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.690093:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690109:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.690114:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.690119:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690134:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690161:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690169:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690190:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.690209:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.690214:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690221:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.690226:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690235:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690252:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690260:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee477a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.690278:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.690286:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.690288:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.690971:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.690980:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.690992:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.690996:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.691000:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.691011:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.691020:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.691028:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.691063:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782481125.691075:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481125.691080:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.691087:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79ab400 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:3.0:1782481125.691090:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.691099:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.691113:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.691121:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031d98b1f/0x65dae4c042ee4781 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.691136:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.691137:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.691139:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.691485:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.691492:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.691501:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.691504:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.691509:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.691518:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.691526:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.691533:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.691550:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782481125.692123:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.692130:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.692140:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.692142:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.692146:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.692164:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.692173:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.692180:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.692205:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782481125.692634:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782481125.692643:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692653:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddea00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481125.692658:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692672:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692745:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692754:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4788 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692772:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481125.692776:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692782:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fdde600 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481125.692806:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692822:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692836:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782481125.692837:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.692848:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692849:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d03f351/0x65dae4c042ee478f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.692871:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.692876:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481125.692877:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.692880:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.692882:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.692883:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.692895:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.692902:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.692920:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.692942:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481125.693029:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481125.693034:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.693042:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddfc00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481125.693045:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.693054:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.693065:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.693077:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4796 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.693091:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.693093:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.693095:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.694046:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.697877:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.697889:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.697906:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.697911:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.697918:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.697932:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.697942:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.697962:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.697983:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.697996:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.698003:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.698010:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.698015:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.698024:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.698041:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.698048:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf63dc55/0x65dae4c042ee479d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.698065:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.698066:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.698068:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.698997:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.699014:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.699027:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.699031:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.699035:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.699047:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.699056:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.699064:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.699079:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481125.699467:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481125.699475:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.699485:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481125.699490:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.699499:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.699514:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.699522:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007be879d6/0x65dae4c042ee47a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.699552:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.699554:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.699561:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.699751:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.699765:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.699776:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.699779:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.699783:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.699804:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.699812:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.699819:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.699980:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.699989:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.699993:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.700008:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf400 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.700011:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.700018:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.700029:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.700036:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055b243ce/0x65dae4c042ee47ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.700050:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.700052:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.700054:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.702902:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.702916:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.702934:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.702938:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.702945:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.702960:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.702985:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.702992:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703008:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782481125.703195:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.703201:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703209:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.703212:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.703216:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703225:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703232:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703239:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703261:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782481125.703271:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782481125.703276:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703283:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf600 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.703288:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703296:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703312:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703319:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000074fc6be/0x65dae4c042ee47b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703335:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.703338:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703343:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.703346:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703363:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703372:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703379:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b755aa7/0x65dae4c042ee47b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703389:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.703390:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.703392:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.703915:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.703922:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703931:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.703935:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.703939:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703948:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703956:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703970:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.703983:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.703991:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.703995:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.704002:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddfe00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.704006:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.704014:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.704025:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.704031:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a35f0c5/0x65dae4c042ee47c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.704045:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.704046:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.704048:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.704496:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.708205:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.708226:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708244:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.708249:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.708257:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708273:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708285:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708294:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708325:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782481125.708852:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.708859:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708870:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.708873:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.708877:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708887:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708903:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708912:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.708936:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782481125.709146:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782481125.709155:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.709166:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf800 already unused, calling callback (ffffffffc0ddece0) 00002000:00010000:2.0:1782481125.709404:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.709411:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.709419:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.709422:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.709426:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.709475:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.709485:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.709493:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.709513:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782481125.709520:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.709533:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.709554:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.709631:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee47c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.709884:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782481125.710042:0:25052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.710050:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.710059:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fdde400 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.710062:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.710082:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.710095:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.710102:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d21694/0x65dae4c042ee47ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.710169:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.710172:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.710174:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.710182:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.710189:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710198:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.710201:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.710205:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710215:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710224:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710231:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710247:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.710256:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.710260:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710267:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.710277:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710286:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710299:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710307:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003acd7a06/0x65dae4c042ee47dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710326:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.710328:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.710331:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.710515:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.710521:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710529:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.710532:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.710536:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710544:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710552:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710564:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710578:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.710586:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.710589:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710595:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5400 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.710598:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710605:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710616:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710622:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e675d178/0x65dae4c042ee47e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.710635:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.710637:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.710639:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.711675:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.711718:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711732:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.711736:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.711742:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711769:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711779:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711800:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711817:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.711826:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.711834:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711842:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5c00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.711848:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711857:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711878:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711885:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e475491/0x65dae4c042ee47ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.711902:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.711905:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.711907:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.712085:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.712091:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712100:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.712103:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.712107:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712117:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712125:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712131:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712156:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.712164:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.712168:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712175:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.712179:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712187:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712198:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712207:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d194aa38/0x65dae4c042ee47f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.712225:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.712226:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.712228:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.714753:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.714768:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.714771:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.716648:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.716660:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.716687:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.716722:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.716729:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.716744:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.716754:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.716772:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.716796:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.717451:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.717459:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.717468:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79ab400 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.717481:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.717491:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.717510:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.717519:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031d98b1f/0x65dae4c042ee47f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.717537:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.717539:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.717541:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.717656:0:24746:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.717661:0:24746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.717671:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.717683:0:24746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.717688:0:24746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.717718:0:24746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.717726:0:24746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.717739:0:24746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.717756:0:24746:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782481125.717973:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.717979:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.717986:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.717989:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.717993:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718001:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718009:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718023:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718038:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782481125.718047:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782481125.718051:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718057:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79ab600 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.718060:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718068:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718079:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718087:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.718090:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718095:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4a00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.718098:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718117:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718126:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718133:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d722d8f/0x65dae4c042ee4806 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.718149:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.718150:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.718151:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782481125.719064:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782481125.719073:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719085:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=742s v=(0 0) 00010000:00010000:2.0:1782481125.719088:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481125.719092:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719102:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719111:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719127:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719143:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.719153:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.719158:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719166:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.719170:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719180:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719196:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719203:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef5561d/0x65dae4c042ee480d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.719222:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.719225:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.719227:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.719452:0:24746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6e1402e/0x65dae4c042ee47ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.719475:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1782481125.719515:0:24746:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1782481125.719612:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22686:x1869066301335296:12345-0@lo:5:osp-pre-1-0.0 Request processed in 118066us (118154us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481125.719622:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782481125.720186:0:22686:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22686:1869066301335296:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1782481125.720214:0:22686:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1782481125.720259:0:22686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22686:1869066301335936:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782481125.720297:0:22686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481125.720321:0:22686:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87f5b780 going to sleep for 11 seconds 00000100:00100000:2.0:1782481125.720339:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301335936 00000100:00100000:2.0:1782481125.720344:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301335936 00000100:00100000:2.0:1782481125.720379:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782481125.720387:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22686:x1869066301335936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1782481125.720423:0:24166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00002000:00010000:3.0:1782481125.720616:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.720623:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.720636:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.720640:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.720645:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.720657:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.720666:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.720712:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.720728:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.721038:0:22649:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.721044:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.721052:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aba00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.721056:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.721065:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.721081:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.721088:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a5f9d49/0x65dae4c042ee4814 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.721115:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.721117:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.721119:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481125.724602:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782481125.724616:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.724633:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=742s v=(0 0) 00010000:00010000:3.0:1782481125.724637:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481125.724643:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.724659:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.724669:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.724677:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481125.724724:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481125.724746:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481125.724764:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.724775:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aae00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481125.724779:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.724813:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.724831:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.724840:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056d808e5/0x65dae4c042ee481b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.724860:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.724862:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.724864:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.725870:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.725873:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481125.725881:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.732640:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.732654:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.732670:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.732674:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.732681:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.732710:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.732721:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.732739:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.732756:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481125.732991:0:25052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733001:0:25052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5a00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.733005:0:25052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733015:0:25052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733033:0:25052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733039:0:25052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b6f6e8f/0x65dae4c042ee47d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733064:0:25052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481125.733068:0:25052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733074:0:25052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030800 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481125.733083:0:25052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733091:0:25052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733103:0:25052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733109:0:25052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf63dc55/0x65dae4c042ee4822 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.733123:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.733125:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481125.733127:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.734356:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.734515:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.734524:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.734539:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.734542:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.734547:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.734559:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.734568:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.734585:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.734615:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.735283:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.735291:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.735302:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030e00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.735307:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.735317:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.735334:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.735343:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef515d0/0x65dae4c042ee4829 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.735366:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.735368:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.735370:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481125.738719:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782481125.738734:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.738753:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.738757:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.738764:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.738779:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.738800:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.738809:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.738834:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481125.739074:0:25053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481125.739081:0:25053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.739097:0:25053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80031e00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481125.739100:0:25053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.739109:0:25053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.739126:0:25053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.739134:0:25053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bb6105d/0x65dae4c042ee4830 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481125.739151:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.739153:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481125.739155:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782481125.739568:0:24980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1782481125.739619:0:24980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00002000:00010000:0.0:1782481125.739622:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000001:00100000:1.0:1782481125.739627:0:24980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1782481125.739631:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.739650:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=742s v=(0 0) 00010000:00010000:0.0:1782481125.739654:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481125.739658:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.739670:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.739679:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.739687:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481125.739804:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782481125.739888:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23404:x1869066301335808:12345-0@lo:5:osp-pre-1-1.0 Request processed in 88061us (90429us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1782481125.739900:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782481125.741845:0:23404:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1782481125.741860:0:23404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1869066301335808:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1782481125.741879:0:23404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1782481125.741937:0:23404:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a01f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1869066301336064:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1782481125.741998:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481125.742031:0:23404:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87f5b900 going to sleep for 11 seconds 00000100:00100000:2.0:1782481125.742067:0:22670:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301336064 00000100:00100000:2.0:1782481125.742073:0:22670:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301336064 00000100:00100000:2.0:1782481125.742134:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782481125.742145:0:22670:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1869066301336064:12345-0@lo:900:osp-pre-1-1.0 00000001:00080000:1.0:1782481125.742174:0:24980:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1782481125.742207:0:25052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782481125.742210:0:22670:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1869066301336064:12345-0@lo:900:osp-pre-1-1.0 Request processed in 66us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1782481125.742215:0:25052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481125.742220:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1782481125.742232:0:25052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80031200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:1.0:1782481125.742238:0:25052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1782481125.742258:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b87a01f80 x1869066301336064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1782481141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1782481125.742258:0:25052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481125.742283:0:23404:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a01f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1869066301336064:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1782481125.742293:0:25052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.742303:0:25052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000114ef993/0x65dae4c042ee4837 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481125.742329:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.742332:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481125.742335:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481125.742391:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22686:x1869066301335936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 22004us (22093us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1782481125.742399:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782481125.742426:0:22686:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1782481125.742432:0:22686:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22686:1869066301335936:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1782481125.742440:0:22686:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00002000:00080000:0.0:1782481125.747190:0:24167:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1782481125.747292:0:24167:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22684:x1869066301335040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 147007us (147479us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481125.747303:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782481125.754510:0:22684:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22684:1869066301335040:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1782481125.754528:0:22684:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1782481125.754582:0:22684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22684:1869066301336192:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1782481125.754642:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481125.754673:0:22684:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb8c60a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782481125.757689:0:24746:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301336192 00000100:00100000:3.0:1782481125.757869:0:24746:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301336192 00000100:00100000:3.0:1782481125.757938:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782481125.757949:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22684:x1869066301336192:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1782481125.757992:0:24746:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:3.0:1782481125.762958:0:24161:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1782481125.762998:0:24161:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1782481125.763003:0:24161:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000100:00100000:1.0:1782481125.780568:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22684:x1869066301336192:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22612us (25916us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1782481125.780582:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782481125.780748:0:22684:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1782481125.780757:0:22684:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22684:1869066301336192:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1782481125.780773:0:22684:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1782481125.795178:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782481126.236385:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782481126.236393:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f5b85b56800 from 14 10000000:01000000:3.0:1782481126.236399:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782481126.236453:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab600/0x65dae4c042ee483e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481126.236465:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab600/0x65dae4c042ee483e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481126.236662:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab600/0x65dae4c042ee483e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481126.236711:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301336320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782481126.236792:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481126.236833:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1782481126.239872:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301336320 00000100:00100000:0.0:1782481126.239887:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301336320 00000100:00100000:0.0:1782481126.239957:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782481126.239988:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:22656:x1869066301336320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481126.240007:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481126.240027:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c80031400/0x65dae4c042ee4845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee483e expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481126.240055:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c80031400/0x65dae4c042ee4845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee483e expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481126.240067:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c80031400/0x65dae4c042ee4845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee483e expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481126.240077:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c80031400, rc 0) 00000100:00100000:0.0:1782481126.240158:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301336320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (3365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481126.240166:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782481126.240195:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301336320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481126.240213:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab600/0x65dae4c042ee483e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4845 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481126.240222:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab600/0x65dae4c042ee483e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4845 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481126.240294:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301336448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782481126.240335:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481126.240385:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1782481126.241196:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301336448 00000100:00100000:0.0:1782481126.241204:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301336448 00000100:00100000:0.0:1782481126.241246:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1782481126.241255:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301336448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782481126.241272:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782481126.241291:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782481126.241294:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1782481126.241388:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301336448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481126.241396:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782481126.241439:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301336448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782481126.241514:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782481126.241523:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab600/0x65dae4c042ee483e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4845 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481126.241532:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab600/0x65dae4c042ee483e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4845 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481126.241541:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782481126.241544:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9f5cb59c2800 from 14 10000000:01000000:3.0:1782481126.241546:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782481126.241577:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aac00/0x65dae4c042ee484c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481126.241585:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aac00/0x65dae4c042ee484c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481126.241593:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aac00/0x65dae4c042ee484c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481126.241607:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301336576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782481126.241633:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481126.241663:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1782481126.242261:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301336576 00000100:00100000:0.0:1782481126.242266:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301336576 00000100:00100000:0.0:1782481126.242302:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782481126.242311:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301336576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481126.242325:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481126.242336:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c80031600/0x65dae4c042ee4853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee484c expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481126.242356:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c80031600/0x65dae4c042ee4853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee484c expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481126.242365:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c80031600/0x65dae4c042ee4853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee484c expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481126.242374:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c80031600, rc 0) 00000100:00100000:0.0:1782481126.242416:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf43b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:22656:x1869066301336576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481126.242422:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782481126.242434:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301336576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481126.242453:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aac00/0x65dae4c042ee484c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4853 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481126.242463:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aac00/0x65dae4c042ee484c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4853 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481126.242515:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301336704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782481126.242547:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481126.242583:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb1d9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1782481126.242761:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301336704 00000100:00100000:0.0:1782481126.242766:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301336704 00000100:00100000:0.0:1782481126.242804:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782481126.242812:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cbf439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:22656:x1869066301336704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782481126.242823:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782481126.242836:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782481126.242839:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1782481126.242924:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cbf439050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:22656:x1869066301336704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481126.242931:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782481126.242942:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c9029a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301336704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782481126.242991:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782481126.242998:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aac00/0x65dae4c042ee484c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4853 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481126.243006:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aac00/0x65dae4c042ee484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4853 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782481126.507919:0:23418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782481126.812356:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481127.836047:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481128.864821:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481129.885319:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481130.460646:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301336832:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782481130.460744:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481130.460860:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782481130.460874:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301336960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782481130.460903:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481130.461390:0:23400:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301336960 00000100:00100000:0.0:1782481130.461398:0:23400:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301336960 00000100:00100000:0.0:1782481130.461442:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782481130.461451:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301336960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782481130.461494:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1782481130.461537:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301336960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.461544:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782481130.461587:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301336960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782481130.461970:0:24169:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301336832 00000100:00100000:3.0:1782481130.461975:0:24169:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301336832 00000100:00100000:3.0:1782481130.462009:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782481130.462015:0:24169:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301336832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782481130.462033:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782481130.462084:0:24169:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301336832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481130.462090:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1782481130.462116:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782481130.462424:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301337088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782481130.462452:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481130.462480:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301337088 00000100:00100000:0.0:1782481130.462483:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301337088 00000100:00100000:0.0:1782481130.462503:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782481130.462509:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301337088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782481130.462527:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782481130.462555:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301337088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.462560:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782481130.462585:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301337088:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782481130.462733:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1782481130.462748:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301336832:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782481130.921898:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481130.978788:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301337216:0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.978854:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.987569:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301337600:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.987646:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481130.991210:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869066301337728:0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.991288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481130.991332:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301338240:0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.991353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481130.991374:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301338752:0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.991397:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481130.991437:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301337728 00000100:00100000:0.0:1782481130.991444:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301337728 00000100:00100000:0.0:1782481130.991489:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301338240 00000100:00100000:0.0:1782481130.991492:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301338240 00000100:00100000:0.0:1782481130.991504:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301338752 00000100:00100000:0.0:1782481130.991506:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301338752 00000100:00100000:0.0:1782481130.991532:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782481130.991539:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869066301337728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.991588:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869066301337728:12345-0@lo:400:kworker.0 Request processed in 49us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.991596:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782481130.991611:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782481130.991617:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301338240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.991640:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301338240:12345-0@lo:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.991645:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782481130.991655:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782481130.991661:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869066301338752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.991711:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869066301338752:12345-0@lo:400:kworker.0 Request processed in 24us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.991718:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782481130.991736:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301337216 00000100:00100000:0.0:1782481130.991739:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301337216 00000100:00100000:0.0:1782481130.991761:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782481130.991767:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301337216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.991793:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301337216:12345-0@lo:400:kworker.0 Request processed in 27us (12940us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.991808:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:0.0:1782481130.991877:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b882a9880 x1869066301338752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481130.991891:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301338752:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.992157:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301338112:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.992194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.992220:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1869066301338624:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.992243:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.992266:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301339136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782481130.992287:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.992303:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1782481130.992310:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301337472:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.992330:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.992347:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301337984:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.992365:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.992381:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1869066301338496:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.992401:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.992414:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301339008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782481130.992432:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.992468:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301337344:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993246:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.993272:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301337856:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.993311:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1869066301338368:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993330:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.993339:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301338880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782481130.993355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481130.993386:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301337600 00000100:00100000:1.0:1782481130.993391:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301337600 00000100:00100000:1.0:1782481130.993432:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301338112 00000100:00100000:1.0:1782481130.993434:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301338112 00000100:00100000:1.0:1782481130.993446:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301337472 00000100:00100000:1.0:1782481130.993448:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301337472 00000100:00100000:1.0:1782481130.993459:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301337984 00000100:00100000:1.0:1782481130.993462:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301337984 00000100:00100000:1.0:1782481130.993474:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782481130.993479:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301337600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993525:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301337600:12345-0@lo:400:kworker.0 Request processed in 44us (5879us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481130.993531:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782481130.993546:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782481130.993553:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301338112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993577:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301338112:12345-0@lo:400:kworker.0 Request processed in 25us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481130.993584:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782481130.993594:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782481130.993599:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301337472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993620:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301337472:12345-0@lo:400:kworker.0 Request processed in 22us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481130.993626:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782481130.993635:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481130.993640:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301337984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993661:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301337984:12345-0@lo:400:kworker.0 Request processed in 21us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481130.993666:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481130.993732:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301337472:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993749:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301337984:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993759:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301337600:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993767:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301338112:0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993816:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301338624 00000100:00100000:1.0:1782481130.993820:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301338624 00000100:00100000:1.0:1782481130.993838:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301338496 00000100:00100000:1.0:1782481130.993841:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301338496 00000100:00100000:1.0:1782481130.993850:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301338368 00000100:00100000:1.0:1782481130.993852:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301338368 00000100:00100000:1.0:1782481130.993862:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782481130.993868:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869066301338624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481130.993899:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869066301338624:12345-0@lo:400:kworker.0 Request processed in 31us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481130.993905:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782481130.994745:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301337216:0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.994772:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782481130.994788:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869066301338496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.994842:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869066301338496:12345-0@lo:400:kworker.0 Request processed in 62us (2439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.994847:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782481130.994866:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782481130.994872:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869066301338368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.994923:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869066301338368:12345-0@lo:400:kworker.0 Request processed in 38us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.994929:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782481130.994950:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301337344 00000100:00100000:0.0:1782481130.994957:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301337344 00000100:00100000:0.0:1782481130.994985:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301337856 00000100:00100000:0.0:1782481130.994988:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301337856 00000100:00100000:0.0:1782481130.995004:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782481130.995010:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301337344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.995043:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301337344:12345-0@lo:400:kworker.0 Request processed in 34us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.995049:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782481130.995264:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782481130.995271:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301337856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.995301:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301337856:12345-0@lo:400:kworker.0 Request processed in 32us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481130.995308:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782481130.995347:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301337344:0@lo:400:kworker.0 00000100:00100000:0.0:1782481130.995359:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301337856:0@lo:400:kworker.0 00010000:00080000:0.0:1782481130.995371:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b882ab800 x1869066301338368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481130.995382:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1869066301338368:0@lo:400:kworker.0 00010000:00080000:0.0:1782481130.995419:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5cb7a30700 x1869066301337728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481130.995429:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869066301337728:0@lo:400:kworker.0 00010000:00080000:0.0:1782481130.995442:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b882a9f80 x1869066301338240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481130.995451:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301338240:0@lo:400:kworker.0 00010000:00080000:1.0:1782481130.995990:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b882aaa00 x1869066301338496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481130.996002:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1869066301338496:0@lo:400:kworker.0 00010000:00080000:1.0:1782481130.996014:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b882aa300 x1869066301338624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481130.996229:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1869066301338624:0@lo:400:kworker.0 00000100:00080000:0.0:1782481130.998231:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782481130.998241:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782481130.998245:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782481130.998247:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782481130.998840:0:24169:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301339136 00000100:00100000:3.0:1782481130.998851:0:24169:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301339136 00000100:00100000:3.0:1782481130.998889:0:24169:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301339008 00000100:00100000:3.0:1782481130.998892:0:24169:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301339008 00000100:00100000:3.0:1782481130.998902:0:24169:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301338880 00000100:00100000:3.0:1782481130.998905:0:24169:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301338880 00000100:00100000:3.0:1782481130.998919:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782481130.998927:0:24169:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301339136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782481130.998952:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782481130.999040:0:24169:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301339136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (6750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481130.999046:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782481130.999148:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481130.999155:0:24169:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301339008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782481130.999173:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1782481130.999201:0:24169:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301339008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (6767us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481130.999207:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481130.999217:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782481130.999223:0:24169:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301338880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782481130.999232:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1782481130.999261:0:24169:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301338880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481130.999266:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782481130.999336:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301338880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782481131.002723:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301339008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782481131.002747:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301339136:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1782481131.592089:0:25340:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782481131.934153:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782481132.448010:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1782481132.655137:0:25392:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782481132.655373:0:25392:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1782481132.957751:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782481133.723154:0:25443:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782481133.723378:0:25443:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1782481133.978514:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481133.978584:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281306752 00000100:00100000:1.0:1782481133.978604:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281306752 00000100:00100000:1.0:1782481133.978664:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 115 00000100:00100000:1.0:1782481133.978673:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1869066281306752:12345-192.168.204.11@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782481133.978727:0:22653:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7f2c34bb-9817-469e-8b47-2ebfb872a531@192.168.204.11@tcp t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:1.0:1782481133.978963:0:22653:0:(genops.c:1406:class_connect()) connect: client 7f2c34bb-9817-469e-8b47-2ebfb872a531, cookie 0x65dae4c042ee485a 00000100:00080000:1.0:1782481133.979098:0:22653:0:(import.c:65:import_set_state_nolock()) ffff9f5b87a83000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782481133.979175:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+5:2403:x1869066281306752:12345-192.168.204.11@tcp:250:mount.lustre.0 Request processed in 501us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481133.979183:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 115 00010000:00010000:0.0:1782481133.980233:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481133.998405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481133.998529:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281306880 00000100:00100000:3.0:1782481133.998539:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281306880 00000100:00100000:3.0:1782481133.998585:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00100000:3.0:1782481133.998595:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+5:18117:x1869066281306880:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782481133.998620:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481133.998653:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5cb79aba00/0x65dae4c042ee4861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x33577da1469df62d expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481133.998683:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5cb79aba00/0x65dae4c042ee4861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df62d expref: 6 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481133.998727:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5cb79aba00/0x65dae4c042ee4861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df62d expref: 6 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481133.998738:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79aba00, rc 0) 00000100:00100000:3.0:1782481133.998792:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+6:18117:x1869066281306880:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 198us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481133.998800:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00100000:2.0:1782481134.007197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481134.007681:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281307008 00000100:00100000:1.0:1782481134.007732:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281307008 00000100:00100000:1.0:1782481134.007802:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 117 00000100:00100000:1.0:1782481134.007813:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+6:18117:x1869066281307008:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782481134.007956:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+6:18117:x1869066281307008:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 144us (768us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782481134.007965:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 117 00000100:00100000:1.0:1782481134.010185:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481134.010254:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281307136 00000100:00100000:0.0:1782481134.010262:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281307136 00000100:00100000:0.0:1782481134.010313:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 118 00000100:00100000:0.0:1782481134.010322:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+6:18117:x1869066281307136:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782481134.010339:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481134.010356:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c80030000/0x65dae4c042ee4868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x33577da1469df634 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481134.010382:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c80030000/0x65dae4c042ee4868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df634 expref: 7 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481134.010393:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c80030000/0x65dae4c042ee4868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df634 expref: 7 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481134.010402:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c80030000, rc 0) 00000100:00100000:0.0:1782481134.010461:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+7:18117:x1869066281307136:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 140us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481134.010468:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 118 00000100:00100000:3.0:1782481134.016504:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481134.016664:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281307264 00000100:00100000:0.0:1782481134.016675:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281307264 00000100:00100000:0.0:1782481134.017305:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 119 00000100:00100000:0.0:1782481134.017325:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+7:18117:x1869066281307264:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782481134.017495:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18117:x1869066281307264:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 176us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481134.017504:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 119 00000100:00100000:3.0:1782481134.020293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481134.021451:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281307392 00000100:00100000:2.0:1782481134.021474:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281307392 00000100:00100000:2.0:1782481134.021516:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 120 00000100:00100000:2.0:1782481134.021524:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18117:x1869066281307392:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782481134.021738:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18117:x1869066281307392:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 213us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481134.021746:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 120 00000100:00100000:3.0:1782481134.026886:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481134.027670:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281307520 00000100:00100000:2.0:1782481134.027681:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281307520 00000100:00100000:2.0:1782481134.027791:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:2.0:1782481134.027803:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18136:x1869066281307520:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782481134.028264:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18136:x1869066281307520:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 461us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481134.028273:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:3.0:1782481134.061346:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481134.061439:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281307648 00000100:00100000:0.0:1782481134.061448:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281307648 00000100:00100000:0.0:1782481134.061501:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 122 00000100:00100000:0.0:1782481134.061510:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18136:x1869066281307648:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782481134.061675:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18136:x1869066281307648:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 166us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481134.061683:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 122 00000100:00100000:2.0:1782481134.075620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481134.075959:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281307776 00000100:00100000:1.0:1782481134.075969:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281307776 00000100:00100000:1.0:1782481134.076022:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 123 00000100:00100000:1.0:1782481134.076031:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18136:x1869066281307776:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782481134.076171:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18136:x1869066281307776:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 140us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481134.076179:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 123 00000100:00100000:1.0:1782481134.089861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481134.090677:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281307904 00000100:00100000:3.0:1782481134.090689:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281307904 00000100:00100000:3.0:1782481134.093825:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 124 00000100:00100000:3.0:1782481134.093837:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+8:18117:x1869066281307904:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782481134.093856:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481134.093875:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5cb79aa400/0x65dae4c042ee486f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33577da1469df665 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481134.093904:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5cb79aa400/0x65dae4c042ee486f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df665 expref: 9 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481134.093915:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5cb79aa400/0x65dae4c042ee486f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df665 expref: 9 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481134.093924:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79aa400, rc 0) 00000100:00100000:3.0:1782481134.094038:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+9:18117:x1869066281307904:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 202us (4187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481134.094045:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 124 00000100:00100000:3.0:1782481134.098907:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481134.099069:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281308032 00000100:00100000:0.0:1782481134.099079:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281308032 00000100:00100000:0.0:1782481134.099134:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 125 00000100:00100000:0.0:1782481134.099143:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+9:18117:x1869066281308032:12345-192.168.204.11@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782481134.099166:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782481134.099189:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782481134.099192:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782481134.099195:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782481134.099198:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1782481134.099199:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1782481134.102187:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+9:18117:x1869066281308032:12345-192.168.204.11@tcp:256:mount.lustre.0 Request processed in 3033us (3277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481134.102202:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 125 00000100:00100000:1.0:1782481134.105753:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481134.106056:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281308160 00000100:00100000:0.0:1782481134.106067:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281308160 00000100:00100000:0.0:1782481134.106124:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00100000:0.0:1782481134.106135:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+9:18117:x1869066281308160:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782481134.106151:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481134.106168:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33577da1469df66c expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481134.106214:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df66c expref: 10 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481134.106225:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df66c expref: 10 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481134.106234:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c80030c00, rc 0) 00000100:00100000:0.0:1782481134.106293:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18117:x1869066281308160:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 160us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481134.106301:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00100000:3.0:1782481134.111388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481134.111521:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281308288 00000100:00100000:0.0:1782481134.111531:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281308288 00000100:00100000:0.0:1782481134.111603:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 127 00000100:00100000:0.0:1782481134.111614:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb5b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18117:x1869066281308288:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782481134.112064:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb5b09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18117:x1869066281308288:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 451us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481134.112072:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 127 00000100:00100000:2.0:1782481134.115998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481134.116099:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281308416 00000100:00100000:3.0:1782481134.116109:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281308416 00000100:00100000:3.0:1782481134.116217:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 128 00000100:00100000:3.0:1782481134.116231:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18117:x1869066281308416:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782481134.116392:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83479850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18117:x1869066281308416:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 164us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481134.116410:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 128 00000100:00100000:3.0:1782481134.120838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481134.121854:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281308544 00000100:00100000:1.0:1782481134.121867:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281308544 00000100:00100000:1.0:1782481134.121973:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 129 00000100:00100000:1.0:1782481134.121983:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18142:x1869066281308544:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782481134.122143:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18142:x1869066281308544:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 160us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481134.122151:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 129 00000100:00100000:2.0:1782481134.133194:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481134.135554:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281308672 00000100:00100000:3.0:1782481134.135566:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281308672 00000100:00100000:3.0:1782481134.135644:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 130 00000100:00100000:3.0:1782481134.135655:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18142:x1869066281308672:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782481134.136073:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18142:x1869066281308672:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 418us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481134.136082:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 130 00000100:00100000:2.0:1782481134.147277:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481134.147333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481134.147614:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281308800 00000100:00100000:1.0:1782481134.147633:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281308800 00000100:00100000:1.0:1782481134.147686:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281309056 00000100:00100000:1.0:1782481134.147689:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281309056 00000100:00100000:1.0:1782481134.147753:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1782481134.147762:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1869066281308800:12345-192.168.204.11@tcp:38:mount.lustre.0 00000100:00100000:3.0:1782481134.147929:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1782481134.147936:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1869066281309056:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782481134.148019:0:24474:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from df8b7b41-b102-4c0b-b8a2-94babd71285c@192.168.204.11@tcp t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:1.0:1782481134.148072:0:24474:0:(genops.c:1406:class_connect()) connect: client df8b7b41-b102-4c0b-b8a2-94babd71285c, cookie 0x65dae4c042ee487d 00000004:00100000:1.0:1782481134.148097:0:24474:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782481134.148289:0:24474:0:(import.c:65:import_set_state_nolock()) ffff9f5ca5d2b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782481134.148375:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:2403:x1869066281308800:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 612us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481134.148383:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00010000:00080000:0.0:1782481134.153722:0:22661:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from df8b7b41-b102-4c0b-b8a2-94babd71285c@192.168.204.11@tcp t0 exp 0000000000000000 cur 750 last 0 00000100:00100000:1.0:1782481134.154022:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481134.154062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481134.154146:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281308928 00000100:00100000:2.0:1782481134.154155:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281308928 00000100:00100000:2.0:1782481134.154224:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281309312 00000100:00100000:2.0:1782481134.154227:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281309312 00000100:00100000:2.0:1782481134.154246:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:2.0:1782481134.154255:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:0:x1869066281308928:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782481134.154286:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782481134.154378:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:0:x1869066281308928:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481134.154386:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:3.0:1782481134.154396:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:3.0:1782481134.154405:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18117:x1869066281309312:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782481134.154418:0:24474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1782481134.154445:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18117:x1869066281309312:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 43us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481134.154450:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00080000:1.0:1782481134.154611:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1782481134.155204:0:22661:0:(genops.c:1406:class_connect()) connect: client df8b7b41-b102-4c0b-b8a2-94babd71285c, cookie 0x65dae4c042ee4884 00000004:00100000:0.0:1782481134.155231:0:22661:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1782481134.155435:0:22661:0:(import.c:65:import_set_state_nolock()) ffff9f5cbdfa9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481134.155488:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:2403:x1869066281309056:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 7551us (8154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481134.155496:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:1.0:1782481134.161863:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481134.162069:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281309440 00000100:00100000:2.0:1782481134.162091:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281309440 00000100:00100000:2.0:1782481134.162155:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1782481134.162165:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18117:x1869066281309440:12345-192.168.204.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782481134.162254:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18117:x1869066281309440:12345-192.168.204.11@tcp:40:mount.lustre.0 Request processed in 90us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481134.162262:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:3.0:1782481134.166920:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481134.167019:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281309184 00000100:00100000:1.0:1782481134.167029:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281309184 00000100:00100000:1.0:1782481134.167111:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:1.0:1782481134.167121:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:0:x1869066281309184:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782481134.167156:0:24474:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782481134.167227:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:0:x1869066281309184:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 108us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481134.167234:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00080000:0.0:1782481134.168733:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782481134.168931:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481134.168975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481134.169048:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281309568 00000100:00100000:0.0:1782481134.169056:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281309568 00000100:00100000:0.0:1782481134.169097:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:0.0:1782481134.169105:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2403:x1869066281309568:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782481134.169135:0:25048:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from df8b7b41-b102-4c0b-b8a2-94babd71285c@192.168.204.11@tcp t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:0.0:1782481134.169165:0:25048:0:(genops.c:1406:class_connect()) connect: client df8b7b41-b102-4c0b-b8a2-94babd71285c, cookie 0x65dae4c042ee488b 00002000:00100000:0.0:1782481134.169176:0:25048:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli df8b7b41-b102-4c0b-b8a2-94babd71285c/ffff9f5cbdfac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782481134.169193:0:25048:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782481134.169377:0:25048:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782481134.169405:0:25048:0:(import.c:65:import_set_state_nolock()) ffff9f5cbdfad000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481134.169465:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:2403:x1869066281309568:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 359us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481134.169472:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:3.0:1782481134.170964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481134.171107:0:22670:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281309824 00000100:00100000:1.0:1782481134.171115:0:22670:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281309824 00000100:00100000:2.0:1782481134.171120:0:24164:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281309696 00000100:00100000:2.0:1782481134.171127:0:24164:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281309696 00000100:00100000:1.0:1782481134.171161:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:1.0:1782481134.171172:0:22670:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18117:x1869066281309824:12345-192.168.204.11@tcp:900:mount.lustre.0 00000100:00100000:2.0:1782481134.171214:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:2.0:1782481134.171221:0:24164:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1869066281309696:12345-192.168.204.11@tcp:8:mount.lustre.0 00000100:00100000:1.0:1782481134.171240:0:22670:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18117:x1869066281309824:12345-192.168.204.11@tcp:900:mount.lustre.0 Request processed in 68us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481134.171249:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00010000:00080000:2.0:1782481134.171262:0:24164:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from df8b7b41-b102-4c0b-b8a2-94babd71285c@192.168.204.11@tcp t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:2.0:1782481134.171292:0:24164:0:(genops.c:1406:class_connect()) connect: client df8b7b41-b102-4c0b-b8a2-94babd71285c, cookie 0x65dae4c042ee4892 00002000:00100000:2.0:1782481134.171303:0:24164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli df8b7b41-b102-4c0b-b8a2-94babd71285c/ffff9f5b87bb7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782481134.171331:0:24164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782481134.171496:0:24164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782481134.171519:0:24164:0:(import.c:65:import_set_state_nolock()) ffff9f5b87bb3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782481134.171561:0:24164:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:2403:x1869066281309696:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 338us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481134.171569:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:1.0:1782481134.174279:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481134.174392:0:22662:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281309952 00000100:00100000:3.0:1782481134.174402:0:22662:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281309952 00000100:00100000:3.0:1782481134.174455:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1782481134.174480:0:22662:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18117:x1869066281309952:12345-192.168.204.11@tcp:33:mount.lustre.0 00000004:00080000:1.0:1782481134.179286:0:22662:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4710us 00000004:00200000:3.0:1782481134.193902:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1782481134.194055:0:22662:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18117:x1869066281309952:12345-192.168.204.11@tcp:33:mount.lustre.0 Request processed in 19572us (19779us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481134.194065:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1782481134.363893:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481134.364086:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281310080 00000100:00100000:2.0:1782481134.364096:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281310080 00000100:00100000:2.0:1782481134.364149:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1782481134.364160:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18165:x1869066281310080:12345-192.168.204.11@tcp:101:mkdir.0 00010000:00010000:2.0:1782481134.364181:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481134.364206:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5400/0x65dae4c042ee4899 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df69d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481134.364288:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee48a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481134.364302:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee48a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481134.364316:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee48a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481134.364366:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782481134.364370:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782481134.364400:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee48a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481134.364426:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5400/0x65dae4c042ee4899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df69d expref: 8 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481134.364445:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee48a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df69d expref: 7 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481134.364454:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbb800) 00010000:00010000:2.0:1782481134.364456:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782481134.364459:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4200, rc 0) 00000100:00100000:2.0:1782481134.365686:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:18165:x1869066281310080:12345-192.168.204.11@tcp:101:mkdir.0 Request processed in 1520us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481134.365875:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00010000:00010000:2.0:1782481135.004854:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481135.581507:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301339264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782481135.581583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481135.584430:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301339392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782481135.584433:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301339520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782481135.587539:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481135.587691:0:24169:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301339264 00000100:00100000:0.0:1782481135.587713:0:24169:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301339264 00000100:00100000:0.0:1782481135.587769:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782481135.587781:0:24169:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301339264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782481135.587959:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782481135.590616:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481135.590732:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301339392 00000100:00100000:1.0:1782481135.590741:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301339392 00000100:00100000:1.0:1782481135.590782:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301339520 00000100:00100000:1.0:1782481135.590785:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301339520 00000100:00100000:1.0:1782481135.590801:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782481135.590809:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301339392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782481135.590848:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1782481135.590901:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301339392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (3409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481135.590924:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782481135.592760:0:24169:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301339264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4974us (11168us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481135.592773:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1782481135.592811:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782481135.592834:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782481135.593071:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301339392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782481135.596372:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301339520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782481135.596431:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1782481135.596527:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301339520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 173us (5916us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481135.596664:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301339520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782481135.603534:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301339264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782481135.612140:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1782481136.029374:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481136.092400:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301339776:0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.092489:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481136.092527:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301340288:0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.092556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481136.092573:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1869066301340800:0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.092609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481136.092640:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782481136.092646:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301339904:0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.093034:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481136.093053:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301340416:0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.093075:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481136.093103:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301340800 00000100:00100000:3.0:1782481136.093111:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301340800 00000100:00100000:3.0:1782481136.093159:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301340416 00000100:00100000:3.0:1782481136.093162:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301340416 00000100:00100000:3.0:1782481136.093182:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782481136.093198:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869066301340800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.093249:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869066301340800:12345-0@lo:400:kworker.0 Request processed in 52us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.093257:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782481136.093276:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782481136.093282:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301340416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.093310:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301340416:12345-0@lo:400:kworker.0 Request processed in 28us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.093317:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782481136.093353:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301340416:0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.093360:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301340928:0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.093381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481136.093399:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301340928 00000100:00100000:3.0:1782481136.093402:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301340928 00000100:00100000:3.0:1782481136.093422:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782481136.093427:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869066301340928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.093645:0:24167:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301340288 00000100:00100000:1.0:1782481136.093657:0:24167:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301340288 00000100:00100000:1.0:1782481136.093683:0:24167:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301339904 00000100:00100000:1.0:1782481136.093686:0:24167:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301339904 00000100:00100000:1.0:1782481136.093725:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782481136.093732:0:24167:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301340288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481136.093849:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301339648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782481136.093934:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869066301340928:12345-0@lo:400:kworker.0 Request processed in 506us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.093941:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782481136.093961:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481136.093968:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301339904:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782481136.094039:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782481136.094043:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782481136.094045:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782481136.094047:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782481136.094075:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301339776 00000100:00100000:0.0:1782481136.094080:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301339776 00000100:00100000:0.0:1782481136.094111:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782481136.094118:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301339776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.094257:0:24167:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301340288:12345-0@lo:400:kworker.0 Request processed in 525us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481136.094264:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782481136.094303:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301340032:0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.094329:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481136.094349:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301340544:0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.094369:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481136.094401:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301341056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782481136.094423:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481136.094463:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301341056 00000100:00100000:1.0:1782481136.094467:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301341056 00000100:00100000:1.0:1782481136.094511:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782481136.094517:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301341056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782481136.094538:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1782481136.094572:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301341056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481136.094577:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782481136.094631:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301341056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782481136.094677:0:24164:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301340032 00000100:00100000:1.0:1782481136.094681:0:24164:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301340032 00000100:00100000:1.0:1782481136.094721:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782481136.094728:0:24164:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301340032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.094761:0:24164:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301340032:12345-0@lo:400:kworker.0 Request processed in 33us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481136.094767:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782481136.094791:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301340032:0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.094808:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301340544 00000100:00100000:1.0:1782481136.094810:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301340544 00000100:00100000:1.0:1782481136.094832:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782481136.094838:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869066301340544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.094885:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869066301340544:12345-0@lo:400:kworker.0 Request processed in 46us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481136.094891:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782481136.094916:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1869066301340544:0@lo:400:kworker.0 00000100:00080000:1.0:1782481136.094946:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782481136.094949:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782481136.094986:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b88817800 x1869066301340928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481136.094997:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301340928:0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.095009:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301340288:0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.095021:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1869066301340800:0@lo:400:kworker.0 00000100:00100000:2.0:1782481136.099611:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481136.099915:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301339648 00000100:00100000:1.0:1782481136.099940:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301339648 00000100:00100000:1.0:1782481136.099998:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782481136.100009:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869066301339648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782481136.100038:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1782481136.100092:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1869066301339648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481136.100100:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782481136.100424:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301339648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782481136.100436:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301340160:0@lo:400:kworker.0 00000100:00100000:2.0:1782481136.100471:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481136.100488:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1869066301340672:0@lo:400:kworker.0 00000100:00100000:2.0:1782481136.100508:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481136.100527:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301341184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782481136.100545:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481136.100601:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301341184 00000100:00100000:2.0:1782481136.100605:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301341184 00000100:00100000:2.0:1782481136.100662:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782481136.100670:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301341184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782481136.100683:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1782481136.100734:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1869066301341184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.100741:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782481136.100774:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1869066301341184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782481136.100793:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301340160 00000100:00100000:2.0:1782481136.100796:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301340160 00000100:00100000:2.0:1782481136.100821:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301340672 00000100:00100000:2.0:1782481136.100824:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301340672 00000100:00100000:2.0:1782481136.100867:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782481136.100872:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301340160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481136.100909:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301340160:12345-0@lo:400:kworker.0 Request processed in 37us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.100916:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782481136.100928:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782481136.100934:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869066301340672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481136.100959:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1869066301340672:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.100965:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1782481136.100984:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782481136.101004:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301340160:0@lo:400:kworker.0 00010000:00080000:2.0:1782481136.101016:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b88816a00 x1869066301340672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481136.101027:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1869066301340672:0@lo:400:kworker.0 00000100:00100000:3.0:1782481136.101893:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301339904:12345-0@lo:400:kworker.0 Request processed in 7921us (8853us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.101903:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782481136.101995:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301339776:12345-0@lo:400:kworker.0 Request processed in 7875us (9504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481136.102004:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1782481136.102078:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301339904:0@lo:400:kworker.0 00000100:00100000:1.0:1782481136.102089:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb1ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301339776:0@lo:400:kworker.0 00000100:00100000:0.0:1782481136.423130:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481136.423219:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281310208 00000100:00100000:2.0:1782481136.423229:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281310208 00000100:00100000:2.0:1782481136.423320:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:2.0:1782481136.423332:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:18218:x1869066281310208:12345-192.168.204.11@tcp:41:lfs.0 00000004:00000024:2.0:1782481136.423366:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782481136.423477:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:18218:x1869066281310208:12345-192.168.204.11@tcp:41:lfs.0 Request processed in 148us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.423485:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00080000:1.0:1782481136.423725:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782481136.427516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481136.427659:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281310336 00000100:00100000:2.0:1782481136.427669:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281310336 00000100:00100000:2.0:1782481136.427842:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:2.0:1782481136.427853:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18218:x1869066281310336:12345-192.168.204.11@tcp:41:lfs.0 00000004:00000024:2.0:1782481136.427899:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782481136.427994:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18218:x1869066281310336:12345-192.168.204.11@tcp:41:lfs.0 Request processed in 143us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.428002:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:3.0:1782481136.431869:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481136.433394:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281310464 00000100:00100000:2.0:1782481136.433408:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281310464 00000100:00080000:1.0:1782481136.434647:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782481136.434656:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782481136.446055:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1782481136.446071:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18218:x1869066281310464:12345-192.168.204.11@tcp:13:lfs.0 00002000:00000024:2.0:1782481136.446102:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1782481136.446212:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18218:x1869066281310464:12345-192.168.204.11@tcp:13:lfs.0 Request processed in 145us (14352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.446221:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:0.0:1782481136.448986:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481136.449082:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281310592 00000100:00100000:2.0:1782481136.449092:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281310592 00000100:00100000:2.0:1782481136.449253:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:2.0:1782481136.449265:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18218:x1869066281310592:12345-192.168.204.11@tcp:13:lfs.0 00002000:00000024:2.0:1782481136.449298:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1782481136.449376:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18218:x1869066281310592:12345-192.168.204.11@tcp:13:lfs.0 Request processed in 113us (398us total) trans 0 rc 0/0 00000100:00080000:1.0:1782481136.449721:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782481136.453521:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:0.0:1782481136.685006:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481136.685170:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281310720 00000100:00100000:3.0:1782481136.685181:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281310720 00000100:00100000:3.0:1782481136.685242:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 132 00000100:00100000:3.0:1782481136.685253:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+10:18253:x1869066281310720:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782481136.685281:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481136.685301:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5cb79aae00/0x65dae4c042ee48a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x33577da1469df6a4 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481136.685332:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5cb79aae00/0x65dae4c042ee48a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df6a4 expref: 11 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481136.685344:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5cb79aae00/0x65dae4c042ee48a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df6a4 expref: 11 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481136.685352:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79aae00, rc 0) 00000100:00100000:3.0:1782481136.685410:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18253:x1869066281310720:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 160us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.685418:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 132 00000100:00100000:0.0:1782481136.692664:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481136.692782:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281310848 00000100:00100000:1.0:1782481136.692791:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281310848 00000100:00100000:1.0:1782481136.692856:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 133 00000100:00100000:1.0:1782481136.692865:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18253:x1869066281310848:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782481136.693012:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18253:x1869066281310848:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 148us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481136.693019:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 133 00000100:00100000:0.0:1782481136.695836:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481136.695978:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281310976 00000100:00100000:1.0:1782481136.695987:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281310976 00000100:00100000:1.0:1782481136.696043:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 134 00000100:00100000:1.0:1782481136.696053:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18253:x1869066281310976:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782481136.696196:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18253:x1869066281310976:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 143us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481136.696213:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 134 00000100:00100000:0.0:1782481136.706918:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481136.707503:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281311104 00000100:00100000:3.0:1782481136.707516:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281311104 00000100:00100000:3.0:1782481136.707600:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 135 00000100:00100000:3.0:1782481136.707613:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18258:x1869066281311104:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782481136.707981:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18258:x1869066281311104:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 368us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.707990:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 135 00000040:00080000:0.0:1782481136.734420:0:23418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1782481136.741189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481136.741349:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281311232 00000100:00100000:0.0:1782481136.741360:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281311232 00000100:00100000:0.0:1782481136.741415:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 136 00000100:00100000:0.0:1782481136.741424:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18258:x1869066281311232:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782481136.742685:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18258:x1869066281311232:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 1253us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481136.743451:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 136 00000100:00100000:0.0:1782481136.748353:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481136.748452:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281311360 00000100:00100000:1.0:1782481136.748463:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281311360 00000100:00100000:1.0:1782481136.748536:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 137 00000100:00100000:1.0:1782481136.748556:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18258:x1869066281311360:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782481136.748750:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18258:x1869066281311360:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 203us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481136.748759:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 137 00000100:00100000:1.0:1782481136.764225:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481136.764370:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281311488 00000100:00100000:0.0:1782481136.764380:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281311488 00000100:00100000:0.0:1782481136.764442:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 138 00000100:00100000:0.0:1782481136.764452:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18253:x1869066281311488:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782481136.764469:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481136.764486:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c80031c00/0x65dae4c042ee48ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33577da1469df6d5 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481136.764529:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c80031c00/0x65dae4c042ee48ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df6d5 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481136.764550:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c80031c00/0x65dae4c042ee48ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df6d5 expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481136.764560:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c80031c00, rc 0) 00000100:00100000:0.0:1782481136.764627:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18253:x1869066281311488:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 176us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481136.764634:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 138 00000100:00100000:0.0:1782481136.771532:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481136.771661:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281311616 00000100:00100000:3.0:1782481136.771672:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281311616 00000100:00100000:3.0:1782481136.771750:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 139 00000100:00100000:3.0:1782481136.771762:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18253:x1869066281311616:12345-192.168.204.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782481136.771788:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782481136.771814:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782481136.771818:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782481136.771822:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782481136.771825:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1782481136.771827:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1782481136.774501:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18253:x1869066281311616:12345-192.168.204.11@tcp:256:mount.lustre.0 Request processed in 2729us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.774528:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 139 00000100:00100000:1.0:1782481136.777766:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481136.777894:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281311744 00000100:00100000:3.0:1782481136.777904:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281311744 00000100:00100000:3.0:1782481136.777958:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 140 00000100:00100000:3.0:1782481136.777967:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18253:x1869066281311744:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782481136.777984:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481136.778003:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33577da1469df6dc expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481136.778029:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df6dc expref: 13 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481136.778040:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df6dc expref: 13 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481136.778049:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79ab400, rc 0) 00000100:00100000:3.0:1782481136.778625:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18253:x1869066281311744:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 656us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.778632:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 140 00000100:00100000:0.0:1782481136.783344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481136.783423:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281311872 00000100:00100000:3.0:1782481136.783434:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281311872 00000100:00100000:3.0:1782481136.783485:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 141 00000100:00100000:3.0:1782481136.783494:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18253:x1869066281311872:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782481136.783671:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18253:x1869066281311872:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 177us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.783678:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 141 00000100:00100000:2.0:1782481136.786803:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481136.787151:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281312000 00000100:00100000:3.0:1782481136.787161:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281312000 00000100:00100000:3.0:1782481136.787214:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 142 00000100:00100000:3.0:1782481136.787224:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18253:x1869066281312000:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782481136.787532:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18253:x1869066281312000:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 307us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.787549:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 142 00000100:00100000:1.0:1782481136.794420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481136.795684:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281312128 00000100:00100000:0.0:1782481136.795732:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281312128 00000100:00100000:0.0:1782481136.795866:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 143 00000100:00100000:0.0:1782481136.795878:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18260:x1869066281312128:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782481136.796109:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18260:x1869066281312128:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 233us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481136.796251:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 143 00000100:00100000:0.0:1782481136.804255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481136.804477:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281312256 00000100:00100000:3.0:1782481136.804488:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281312256 00000100:00100000:3.0:1782481136.804564:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 144 00000100:00100000:3.0:1782481136.804583:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18260:x1869066281312256:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782481136.804766:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18260:x1869066281312256:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 192us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.804774:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 144 00000100:00100000:0.0:1782481136.817642:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481136.818077:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281312384 00000100:00100000:3.0:1782481136.818101:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281312384 00000100:00100000:3.0:1782481136.818156:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:3.0:1782481136.818163:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2403:x1869066281312384:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782481136.818192:0:22660:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7492e7e4-41f4-4199-b3ea-6cba6d5bda33@192.168.204.11@tcp t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:3.0:1782481136.818226:0:22660:0:(genops.c:1406:class_connect()) connect: client 7492e7e4-41f4-4199-b3ea-6cba6d5bda33, cookie 0x65dae4c042ee48bc 00000004:00100000:3.0:1782481136.818249:0:22660:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782481136.818339:0:22660:0:(import.c:65:import_set_state_nolock()) ffff9f5c8f6a2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782481136.818422:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2403:x1869066281312384:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 257us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.818430:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:0.0:1782481136.819256:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481136.823724:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281312640 00000100:00100000:2.0:1782481136.823740:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281312640 00000100:00100000:2.0:1782481136.823853:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:2.0:1782481136.823876:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1869066281312640:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782481136.823909:0:22659:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 7492e7e4-41f4-4199-b3ea-6cba6d5bda33@192.168.204.11@tcp t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:2.0:1782481136.823945:0:22659:0:(genops.c:1406:class_connect()) connect: client 7492e7e4-41f4-4199-b3ea-6cba6d5bda33, cookie 0x65dae4c042ee48c3 00000004:00100000:2.0:1782481136.823969:0:22659:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782481136.824068:0:22659:0:(import.c:65:import_set_state_nolock()) ffff9f5b875ee800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782481136.824151:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2403:x1869066281312640:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 275us (4897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.824158:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:1.0:1782481136.842926:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481136.842967:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481136.843048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481136.843329:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281312896 00000100:00100000:2.0:1782481136.843342:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281312896 00000100:00100000:2.0:1782481136.843414:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281312768 00000100:00100000:2.0:1782481136.843421:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281312768 00000100:00100000:2.0:1782481136.843442:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281312512 00000100:00100000:2.0:1782481136.843444:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281312512 00000100:00100000:2.0:1782481136.843468:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:2.0:1782481136.843481:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+7:18253:x1869066281312896:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782481136.843537:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782481136.843631:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+7:18253:x1869066281312896:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 153us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.843638:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:2.0:1782481136.843656:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1782481136.843663:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:0:x1869066281312768:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782481136.843686:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782481136.843753:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:0:x1869066281312768:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 89us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.843759:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1782481136.843978:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:2.0:1782481136.843985:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:0:x1869066281312512:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782481136.844001:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1782481136.844032:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:0:x1869066281312512:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 44us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.844038:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00080000:1.0:1782481136.844437:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782481136.844441:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782481136.846268:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481136.846348:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281313024 00000100:00100000:2.0:1782481136.846356:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281313024 00000100:00100000:2.0:1782481136.846439:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:2.0:1782481136.846449:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:18253:x1869066281313024:12345-192.168.204.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782481136.846823:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:18253:x1869066281313024:12345-192.168.204.11@tcp:40:mount.lustre.0 Request processed in 374us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481136.846832:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:2.0:1782481136.855190:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481136.855236:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481136.855277:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481136.855526:0:24746:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281313152 00000100:00100000:0.0:1782481136.855536:0:24746:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281313152 00000100:00100000:0.0:1782481136.855584:0:24746:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281313280 00000100:00100000:0.0:1782481136.855587:0:24746:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281313280 00000100:00100000:0.0:1782481136.855607:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1782481136.855615:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1869066281313152:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782481136.855650:0:24746:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7492e7e4-41f4-4199-b3ea-6cba6d5bda33@192.168.204.11@tcp t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:0.0:1782481136.855682:0:24746:0:(genops.c:1406:class_connect()) connect: client 7492e7e4-41f4-4199-b3ea-6cba6d5bda33, cookie 0x65dae4c042ee48ca 00002000:00100000:0.0:1782481136.855719:0:24746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7492e7e4-41f4-4199-b3ea-6cba6d5bda33/ffff9f5cbdfab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782481136.855729:0:24746:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782481136.855791:0:24746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782481136.855830:0:24746:0:(import.c:65:import_set_state_nolock()) ffff9f5cbdfad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481136.855889:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2403:x1869066281313152:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 273us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481136.855895:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1782481136.855912:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:0.0:1782481136.855916:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1869066281313280:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782481136.855931:0:24746:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7492e7e4-41f4-4199-b3ea-6cba6d5bda33@192.168.204.11@tcp t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:0.0:1782481136.855964:0:24746:0:(genops.c:1406:class_connect()) connect: client 7492e7e4-41f4-4199-b3ea-6cba6d5bda33, cookie 0x65dae4c042ee48d1 00002000:00100000:0.0:1782481136.855969:0:24746:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7492e7e4-41f4-4199-b3ea-6cba6d5bda33/ffff9f5cbdfac800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782481136.855974:0:24746:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782481136.856008:0:24746:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782481136.856023:0:24746:0:(import.c:65:import_set_state_nolock()) ffff9f5cbdfa9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481136.856046:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2403:x1869066281313280:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 128us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481136.856053:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:3.0:1782481136.857054:0:22671:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281313408 00000100:00100000:3.0:1782481136.857063:0:22671:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281313408 00000100:00100000:3.0:1782481136.857124:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:3.0:1782481136.857134:0:22671:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:18253:x1869066281313408:12345-192.168.204.11@tcp:900:mount.lustre.0 00000100:00100000:3.0:1782481136.857210:0:22671:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:18253:x1869066281313408:12345-192.168.204.11@tcp:900:mount.lustre.0 Request processed in 77us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481136.857217:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1782481136.874023:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481136.874178:0:22663:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281313536 00000100:00100000:1.0:1782481136.874189:0:22663:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281313536 00000100:00100000:1.0:1782481136.874248:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:1.0:1782481136.874260:0:22663:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:18253:x1869066281313536:12345-192.168.204.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1782481136.874359:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782481136.874453:0:22663:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:18253:x1869066281313536:12345-192.168.204.11@tcp:33:mount.lustre.0 Request processed in 195us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481136.874461:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00010000:00010000:3.0:1782481137.051853:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481137.161272:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481137.161554:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281313664 00000100:00100000:3.0:1782481137.161574:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281313664 00000100:00100000:3.0:1782481137.161640:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:3.0:1782481137.161650:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:18283:x1869066281313664:12345-192.168.204.11@tcp:101:mkdir.0 00010000:00010000:3.0:1782481137.161672:0:24474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481137.161724:0:24474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee48d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df70d expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481137.161806:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481137.161819:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481137.161830:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782481137.161941:0:24474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782481137.161945:0:24474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782481137.161967:0:24474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481137.161993:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee48d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df70d expref: 8 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481137.162010:0:24474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df70d expref: 7 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481137.162018:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbb800) 00010000:00010000:3.0:1782481137.162021:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782481137.162025:0:24474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79aa000, rc 0) 00000100:00100000:3.0:1782481137.162086:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+7:18283:x1869066281313664:12345-192.168.204.11@tcp:101:mkdir.0 Request processed in 437us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481137.162094:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00010000:00010000:0.0:1782481138.075929:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481139.102347:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782481139.678240:0:24161:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7492e7e4-41f4-4199-b3ea-6cba6d5bda33 00000001:00100000:1.0:1782481139.678261:0:24161:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of df8b7b41-b102-4c0b-b8a2-94babd71285c 00000001:00100000:0.0:1782481139.680078:0:22640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7492e7e4-41f4-4199-b3ea-6cba6d5bda33 00000001:00100000:0.0:1782481139.680089:0:22640:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of df8b7b41-b102-4c0b-b8a2-94babd71285c 00000001:00100000:3.0:1782481139.680637:0:23392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7492e7e4-41f4-4199-b3ea-6cba6d5bda33 00000001:00100000:3.0:1782481139.680646:0:23392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of df8b7b41-b102-4c0b-b8a2-94babd71285c 00000001:00100000:1.0:1782481139.681500:0:24980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7492e7e4-41f4-4199-b3ea-6cba6d5bda33 00000001:00100000:1.0:1782481139.681508:0:24980:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of df8b7b41-b102-4c0b-b8a2-94babd71285c 00000001:02000400:0.0:1782481139.906383:0:25540:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782481140.124284:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481140.700981:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782481140.701005:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301341312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782481140.701083:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481140.701150:0:24169:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301341312 00000100:00100000:3.0:1782481140.701157:0:24169:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301341312 00000100:00100000:3.0:1782481140.701211:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782481140.701220:0:24169:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301341312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782481140.701247:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782481140.701292:0:24169:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869066301341312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481140.701723:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1782481140.701746:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782481140.701782:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1869066301341312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782481140.703100:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782481140.703133:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301341440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782481140.703200:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481140.703256:0:23400:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301341440 00000100:00100000:2.0:1782481140.703264:0:23400:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301341440 00000100:00100000:2.0:1782481140.703313:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782481140.703322:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301341440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782481140.703377:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782481140.703426:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301341440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481140.703434:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782481140.703479:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301341440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782481140.709060:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301341568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782481140.709139:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481140.709316:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301341568 00000100:00100000:1.0:1782481140.709325:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301341568 00000100:00100000:1.0:1782481140.709382:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782481140.709393:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301341568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782481140.709435:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1782481140.709485:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301341568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481140.709492:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782481140.709686:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301341568:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782481141.147871:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481141.212025:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782481141.212047:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301341696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782481141.212113:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481141.212437:0:24169:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301341696 00000100:00100000:3.0:1782481141.212446:0:24169:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301341696 00000100:00100000:3.0:1782481141.212510:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782481141.212521:0:24169:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301341696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782481141.212550:0:24169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1782481141.212597:0:24169:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301341696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481141.212604:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1782481141.212997:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782481141.213055:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301341696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782481141.213082:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301342080:0@lo:400:kworker.0 00000100:00100000:2.0:1782481141.213131:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301341824:0@lo:400:kworker.0 00000100:00100000:2.0:1782481141.213164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481141.213191:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301342336:0@lo:400:kworker.0 00000100:00100000:2.0:1782481141.213214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481141.213231:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301342848:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.213312:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481141.213350:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1869066301342592:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.213385:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301341952:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.213411:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481141.213431:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1869066301342464:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.213458:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301342208:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.213498:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301342080 00000100:00100000:3.0:1782481141.213504:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301342080 00000100:00100000:3.0:1782481141.213541:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301341952 00000100:00100000:3.0:1782481141.213544:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301341952 00000100:00100000:3.0:1782481141.213570:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782481141.213578:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301342080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481141.213583:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782481141.213598:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301341952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.213624:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301342080:12345-0@lo:400:kworker.0 Request processed in 46us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481141.213651:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869066301341952:12345-0@lo:400:kworker.0 Request processed in 58us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481141.213657:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481141.214420:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1782481141.214449:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782481141.214453:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782481141.214837:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301341824 00000100:00100000:1.0:1782481141.214854:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301341824 00000100:00100000:1.0:1782481141.214888:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782481141.214896:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301341824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481141.214948:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301341824:12345-0@lo:400:kworker.0 Request processed in 53us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481141.214955:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782481141.215411:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481141.216066:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301341824:0@lo:400:kworker.0 00000100:00100000:2.0:1782481141.216083:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782481141.216092:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301342976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782481141.216132:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481141.224857:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481141.226171:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1869066301342720:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.226245:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481141.226279:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782481141.226287:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b88814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301343104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782481141.226312:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481141.226350:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301342336 00000100:00100000:3.0:1782481141.226357:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301342336 00000100:00100000:3.0:1782481141.226396:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301342848 00000100:00100000:3.0:1782481141.226400:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301342848 00000100:00100000:3.0:1782481141.226426:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301342208 00000100:00100000:3.0:1782481141.226441:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301342208 00000100:00100000:3.0:1782481141.226458:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301342720 00000100:00100000:3.0:1782481141.226461:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301342720 00000100:00100000:3.0:1782481141.226478:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782481141.226500:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301342336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.226558:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869066301342336:12345-0@lo:400:kworker.0 Request processed in 72us (13342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481141.226566:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782481141.226583:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782481141.226589:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869066301342848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.226616:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869066301342848:12345-0@lo:400:kworker.0 Request processed in 27us (13362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481141.226621:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782481141.226632:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782481141.226636:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301342208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.226679:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1869066301342208:12345-0@lo:400:kworker.0 Request processed in 42us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481141.226686:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782481141.226727:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782481141.226733:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869066301342720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.226756:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1869066301342720:12345-0@lo:400:kworker.0 Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481141.226761:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782481141.226780:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301342976 00000100:00100000:3.0:1782481141.226783:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301342976 00000100:00100000:3.0:1782481141.226797:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301343104 00000100:00100000:3.0:1782481141.226800:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301343104 00000100:00100000:3.0:1782481141.226820:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782481141.226826:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301342976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782481141.226842:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782481141.226873:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301342976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (10740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481141.226879:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782481141.226890:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782481141.226895:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301343104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782481141.226903:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1782481141.226927:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301343104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481141.226932:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1782481141.226947:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782481141.226951:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782481141.226961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481141.227002:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1869066301341952:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.227025:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481141.227051:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301342080:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.227070:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301342464 00000100:00100000:3.0:1782481141.227073:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301342464 00000100:00100000:3.0:1782481141.227095:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301342592 00000100:00100000:3.0:1782481141.227098:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301342592 00000100:00100000:3.0:1782481141.227109:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782481141.227113:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869066301342464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.227146:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869066301342464:12345-0@lo:400:kworker.0 Request processed in 32us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481141.227152:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782481141.227177:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782481141.227182:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869066301342592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.227214:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869066301342592:12345-0@lo:400:kworker.0 Request processed in 32us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481141.227220:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1782481141.227232:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782481141.227234:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782481141.227252:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1869066301342464:0@lo:400:kworker.0 00010000:00080000:3.0:1782481141.227275:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b882d1180 x1869066301342592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481141.227284:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1869066301342592:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.227307:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301343104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782481141.227317:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1869066301342208:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.227325:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1869066301342720:0@lo:400:kworker.0 00000100:00100000:3.0:1782481141.227353:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b88815180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301342976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782481141.227364:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869066301342336:0@lo:400:kworker.0 00010000:00080000:3.0:1782481141.227374:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b882d2680 x1869066301342848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481141.227382:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1869066301342848:0@lo:400:kworker.0 00000100:00100000:2.0:1782481142.082932:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481142.082977:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481142.083004:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481142.083034:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481142.083055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481142.083073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481142.083090:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481142.083109:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481142.083133:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481142.083158:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281313792 00000100:00100000:2.0:1782481142.083167:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281313792 00000100:00100000:2.0:1782481142.083213:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 146 00000100:00100000:2.0:1782481142.083223:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:2404:x1869066281313792:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481142.083286:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:2404:x1869066281313792:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 64us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481142.083294:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 146 00000100:00100000:2.0:1782481142.083327:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281313920 00000100:00100000:2.0:1782481142.083331:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281313920 00000100:00100000:2.0:1782481142.083373:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281314048 00000100:00100000:2.0:1782481142.083377:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281314048 00000100:00100000:2.0:1782481142.083390:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281314432 00000100:00100000:2.0:1782481142.083392:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281314432 00000100:00100000:2.0:1782481142.083402:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281314560 00000100:00100000:2.0:1782481142.083404:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281314560 00000100:00100000:2.0:1782481142.083417:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:2.0:1782481142.083422:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:2405:x1869066281313920:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481142.083452:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:2405:x1869066281313920:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481142.083459:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:2.0:1782481142.083479:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:2.0:1782481142.083486:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2404:x1869066281314048:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481142.083519:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2404:x1869066281314048:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 33us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481142.083526:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:2.0:1782481142.083538:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:2.0:1782481142.083544:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2405:x1869066281314432:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481142.083567:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2405:x1869066281314432:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481142.083574:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:2.0:1782481142.083585:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:2.0:1782481142.083591:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2404:x1869066281314560:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481142.083613:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2404:x1869066281314560:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 22us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481142.083620:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:2.0:1782481142.083640:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281314176 00000100:00100000:2.0:1782481142.083644:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281314176 00000100:00100000:2.0:1782481142.083670:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281314304 00000100:00100000:2.0:1782481142.083672:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281314304 00000100:00100000:2.0:1782481142.083684:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281314688 00000100:00100000:2.0:1782481142.083686:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281314688 00000100:00100000:2.0:1782481142.083725:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281314816 00000100:00100000:2.0:1782481142.083728:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281314816 00000100:00100000:2.0:1782481142.083741:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1782481142.083746:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2405:x1869066281314176:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481142.083785:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2405:x1869066281314176:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 39us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481142.083801:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1782481142.083812:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:2.0:1782481142.083818:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2404:x1869066281314304:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481142.083843:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2404:x1869066281314304:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 25us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481142.083849:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:2.0:1782481142.083860:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1782481142.083867:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2405:x1869066281314688:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481142.083887:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2405:x1869066281314688:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 21us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481142.083893:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1782481142.083903:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:2.0:1782481142.083909:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2404:x1869066281314816:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481142.083927:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2404:x1869066281314816:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 19us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481142.083932:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00080000:2.0:1782481142.083955:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782481142.083959:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782481142.083961:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782481142.083963:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782481142.172040:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782481142.685033:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1782481143.096012:0:25688:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd2e95090 20000000:00000080:0.0:1782481143.096031:0:25688:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f5cbdfdac00 uarg=0000000000000000 20000000:01000000:0.0:1782481143.096076:0:25688:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782481143.096082:0:25688:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782481143.096086:0:25688:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782481143.096572:0:25689:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1782481143.096853:0:25688:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782481143.105820:0:25688:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782481143.105856:0:25688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.105887:0:25688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee453c expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.105895:0:25688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee454a expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.105902:0:25688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4589 expref: 23 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.105909:0:25688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4623 expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.105920:0:25688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df66c expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.105927:0:25688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df6dc expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.105935:0:25688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.105977:0:25688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df6dc expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.105993:0:25688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df6dc expref: 12 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.106008:0:25688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343232:192.168.204.11@tcp:104: 00010000:00010000:0.0:1782481143.106176:0:25688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df66c expref: 12 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.106192:0:25688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df66c expref: 12 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.106202:0:25688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343360:192.168.204.11@tcp:104: 00010000:00010000:0.0:1782481143.106236:0:25688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee4623 expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.106245:0:25688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee4623 expref: 23 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.106254:0:25688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343488:0@lo:104: 00000100:00100000:0.0:1782481143.106297:0:25688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782481143.106341:0:25688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee4589 expref: 23 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.106350:0:25688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee4589 expref: 23 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.106358:0:25688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343616:0@lo:104: 00000100:00100000:0.0:1782481143.106381:0:25688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782481143.106428:0:25688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee454a expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.106436:0:25688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee454a expref: 23 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.106445:0:25688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343744:0@lo:104: 00000100:00100000:0.0:1782481143.106486:0:25688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782481143.106511:0:25688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65dae4c042ee453c expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.106519:0:25688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65dae4c042ee453c expref: 23 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.106528:0:25688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343872:0@lo:104: 00000100:00100000:0.0:1782481143.106548:0:25688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481143.106559:0:25688:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b810dccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481143.106741:0:22643:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301343488 00000100:00100000:3.0:1782481143.106749:0:22643:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301343488 00000100:00100000:3.0:1782481143.106784:0:22643:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301343616 00000100:00100000:3.0:1782481143.106793:0:22643:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301343616 00000100:00100000:3.0:1782481143.106807:0:22643:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301343744 00000100:00100000:3.0:1782481143.106809:0:22643:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301343744 00000100:00100000:3.0:1782481143.106819:0:22643:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301343872 00000100:00100000:3.0:1782481143.106821:0:22643:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301343872 00000100:00100000:3.0:1782481143.106832:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782481143.106840:0:22643:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+6:25688:x1869066301343488:12345-0@lo:104: 00010000:00010000:3.0:1782481143.106852:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.106907:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782481143.106912:0:22643:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+6:25688:x1869066301343488:12345-0@lo:104: Request processed in 74us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481143.106919:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782481143.106935:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481143.106940:0:22643:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+5:25688:x1869066301343616:12345-0@lo:104: 00010000:00010000:3.0:1782481143.106947:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.106974:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782481143.106979:0:22643:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+5:25688:x1869066301343616:12345-0@lo:104: Request processed in 39us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481143.106984:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481143.106994:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782481143.106999:0:22643:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:25688:x1869066301343744:12345-0@lo:104: 00010000:00010000:3.0:1782481143.107006:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107031:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782481143.107041:0:22643:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+4:25688:x1869066301343744:12345-0@lo:104: Request processed in 42us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481143.107047:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782481143.107059:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782481143.107065:0:22643:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:25688:x1869066301343872:12345-0@lo:104: 00010000:00010000:3.0:1782481143.107072:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107100:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782481143.107105:0:22643:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:93f44a9c-11b5-4eed-b910-753bd776bd7b+3:25688:x1869066301343872:12345-0@lo:104: Request processed in 41us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481143.107110:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1782481143.107125:0:25052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782481143.107130:0:25052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107137:0:25052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4e00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481143.107140:0:25052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107148:0:25052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481143.107155:0:25052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481143.107161:0:25052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782481143.107184:0:25052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107199:0:25052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481143.107216:0:25052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107222:0:25052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5ca6eb4e00/0x65dae4c042ee4623 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee462a expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107234:0:25052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782481143.107237:0:25052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107242:0:25052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d74000 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481143.107245:0:25052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107251:0:25052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481143.107256:0:25052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481143.107260:0:25052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782481143.107270:0:25052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107275:0:25052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481143.107287:0:25052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107293:0:25052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d74000/0x65dae4c042ee4589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4590 expref: -99 pid: 24160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107305:0:25052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481143.107309:0:25052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107314:0:25052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111c600 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481143.107316:0:25052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107322:0:25052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481143.107328:0:25052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481143.107333:0:25052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782481143.107344:0:25052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107349:0:25052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481143.107354:0:25052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107360:0:25052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111c600/0x65dae4c042ee454a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4551 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107368:0:25052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481143.107370:0:25052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107384:0:25052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111ca00 already unused, calling callback (ffffffffc13d7c20) 10000000:00010000:3.0:1782481143.107387:0:25052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107392:0:25052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481143.107398:0:25052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481143.107403:0:25052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782481143.107415:0:25052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107434:0:25052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481143.107440:0:25052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107454:0:25052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9f5c9111ca00/0x65dae4c042ee453c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65dae4c042ee4543 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107471:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481143.107473:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481143.107474:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481143.107493:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301344000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481143.107523:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481143.107552:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782481143.107558:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301344384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481143.107587:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481143.107613:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301344128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481143.107636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481143.107651:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782481143.107656:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301344256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481143.107673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481143.107715:0:22647:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301344000 00000100:00100000:3.0:1782481143.107719:0:22647:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301344000 00010000:00010000:3.0:1782481143.107738:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4623 expref: 24 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481143.107752:0:22647:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301344384 00000100:00100000:3.0:1782481143.107754:0:22647:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301344384 00010000:00010000:3.0:1782481143.107764:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee453c expref: 25 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481143.107774:0:22647:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301344128 00000100:00100000:3.0:1782481143.107777:0:22647:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301344128 00010000:00010000:3.0:1782481143.107784:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4589 expref: 26 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481143.107793:0:22647:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301344256 00000100:00100000:3.0:1782481143.107794:0:22647:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301344256 00010000:00010000:3.0:1782481143.107809:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee454a expref: 27 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481143.107822:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782481143.107828:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+27:3650:x1869066301344000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481143.107839:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481143.107850:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4623 expref: 27 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107859:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee4623 expref: 27 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107875:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481143.107903:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+27:3650:x1869066301344000:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481143.107909:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782481143.107923:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481143.107928:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+26:3650:x1869066301344384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481143.107935:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481143.107938:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee453c expref: 26 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107945:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee453c expref: 26 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.107954:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481143.107971:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+26:3650:x1869066301344384:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481143.107976:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481143.107985:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782481143.107989:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+25:3647:x1869066301344128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481143.107995:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481143.107998:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee4589 expref: 25 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.108015:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee4589 expref: 25 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.108023:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481143.108044:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+25:3647:x1869066301344128:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481143.108049:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782481143.108060:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782481143.108065:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301344256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481143.108071:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481143.108075:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65dae4c042ee454a expref: 24 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.108081:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65dae4c042ee454a expref: 24 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.108089:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481143.108104:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3647:x1869066301344256:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481143.108110:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782481143.108140:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301344256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481143.108149:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:93f44a9c-11b5-4eed-b910-753bd776bd7b:3647:1869066301344128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481143.108173:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301344384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481143.108180:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:93f44a9c-11b5-4eed-b910-753bd776bd7b:3650:1869066301344000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782481143.109467:0:25688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111c800/0x65dae4c042ee462a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee4623 expref: 23 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.109483:0:25688:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343488:0@lo:104: 00010000:00010000:0.0:1782481143.109495:0:25688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5ca6eb4000/0x65dae4c042ee4590 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee4589 expref: 22 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.109503:0:25688:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343616:0@lo:104: 00010000:00010000:0.0:1782481143.109511:0:25688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111cc00/0x65dae4c042ee4551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee454a expref: 21 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.109518:0:25688:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343744:0@lo:104: 00010000:00010000:0.0:1782481143.109526:0:25688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c9111c000/0x65dae4c042ee4543 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65dae4c042ee453c expref: 20 pid: 22654 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.109533:0:25688:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343872:0@lo:104: 00010000:00010000:3.0:1782481143.111602:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481143.111625:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481143.111630:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481143.117110:0:25688:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343232:192.168.204.11@tcp:104: 00000100:00100000:0.0:1782481143.117124:0:25688:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25688:1869066301343360:192.168.204.11@tcp:104: 00010000:00010000:0.0:1782481143.117162:0:25688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481143.124026:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481143.124133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481143.124290:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281315072 00000100:00100000:2.0:1782481143.124300:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281315072 00010000:00010000:2.0:1782481143.124350:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df66c expref: 13 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481143.124386:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281314944 00000100:00100000:2.0:1782481143.124389:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281314944 00010000:00010000:2.0:1782481143.124400:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df6dc expref: 14 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481143.124426:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1782481143.124436:0:22646:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c8944c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2c34bb-9817-469e-8b47-2ebfb872a531+14:2404:x1869066281315072:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481143.124461:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481143.124475:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df66c expref: 14 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124487:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df66c expref: 14 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124505:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c80030c00/0x65dae4c042ee4876 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df66c expref: 14 pid: 22653 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124521:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481143.124584:0:22646:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c8944c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:2404:x1869066281315072:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 149us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481143.124593:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1782481143.124648:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:2.0:1782481143.124655:0:22646:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:2404:x1869066281314944:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481143.124663:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481143.124668:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df6dc expref: 12 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124684:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df6dc expref: 12 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124728:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5cb79ab400/0x65dae4c042ee48b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df6dc expref: 12 pid: 22652 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124740:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124749:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124765:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124772:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124779:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124786:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124792:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80031e00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481143.124796:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124804:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124829:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481143.124839:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481143.124858:0:22646:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:2404:x1869066281314944:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 203us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481143.124865:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00010000:00010000:0.0:1782481143.125436:0:25688:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.125458:0:25688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481143.125623:0:25688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee48e6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481143.195936:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481144.219980:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481144.258869:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.259013:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281315200 00000100:00100000:3.0:1782481144.259024:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281315200 00000100:00100000:3.0:1782481144.259118:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 147 00000100:00100000:3.0:1782481144.259129:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+11:18131:x1869066281315200:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481144.259146:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481144.259165:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5cb79abe00/0x65dae4c042ee48ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33577da1469df714 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.259190:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5cb79abe00/0x65dae4c042ee48ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df714 expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.259201:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5cb79abe00/0x65dae4c042ee48ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df714 expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.259210:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79abe00, rc 0) 00000100:00100000:3.0:1782481144.259332:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18131:x1869066281315200:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 203us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.259340:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 147 00000100:00100000:1.0:1782481144.262790:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481144.263062:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281315328 00000100:00100000:2.0:1782481144.263073:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281315328 00000100:00100000:2.0:1782481144.263244:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 148 00000100:00100000:2.0:1782481144.263256:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c837ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18131:x1869066281315328:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782481144.263422:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c837ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18131:x1869066281315328:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 168us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481144.263441:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 148 00000100:00100000:0.0:1782481144.266053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.267337:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281315456 00000100:00100000:3.0:1782481144.267349:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281315456 00000100:00100000:3.0:1782481144.267550:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 149 00000100:00100000:3.0:1782481144.267562:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c837ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18131:x1869066281315456:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782481144.268030:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c837ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18131:x1869066281315456:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 468us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.268050:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 149 00000100:00100000:1.0:1782481144.281132:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481144.281301:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281315584 00000100:00100000:2.0:1782481144.281311:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281315584 00000100:00100000:2.0:1782481144.281368:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 150 00000100:00100000:2.0:1782481144.281378:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+12:18131:x1869066281315584:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782481144.281394:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481144.281413:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca6eb5a00/0x65dae4c042ee48f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33577da1469df71b expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.281455:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca6eb5a00/0x65dae4c042ee48f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df71b expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.281486:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca6eb5a00/0x65dae4c042ee48f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df71b expref: 13 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.281496:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb5a00, rc 0) 00000100:00100000:2.0:1782481144.281558:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83872050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18131:x1869066281315584:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 181us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481144.281566:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 150 00000100:00100000:1.0:1782481144.288633:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.289061:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281315712 00000100:00100000:3.0:1782481144.289072:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281315712 00000100:00100000:3.0:1782481144.289131:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 151 00000100:00100000:3.0:1782481144.289791:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18131:x1869066281315712:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782481144.290587:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83871c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18131:x1869066281315712:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 1441us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.290597:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 151 00000100:00100000:0.0:1782481144.298279:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481144.298613:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281315840 00000100:00100000:2.0:1782481144.298623:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281315840 00000100:00100000:2.0:1782481144.298687:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 152 00000100:00100000:2.0:1782481144.298726:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c83873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18131:x1869066281315840:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782481144.299212:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c83873850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:18131:x1869066281315840:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 486us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481144.299220:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 152 00000100:00100000:1.0:1782481144.707030:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481144.707227:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281315968 00000100:00100000:2.0:1782481144.707238:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281315968 00000100:00100000:2.0:1782481144.707325:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:2.0:1782481144.707336:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:18753:x1869066281315968:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782481144.707357:0:24474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481144.707378:0:24474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee48fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df722 expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707457:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707471:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707501:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707517:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707524:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707531:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707629:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4a00/0x65dae4c042ee4910 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707638:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4a00/0x65dae4c042ee4910 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707645:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4a00/0x65dae4c042ee4910 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481144.707676:0:24474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000100:00080000:3.0:1782481144.707736:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1782481144.707931:0:24474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782481144.707974:0:24474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4a00/0x65dae4c042ee4910 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707985:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.707992:0:24474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708010:0:24474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708016:0:24474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481144.708020:0:24474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708028:0:24474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708041:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbb800) 00010000:00010000:2.0:1782481144.708044:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481144.708048:0:24474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708053:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708066:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708071:0:24474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708076:0:24474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708079:0:24474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481144.708083:0:24474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708098:0:24474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708106:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f5c886fca00) 00010000:00010000:2.0:1782481144.708108:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481144.708111:0:24474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708116:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4909 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708149:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee48fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df722 expref: 8 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708174:0:24474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4a00/0x65dae4c042ee4910 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df722 expref: 7 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.708182:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f5c886fcc00) 00010000:00010000:2.0:1782481144.708184:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782481144.708186:0:24474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4a00, rc 0) 00000100:00100000:2.0:1782481144.708255:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:18753:x1869066281315968:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 921us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481144.708262:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:1.0:1782481144.713284:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.713519:0:22671:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281316096 00000100:00100000:3.0:1782481144.713530:0:22671:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281316096 00000100:00100000:3.0:1782481144.713590:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:3.0:1782481144.713601:0:22671:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:18753:x1869066281316096:12345-192.168.204.11@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782481144.713939:0:22671:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:18753:x1869066281316096:12345-192.168.204.11@tcp:900:lhsmtool_posix.0 Request processed in 338us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.713948:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:1.0:1782481144.720442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481144.720560:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281316352 00000100:00100000:2.0:1782481144.720571:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281316352 00000100:00100000:2.0:1782481144.720635:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:2.0:1782481144.720646:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:18753:x1869066281316352:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782481144.720684:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481144.720734:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4917 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df729 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.720811:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.720838:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.720850:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.720865:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.720872:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.720879:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.720979:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5c00/0x65dae4c042ee492c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.720988:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5c00/0x65dae4c042ee492c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.720995:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5c00/0x65dae4c042ee492c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481144.721006:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1782481144.721177:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721185:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721192:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721199:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481144.721203:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721211:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721224:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f5c886fcc00) 00010000:00010000:2.0:1782481144.721227:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481144.721232:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721240:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee491e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721253:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721259:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721266:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721282:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481144.721285:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721292:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721301:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f5c886fca00) 00010000:00010000:2.0:1782481144.721303:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481144.721306:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.721313:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4925 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.723240:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4917 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df729 expref: 10 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.723265:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5c00/0x65dae4c042ee492c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df729 expref: 9 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.723273:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f5c886fc500) 00010000:00010000:2.0:1782481144.723276:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481144.723280:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb5c00, rc 0) 00000100:00100000:2.0:1782481144.723355:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:18753:x1869066281316352:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 2710us (2925us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1782481144.723365:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:2.0:1782481144.734215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.734623:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281316480 00000100:00100000:3.0:1782481144.734634:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281316480 00000100:00100000:3.0:1782481144.734710:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:3.0:1782481144.734721:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:18753:x1869066281316480:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782481144.734831:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:18753:x1869066281316480:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 Request processed in 113us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.734838:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:1.0:1782481144.755277:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481144.755369:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281316608 00000100:00100000:0.0:1782481144.755379:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281316608 00000100:00100000:0.0:1782481144.755457:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:0.0:1782481144.755471:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:18753:x1869066281316608:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1782481144.757216:0:22660:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1701us 00000100:00080000:3.0:1782481144.757353:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782481144.784118:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:18753:x1869066281316608:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 Request processed in 28631us (28832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481144.784132:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:2.0:1782481144.798732:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.798870:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281316736 00000100:00100000:3.0:1782481144.798883:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281316736 00000100:00100000:3.0:1782481144.798949:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:3.0:1782481144.798959:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:18759:x1869066281316736:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1782481144.798980:0:24474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481144.799000:0:24474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee493a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df730 expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799067:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799082:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799093:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799106:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799114:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799120:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799169:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799176:0:24474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799196:0:24474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799202:0:24474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aaa00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1782481144.799206:0:24474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799214:0:24474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799226:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbb800) 00010000:00010000:3.0:1782481144.799229:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782481144.799234:0:24474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799240:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799252:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799259:0:24474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799264:0:24474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799269:0:24474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79abc00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1782481144.799272:0:24474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799286:0:24474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799295:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f5c90fbc900) 00010000:00010000:3.0:1782481144.799297:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782481144.799300:0:24474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799305:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee4948 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799336:0:24474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee493a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df730 expref: 10 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799346:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbb800) 00010000:00010000:3.0:1782481144.799349:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782481144.799352:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee493a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df730 expref: 10 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.799361:0:24474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79ab200, rc 0) 00000100:00100000:3.0:1782481144.799479:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:18759:x1869066281316736:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 521us (792us total) trans 0 rc 301/301 00000100:00100000:3.0:1782481144.799486:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:1.0:1782481144.815961:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.816061:0:22668:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281316864 00000100:00100000:3.0:1782481144.816071:0:22668:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281316864 00000100:00100000:3.0:1782481144.816120:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1782481144.816130:0:22668:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:18759:x1869066281316864:12345-192.168.204.11@tcp:700:lfs.0 00000100:00100000:3.0:1782481144.816231:0:22668:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:18759:x1869066281316864:12345-192.168.204.11@tcp:700:lfs.0 Request processed in 102us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.816239:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:1.0:1782481144.822640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481144.822734:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281317120 00000100:00100000:2.0:1782481144.822744:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281317120 00000100:00100000:2.0:1782481144.822803:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:2.0:1782481144.822814:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:18759:x1869066281317120:12345-192.168.204.11@tcp:36:lfs.0 00010000:00010000:2.0:1782481144.822869:0:22661:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481144.822893:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee48a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df69d expref: 9 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.822912:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbb800) 00010000:00010000:2.0:1782481144.822916:0:22661:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782481144.822969:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.822982:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df70d expref: 5 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.822991:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.823021:0:22661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df70d expref: 5 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481144.823034:0:22661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df70d expref: 5 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481144.823068:0:22661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22661:1869066301344512:192.168.204.11@tcp:104: 00000100:00100000:2.0:1782481144.823150:0:22661:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cb8cdb480 going to sleep for 11 seconds 00000100:00100000:2.0:1782481144.831411:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.831535:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281317248 00000100:00100000:3.0:1782481144.831546:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281317248 00010000:00010000:3.0:1782481144.831612:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df70d expref: 6 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481144.831657:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:3.0:1782481144.831668:0:22646:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2404:x1869066281317248:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782481144.831684:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481144.831720:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df70d expref: 6 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.831734:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df70d expref: 6 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.831756:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbb800) 00010000:00010000:3.0:1782481144.831762:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.831771:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.831778:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.831798:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481144.831876:0:22646:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2404:x1869066281317248:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 207us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.831883:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00080000:2.0:1782481144.832421:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782481144.832616:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa000/0x65dae4c042ee48df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df70d expref: 5 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481144.832640:0:22661:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22661:1869066301344512:192.168.204.11@tcp:104: 00010000:00010000:0.0:1782481144.832664:0:22661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.832673:0:22661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.832679:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.833251:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.833265:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.833275:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836089:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836113:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836124:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782481144.836140:0:22661:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000511390d6 reply state 000000001f8ebc22 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836151:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836158:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:0.0:1782481144.836161:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782481144.836165:0:22661:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782481144.836170:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782481144.836177:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836183:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836197:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836203:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481144.836207:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836214:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836225:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbb800) 00010000:00010000:0.0:1782481144.836227:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481144.836231:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836242:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee494f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782481144.836262:0:22661:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000511390d6 reply state 000000001f8ebc22 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836271:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481144.836276:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f5c912e1500) 00010000:00010000:0.0:1782481144.836278:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782481144.836280:0:22661:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1782481144.836379:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+10:18759:x1869066281317120:12345-192.168.204.11@tcp:36:lfs.0 Request processed in 13563us (13745us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1782481144.836387:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 28 00000040:00080000:3.0:1782481144.924685:0:23418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782481144.940355:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.941146:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281317376 00000100:00100000:3.0:1782481144.941159:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281317376 00000100:00100000:3.0:1782481144.941226:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:3.0:1782481144.941235:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b882d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+10:18767:x1869066281317376:12345-192.168.204.11@tcp:101:lctl.0 00010000:00010000:3.0:1782481144.941259:0:24474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481144.941279:0:24474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee4964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df737 expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.941336:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee496b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.941350:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee496b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.941361:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee496b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782481144.941431:0:24474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782481144.941435:0:24474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782481144.941467:0:24474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee496b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.941491:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee4964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df737 expref: 12 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.941509:0:24474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79abc00/0x65dae4c042ee496b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df737 expref: 11 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.941531:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbc900) 00010000:00010000:3.0:1782481144.941534:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782481144.941537:0:24474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79abc00, rc 0) 00000100:00100000:3.0:1782481144.941608:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b882d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+11:18767:x1869066281317376:12345-192.168.204.11@tcp:101:lctl.0 Request processed in 373us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.941615:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:3.0:1782481144.961601:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481144.962764:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281317504 00000100:00100000:1.0:1782481144.962777:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281317504 00000100:00100000:1.0:1782481144.962847:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:1.0:1782481144.962859:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:18768:x1869066281317504:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1782481144.962879:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481144.962901:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74600/0x65dae4c042ee4972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df73e expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481144.962965:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75800/0x65dae4c042ee4979 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481144.962980:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75800/0x65dae4c042ee4979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481144.962993:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75800/0x65dae4c042ee4979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782481144.963033:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782481144.963037:0:22660:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782481144.963057:0:22660:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75800/0x65dae4c042ee4979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481144.963086:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74600/0x65dae4c042ee4972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df73e expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481144.963104:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75800/0x65dae4c042ee4979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df73e expref: 6 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481144.963132:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbc900) 00010000:00010000:1.0:1782481144.963135:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782481144.963139:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca7d75800, rc 0) 00000100:00100000:1.0:1782481144.963208:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:18768:x1869066281317504:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 351us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481144.963215:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:1.0:1782481144.974173:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.974444:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281317632 00000100:00100000:3.0:1782481144.974454:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281317632 00000100:00100000:3.0:1782481144.974518:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:3.0:1782481144.974530:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:18768:x1869066281317632:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1782481144.974551:0:24474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481144.974573:0:24474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee4980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df745 expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974639:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974653:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974664:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974676:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974684:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974735:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974818:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa200/0x65dae4c042ee4995 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974827:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa200/0x65dae4c042ee4995 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974834:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa200/0x65dae4c042ee4995 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782481144.974869:0:24474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782481144.974874:0:24474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782481144.974898:0:24474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa200/0x65dae4c042ee4995 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974910:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974915:0:24474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974921:0:24474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974926:0:24474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aaa00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1782481144.974929:0:24474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974936:0:24474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974954:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbc900) 00010000:00010000:3.0:1782481144.974957:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782481144.974962:0:24474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974967:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aaa00/0x65dae4c042ee4987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974980:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974985:0:24474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974991:0:24474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.974995:0:24474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1782481144.974998:0:24474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.975003:0:24474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.975008:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f5c912e1500) 00010000:00010000:3.0:1782481144.975010:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782481144.975013:0:24474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.975017:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee498e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.975054:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee4980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df745 expref: 8 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.975066:0:24474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa200/0x65dae4c042ee4995 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df745 expref: 7 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481144.975074:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:3.0:1782481144.975076:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782481144.975078:0:24474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79aa200, rc 0) 00000100:00100000:3.0:1782481144.976365:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+7:18768:x1869066281317632:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1830us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.976376:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:2.0:1782481144.983510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481144.983958:0:23419:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281317760 00000100:00100000:3.0:1782481144.983969:0:23419:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281317760 00000100:00100000:3.0:1782481144.984092:0:23419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:3.0:1782481144.984115:0:23419:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:18768:x1869066281317760:12345-192.168.204.11@tcp:900:lfs.0 00000100:00100000:3.0:1782481144.984211:0:23419:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:18768:x1869066281317760:12345-192.168.204.11@tcp:900:lfs.0 Request processed in 109us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481144.984219:0:23419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00080000:2.0:1782481144.985063:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782481144.997238:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481144.999750:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281318016 00000100:00100000:0.0:1782481144.999765:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281318016 00000100:00100000:0.0:1782481144.999848:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:0.0:1782481144.999860:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b88816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+7:18768:x1869066281318016:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1782481144.999886:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481144.999908:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031e00/0x65dae4c042ee499c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df74c expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782481145.000265:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782481145.000372:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031e00/0x65dae4c042ee499c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df74c expref: 9 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.000455:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbc900) 00010000:00010000:0.0:1782481145.000458:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782481145.000464:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031e00/0x65dae4c042ee499c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df74c expref: 9 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.000479:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c80031e00, rc 0) 00000100:00100000:0.0:1782481145.000554:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b88816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+8:18768:x1869066281318016:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 696us (3324us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1782481145.000562:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:1.0:1782481145.003129:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481145.003197:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281318272 00000100:00100000:0.0:1782481145.003206:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281318272 00000100:00100000:0.0:1782481145.003266:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:0.0:1782481145.003277:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+8:18768:x1869066281318272:12345-192.168.204.11@tcp:36:lfs.0 00010000:00010000:0.0:1782481145.003328:0:22659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782481145.003355:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa200/0x65dae4c042ee4995 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df745 expref: 8 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.003387:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:0.0:1782481145.003402:0:22659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782481145.003538:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.003552:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.003562:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782481145.004258:0:22659:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000985d9a9 reply state 00000000e00d8da7 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.004276:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.004284:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:0.0:1782481145.004286:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1782481145.004289:0:22659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782481145.004298:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782481145.004385:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+9:18768:x1869066281318272:12345-192.168.204.11@tcp:36:lfs.0 Request processed in 1108us (1263us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1782481145.004401:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:2.0:1782481145.007816:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481145.007979:0:22662:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281318528 00000100:00100000:3.0:1782481145.007990:0:22662:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281318528 00000100:00100000:3.0:1782481145.008052:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:3.0:1782481145.008063:0:22662:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+9:18768:x1869066281318528:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1782481145.008297:0:22662:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+10:18768:x1869066281318528:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 235us (490us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1782481145.008323:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:1.0:1782481145.014065:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481145.014313:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281318784 00000100:00100000:2.0:1782481145.014324:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281318784 00000100:00100000:2.0:1782481145.014378:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:2.0:1782481145.014464:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+10:18768:x1869066281318784:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1782481145.014492:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481145.014514:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5400/0x65dae4c042ee49b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df753 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.014590:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.014604:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.014615:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.014626:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.014652:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.014659:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481145.015569:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782481145.015652:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.015662:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.015670:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.015676:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481145.015680:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.015687:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.015736:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbc900) 00010000:00010000:2.0:1782481145.015739:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481145.015744:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.015749:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee49b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.015776:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.015781:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.016318:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.016327:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481145.016331:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.016339:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.016350:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f5c912e1500) 00010000:00010000:2.0:1782481145.016353:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481145.016356:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.016361:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee49bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.016591:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5400/0x65dae4c042ee49b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df753 expref: 12 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.016602:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbc900) 00010000:00010000:2.0:1782481145.016605:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782481145.016620:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5400/0x65dae4c042ee49b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df753 expref: 12 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.016631:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb5400, rc 0) 00000100:00100000:2.0:1782481145.016780:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+11:18768:x1869066281318784:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 2321us (2723us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1782481145.016797:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:1.0:1782481145.022333:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481145.022509:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281318912 00000100:00100000:3.0:1782481145.022759:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281318912 00000100:00100000:3.0:1782481145.023275:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:3.0:1782481145.023287:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+11:18768:x1869066281318912:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1782481145.023314:0:24474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481145.023337:0:24474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee49cd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df75a expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.023557:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.023572:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.023583:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782481145.023605:0:24474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782481145.023608:0:24474:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782481145.023912:0:24474:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.023938:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab200/0x65dae4c042ee49cd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df75a expref: 13 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.023954:0:24474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df75a expref: 12 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.023980:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:3.0:1782481145.023983:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782481145.023987:0:24474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79aa800, rc 0) 00000100:00100000:3.0:1782481145.024037:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+12:18768:x1869066281318912:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 754us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481145.024045:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:1.0:1782481145.036891:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481145.037145:0:22663:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281319040 00000100:00100000:3.0:1782481145.037156:0:22663:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281319040 00000100:00100000:3.0:1782481145.037224:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:3.0:1782481145.037235:0:22663:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+12:18768:x1869066281319040:12345-192.168.204.11@tcp:37:lfs.0 00000100:00100000:3.0:1782481145.042565:0:22663:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+12:18768:x1869066281319040:12345-192.168.204.11@tcp:37:lfs.0 Request processed in 5320us (5673us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481145.042657:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:1.0:1782481145.047897:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481145.048105:0:22662:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281319296 00000100:00100000:3.0:1782481145.048115:0:22662:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281319296 00000100:00100000:3.0:1782481145.048183:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:3.0:1782481145.048194:0:22662:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cc1cbc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+12:18768:x1869066281319296:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1782481145.048432:0:22662:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cc1cbc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+13:18768:x1869066281319296:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 238us (544us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1782481145.048818:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 10000000:01000000:3.0:1782481145.115849:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782481145.115860:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5ca5d2c000 from 13 10000000:01000000:3.0:1782481145.115867:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782481145.115949:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab200/0x65dae4c042ee49db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.115984:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab200/0x65dae4c042ee49db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.115997:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab200/0x65dae4c042ee49db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.116029:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301344640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.116155:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481145.116219:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1782481145.116882:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301344640 00000100:00100000:0.0:1782481145.116898:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301344640 00000100:00100000:0.0:1782481145.116988:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1782481145.117000:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+20:22656:x1869066301344640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481145.117019:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481145.117049:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee49e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee49db expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.117083:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee49e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee49db expref: 21 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.117094:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5c80031e00/0x65dae4c042ee49e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee49db expref: 21 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.117105:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c80031e00, rc 0) 00000100:00100000:0.0:1782481145.117178:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:22656:x1869066301344640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481145.117186:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782481145.117219:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301344640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481145.117238:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab200/0x65dae4c042ee49db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee49e2 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.117247:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab200/0x65dae4c042ee49db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee49e2 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.117329:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301344768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.117364:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481145.117474:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1782481145.125991:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301344768 00000100:00100000:0.0:1782481145.126016:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301344768 00000100:00100000:0.0:1782481145.126184:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782481145.126197:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:22656:x1869066301344768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782481145.126473:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:22656:x1869066301344768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (9105us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.126483:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782481145.126606:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301344768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.126668:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301344896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.128468:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481145.138418:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1782481145.139131:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301344896 00000100:00100000:1.0:1782481145.139143:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301344896 00000100:00100000:1.0:1782481145.139197:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782481145.139205:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:22656:x1869066301344896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782481145.139360:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:22656:x1869066301344896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (10899us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.139368:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782481145.140262:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301344896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782481145.142179:0:25702:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1782481145.142351:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1782481145.142372:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782481145.142388:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab200/0x65dae4c042ee49db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee49e2 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.142570:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab200/0x65dae4c042ee49db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee49e2 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782481145.142650:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782481145.142654:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5cb8c99800 from 13 10000000:01000000:1.0:1782481145.142657:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782481145.142729:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee49e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.142739:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee49e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.142750:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee49e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481145.142773:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782481145.143211:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481145.143252:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782481145.143417:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301345024 00000100:00100000:3.0:1782481145.143426:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301345024 00000100:00100000:3.0:1782481145.143478:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782481145.143488:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+21:22656:x1869066301345024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481145.143502:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481145.143515:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5cb79aaa00/0x65dae4c042ee49f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee49e9 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.143539:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5cb79aaa00/0x65dae4c042ee49f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee49e9 expref: 22 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.143551:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5cb79aaa00/0x65dae4c042ee49f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee49e9 expref: 22 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.143559:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79aaa00, rc 0) 00000100:00100000:3.0:1782481145.143610:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:22656:x1869066301345024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481145.143617:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1782481145.146425:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782481145.146469:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee49e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee49f0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.146482:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee49e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee49f0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481145.147060:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782481145.147152:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481145.147206:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782481145.147302:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301345152 00000100:00100000:3.0:1782481145.147309:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301345152 00000100:00100000:3.0:1782481145.147354:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782481145.147364:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:22656:x1869066301345152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.147526:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:22656:x1869066301345152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481145.147534:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782481145.148061:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782481145.148123:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782481145.148163:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481145.148192:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782481145.148277:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301345280 00000100:00100000:3.0:1782481145.148283:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301345280 00000100:00100000:3.0:1782481145.148305:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1782481145.148311:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:22656:x1869066301345280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.148397:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:22656:x1869066301345280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481145.148404:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782481145.148550:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782481145.150210:0:25703:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782481145.151121:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782481145.151154:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782481145.151168:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee49e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee49f0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.151181:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5ca7d75c00/0x65dae4c042ee49e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee49f0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481145.151193:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782481145.151196:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5b85b56800 from 13 10000000:01000000:3.0:1782481145.151199:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782481145.151245:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee49f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.151254:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee49f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.151265:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee49f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.151290:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.151360:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481145.151474:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cc300 going to sleep for 11 seconds 00000100:00100000:0.0:1782481145.151727:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301345408 00000100:00100000:0.0:1782481145.151735:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301345408 00000100:00100000:1.0:1782481145.152034:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1782481145.152045:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+22:22656:x1869066301345408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782481145.152060:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481145.152074:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca7d74800/0x65dae4c042ee49fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee49f7 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.152097:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca7d74800/0x65dae4c042ee49fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee49f7 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.152109:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca7d74800/0x65dae4c042ee49fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee49f7 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.152118:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca7d74800, rc 0) 00000100:00100000:1.0:1782481145.152206:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301345408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.152213:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782481145.152516:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481145.152533:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee49f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee49fe expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.152556:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee49f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee49fe expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.152996:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.153038:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481145.153109:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cc300 going to sleep for 11 seconds 00000100:00100000:1.0:1782481145.153143:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301345536 00000100:00100000:1.0:1782481145.153149:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301345536 00000100:00100000:1.0:1782481145.153230:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782481145.153238:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301345536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782481145.153366:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301345536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.153374:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782481145.153456:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.153492:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.153533:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481145.154296:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cc300 going to sleep for 11 seconds 00000100:00100000:0.0:1782481145.154675:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301345664 00000100:00100000:0.0:1782481145.154683:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301345664 00000100:00100000:0.0:1782481145.154762:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1782481145.154771:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301345664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481145.154921:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301345664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481145.154928:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782481145.155223:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782481145.156380:0:25704:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782481145.156482:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782481145.156501:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782481145.156512:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee49f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee49fe expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.156523:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5cb79ab000/0x65dae4c042ee49f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee49fe expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481145.156533:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782481145.156536:0:22656:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9f5cb59c2800 from 13 10000000:01000000:3.0:1782481145.156539:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782481145.156573:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee4a05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.156606:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee4a05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.156617:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee4a05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.156639:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.157042:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481145.157182:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301345792 00000100:00100000:1.0:1782481145.157191:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301345792 00000100:00100000:3.0:1782481145.157568:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cc180 going to sleep for 11 seconds 00000100:00100000:1.0:1782481145.158107:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782481145.158123:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+23:22656:x1869066301345792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782481145.158141:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481145.158161:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f5ca7d74600/0x65dae4c042ee4a0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x65dae4c042ee4a05 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.158187:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f5ca7d74600/0x65dae4c042ee4a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65dae4c042ee4a05 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.158199:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f5ca7d74600/0x65dae4c042ee4a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65dae4c042ee4a05 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.158207:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca7d74600, rc 0) 00000100:00100000:1.0:1782481145.158278:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:22656:x1869066301345792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.158284:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782481145.158360:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481145.158377:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee4a05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4a0c expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.158387:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee4a05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x65dae4c042ee4a0c expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.158489:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.158518:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481145.158999:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cc180 going to sleep for 11 seconds 00000100:00100000:2.0:1782481145.161748:0:22653:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301345920 00000100:00100000:2.0:1782481145.161763:0:22653:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301345920 00000100:00100000:2.0:1782481145.161907:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782481145.161918:0:22653:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:22656:x1869066301345920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782481145.162109:0:22653:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:22656:x1869066301345920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (3589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481145.162117:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1782481145.162127:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301345920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.162182:0:22656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301346048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782481145.162243:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481145.162268:0:22656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cc180 going to sleep for 11 seconds 00000100:00100000:0.0:1782481145.163146:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301346048 00000100:00100000:0.0:1782481145.163155:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301346048 00000100:00100000:0.0:1782481145.163195:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782481145.163214:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:22656:x1869066301346048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481145.163339:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:22656:x1869066301346048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481145.163346:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1782481145.163459:0:22656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:93f44a9c-11b5-4eed-b910-753bd776bd7b:22656:1869066301346048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782481145.167930:0:25705:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1782481145.168485:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1782481145.168533:0:22656:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782481145.168547:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee4a05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4a0c expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.168559:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9f5cb79aa600/0x65dae4c042ee4a05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x65dae4c042ee4a0c expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481145.187093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481145.187469:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281319424 00000100:00100000:0.0:1782481145.187482:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281319424 00000100:00100000:0.0:1782481145.187586:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:0.0:1782481145.187598:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+11:18774:x1869066281319424:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:0.0:1782481145.187618:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481145.187638:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030e00/0x65dae4c042ee4a13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df761 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.187738:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.187753:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.187764:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.187774:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.187780:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.187786:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.187898:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c000/0x65dae4c042ee4a28 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.187908:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c000/0x65dae4c042ee4a28 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.187915:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c000/0x65dae4c042ee4a28 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782481145.187956:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782481145.187960:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782481145.187998:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c000/0x65dae4c042ee4a28 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188009:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188015:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188022:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188028:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481145.188033:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188040:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188055:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbc900) 00010000:00010000:0.0:1782481145.188064:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481145.188071:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188078:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030200/0x65dae4c042ee4a1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188093:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188099:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188104:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188109:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80031000 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481145.188111:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188117:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188125:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f5c912e1500) 00010000:00010000:0.0:1782481145.188127:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481145.188130:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188135:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031000/0x65dae4c042ee4a21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188163:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030e00/0x65dae4c042ee4a13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df761 expref: 13 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188190:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c000/0x65dae4c042ee4a28 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df761 expref: 12 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.188196:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:0.0:1782481145.188199:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782481145.188201:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111c000, rc 0) 00000100:00100000:0.0:1782481145.188276:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+12:18774:x1869066281319424:12345-192.168.204.11@tcp:101:bash.0 Request processed in 680us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481145.188284:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:2.0:1782481145.194010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481145.194076:0:22670:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281319552 00000100:00100000:1.0:1782481145.194087:0:22670:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281319552 00000100:00100000:1.0:1782481145.194140:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1782481145.194150:0:22670:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:18774:x1869066281319552:12345-192.168.204.11@tcp:900:bash.0 00000100:00100000:1.0:1782481145.194241:0:22670:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:18774:x1869066281319552:12345-192.168.204.11@tcp:900:bash.0 Request processed in 92us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.194248:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1782481145.198637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481145.198944:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281319808 00000100:00100000:3.0:1782481145.198957:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281319808 00000100:00100000:0.0:1782481145.199958:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:0.0:1782481145.199976:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+12:18774:x1869066281319808:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:0.0:1782481145.199996:0:24474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481145.200017:0:24474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111cc00/0x65dae4c042ee4a2f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df768 expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.200142:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.200157:0:24474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df75a expref: 12 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.200165:0:24474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.200196:0:24474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df75a expref: 12 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.200229:0:24474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df75a expref: 12 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481145.200254:0:24474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c885b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24474:1869066301346176:192.168.204.11@tcp:104: 00000100:00100000:0.0:1782481145.200344:0:24474:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b810dc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782481145.205179:0:24474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c885b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24474:1869066301346176:192.168.204.11@tcp:104: 00010000:00010000:2.0:1782481145.205215:0:24474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481145.206111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481145.206235:0:22647:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281319936 00000100:00100000:3.0:1782481145.206324:0:22647:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281319936 00010000:00010000:3.0:1782481145.206368:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df75a expref: 13 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.206866:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:3.0:1782481145.206878:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+13:2405:x1869066281319936:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782481145.206895:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481145.206911:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df75a expref: 13 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.206927:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df75a expref: 13 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.206950:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee49d4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df75a expref: 13 pid: 24474 timeout: 861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.206967:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:3.0:1782481145.206972:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.206999:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.207009:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.207048:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481145.207217:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+12:2405:x1869066281319936:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 340us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481145.207224:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00010000:00010000:0.0:1782481145.207356:0:24474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.207364:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.207415:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.207425:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.207434:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.207982:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.207996:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208004:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782481145.208015:0:24474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782481145.208054:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208062:0:24474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208070:0:24474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208078:0:24474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111c800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481145.208082:0:24474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208090:0:24474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208100:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:0.0:1782481145.208103:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481145.208107:0:24474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208113:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a36 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782481145.208123:0:24474:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b74f53d4 reply state 0000000064438dbc transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208134:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208140:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f5c912e1100) 00010000:00010000:0.0:1782481145.208142:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782481145.208153:0:24474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782481145.208195:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111cc00/0x65dae4c042ee4a2f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df768 expref: 15 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208208:0:24474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df768 expref: 14 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.208215:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:0.0:1782481145.208217:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1782481145.208219:0:24474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111c600, rc 0) 00000100:00100000:0.0:1782481145.208844:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+15:18774:x1869066281319808:12345-192.168.204.11@tcp:101:bash.0 Request processed in 8871us (10217us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1782481145.208854:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:3.0:1782481145.228642:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481145.228733:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281320064 00000100:00100000:0.0:1782481145.228744:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281320064 00000100:00100000:0.0:1782481145.229737:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:0.0:1782481145.229753:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+15:18774:x1869066281320064:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:0.0:1782481145.229773:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481145.229789:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111cc00/0x65dae4c042ee4a52 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df76f expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.229851:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.229865:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.229875:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782481145.229939:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782481145.229943:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782481145.229961:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.229970:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.229988:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111cc00/0x65dae4c042ee4a52 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df76f expref: 17 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.230001:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df76f expref: 16 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.230008:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:0.0:1782481145.230010:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782481145.230012:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c9111c800, rc 0) 00000100:00100000:0.0:1782481145.230069:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+16:18774:x1869066281320064:12345-192.168.204.11@tcp:101:bash.0 Request processed in 323us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481145.230076:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:0.0:1782481145.236168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481145.236398:0:22663:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281320320 00000100:00100000:1.0:1782481145.236417:0:22663:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281320320 00000100:00100000:1.0:1782481145.236476:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:1.0:1782481145.236486:0:22663:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+16:18774:x1869066281320320:12345-192.168.204.11@tcp:35:bash.0 00000001:00080000:1.0:1782481145.236782:0:22663:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:1.0:1782481145.236887:0:22663:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+18:18774:x1869066281320320:12345-192.168.204.11@tcp:35:bash.0 Request processed in 402us (729us total) trans 12884901898 rc 0/0 00000100:00100000:1.0:1782481145.236895:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000020:00080000:1.0:1782481145.236900:0:22663:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782481145.243865:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481145.344205:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481145.344359:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281320576 00000100:00100000:2.0:1782481145.344369:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281320576 00000100:00100000:2.0:1782481145.344439:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:2.0:1782481145.344450:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+18:18784:x1869066281320576:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1782481145.344475:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481145.344496:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4a60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df776 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481145.344631:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782481145.344779:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4a60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df776 expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.344794:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f5c90fbc900) 00010000:00010000:2.0:1782481145.344797:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782481145.344802:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4a60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df776 expref: 20 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.344818:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4000, rc 0) 00000100:00100000:2.0:1782481145.344891:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+19:18784:x1869066281320576:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 443us (705us total) trans 12884901899 rc 301/301 00000100:00100000:2.0:1782481145.344900:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:3.0:1782481145.347459:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481145.347574:0:22662:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281320832 00000100:00100000:1.0:1782481145.347583:0:22662:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281320832 00000100:00100000:1.0:1782481145.347646:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1782481145.347673:0:22662:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+19:18784:x1869066281320832:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:1.0:1782481145.347939:0:22662:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+20:18784:x1869066281320832:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 274us (487us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1782481145.347946:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1782481145.392421:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481145.392533:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281321088 00000100:00100000:2.0:1782481145.392544:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281321088 00000100:00100000:2.0:1782481145.392611:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:2.0:1782481145.392621:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+20:18787:x1869066281321088:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1782481145.392647:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481145.392679:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4a6e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df77d expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.392831:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4a75 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.392860:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4a75 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.392892:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4a75 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481145.392907:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782481145.393049:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4a6e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df77d expref: 23 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.393073:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4a75 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df77d expref: 22 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.393081:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:2.0:1782481145.393084:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782481145.393087:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb5800, rc 0) 00000100:00100000:2.0:1782481145.393556:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+22:18787:x1869066281321088:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 932us (1151us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1782481145.393565:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:0.0:1782481145.401363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481145.401657:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281321216 00000100:00100000:1.0:1782481145.401669:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281321216 00000100:00100000:1.0:1782481145.401876:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:1.0:1782481145.401887:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+22:18787:x1869066281321216:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:1.0:1782481145.401990:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.402008:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.402029:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.402073:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.402080:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.402096:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.402103:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d75200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1782481145.402108:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.402116:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.402128:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:1.0:1782481145.402131:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782481145.402135:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.402142:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4a83 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481145.402255:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481145.402287:0:22645:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281321344 00000100:00100000:0.0:1782481145.402292:0:22645:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281321344 00000100:00100000:0.0:1782481145.402329:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:0.0:1782481145.402336:0:22645:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+23:2405:x1869066281321344:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782481145.402355:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782481145.402371:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4a75 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df77d expref: 23 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481145.402386:0:22645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:0.0:1782481145.402389:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782481145.402458:0:22645:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+22:2405:x1869066281321344:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 122us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481145.402476:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:1.0:1782481145.402824:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+21:18787:x1869066281321216:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 939us (1868us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.402829:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:0.0:1782481145.416279:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481145.416586:0:22662:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281321600 00000100:00100000:1.0:1782481145.416596:0:22662:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281321600 00000100:00100000:1.0:1782481145.416658:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1782481145.416670:0:22662:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+21:18787:x1869066281321600:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:1.0:1782481145.416923:0:22662:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+22:18787:x1869066281321600:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 255us (652us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1782481145.416933:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000040:00080000:3.0:1782481145.759818:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782481145.806060:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481145.815470:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281321856 00000100:00100000:2.0:1782481145.815486:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281321856 00000100:00100000:2.0:1782481145.815573:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:2.0:1782481145.815583:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+22:18818:x1869066281321856:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:2.0:1782481145.816330:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481145.816356:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4a8a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df784 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.817314:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4a91 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.817347:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4a91 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.817361:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4a91 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481145.817862:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782481145.818880:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4a8a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df784 expref: 25 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.818905:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4a91 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df784 expref: 24 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.818914:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:2.0:1782481145.818917:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782481145.818921:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4800, rc 0) 00000100:00100000:2.0:1782481145.819558:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+24:18818:x1869066281321856:12345-192.168.204.11@tcp:101:cat.0 Request processed in 3972us (13503us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1782481145.819568:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:2.0:1782481145.822059:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782481145.822081:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301346304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782481145.822160:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481145.822210:0:22665:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301346304 00000100:00100000:2.0:1782481145.822216:0:22665:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301346304 00000100:00100000:2.0:1782481145.822270:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782481145.822278:0:22665:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301346304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782481145.822313:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1782481145.822383:0:22665:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301346304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481145.822390:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782481145.822442:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301346304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782481145.823851:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301346432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782481145.823900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481145.823958:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301346432 00000100:00100000:3.0:1782481145.823964:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301346432 00000100:00100000:3.0:1782481145.824009:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782481145.824016:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301346432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782481145.824039:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782481145.824076:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301346432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481145.824082:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1782481145.824113:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782481145.824141:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301346432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782481145.825048:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782481145.825060:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301346560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782481145.825109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481145.825143:0:23400:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301346560 00000100:00100000:1.0:1782481145.825147:0:23400:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301346560 00000100:00100000:1.0:1782481145.825180:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782481145.825189:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301346560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782481145.825215:0:23400:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1782481145.825265:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869066301346560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.825272:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782481145.825309:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1869066301346560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782481145.836546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481145.836603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481145.836650:0:22662:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281322112 00000100:00100000:1.0:1782481145.836659:0:22662:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281322112 00000100:00100000:1.0:1782481145.836948:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:1.0:1782481145.836969:0:22662:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+24:18818:x1869066281322112:12345-192.168.204.11@tcp:35:cat.0 00000100:00100000:1.0:1782481145.837476:0:22662:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+25:18818:x1869066281322112:12345-192.168.204.11@tcp:35:cat.0 Request processed in 507us (938us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1782481145.837485:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1782481145.837816:0:22647:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281322240 00000100:00100000:3.0:1782481145.837831:0:22647:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281322240 00000100:00100000:3.0:1782481145.837879:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:3.0:1782481145.837887:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+25:2405:x1869066281322240:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782481145.837898:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481145.837920:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4a91 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df784 expref: 25 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.837938:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:3.0:1782481145.837943:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481145.837965:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+24:2405:x1869066281322240:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 79us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481145.837972:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:0.0:1782481145.911648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481145.911762:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281322496 00000100:00100000:3.0:1782481145.911772:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281322496 00000100:00100000:3.0:1782481145.911842:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:3.0:1782481145.911853:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+24:18824:x1869066281322496:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:3.0:1782481145.911878:0:24474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481145.911898:0:24474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4a9f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df78b expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.912006:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.912021:0:24474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df768 expref: 25 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.912029:0:24474:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df76f expref: 25 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.912056:0:24474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.913548:0:24474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df76f expref: 25 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.913570:0:24474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df76f expref: 25 pid: 22661 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.913586:0:24474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24474:1869066301346688:192.168.204.11@tcp:104: 00010000:00010000:3.0:1782481145.913686:0:24474:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df768 expref: 25 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.913720:0:24474:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df768 expref: 25 pid: 24474 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.913730:0:24474:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a35180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24474:1869066301346816:192.168.204.11@tcp:104: 00000100:00100000:3.0:1782481145.913759:0:24474:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832cc180 going to sleep for 11 seconds 00000100:00100000:0.0:1782481145.922081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481145.922128:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481145.922388:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281322624 00000100:00100000:2.0:1782481145.922409:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281322624 00010000:00010000:2.0:1782481145.922448:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df76f expref: 26 pid: 22661 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481145.922485:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281322752 00000100:00100000:2.0:1782481145.922488:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281322752 00010000:00010000:2.0:1782481145.922501:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df768 expref: 27 pid: 24474 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481145.922517:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:2.0:1782481145.922526:0:22646:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+27:2405:x1869066281322624:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481145.922541:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481145.922548:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df76f expref: 27 pid: 22661 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.922560:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df76f expref: 27 pid: 22661 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.922581:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:2.0:1782481145.922587:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.922595:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.922625:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481145.922675:0:22646:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+27:2405:x1869066281322624:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 149us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481145.922682:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:2.0:1782481145.922731:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:2.0:1782481145.922737:0:22646:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c8944f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+26:2405:x1869066281322752:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481145.922747:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481145.922752:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df768 expref: 26 pid: 24474 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.922771:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df768 expref: 26 pid: 24474 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.922782:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:2.0:1782481145.922785:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.922792:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.922799:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.922816:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481145.922834:0:22646:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c8944f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+26:2405:x1869066281322752:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 97us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481145.922841:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00010000:00010000:3.0:1782481145.923025:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c800/0x65dae4c042ee4a59 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df76f expref: 25 pid: 22661 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.923042:0:24474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24474:1869066301346688:192.168.204.11@tcp:104: 00010000:00010000:3.0:1782481145.923054:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4a44 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df768 expref: 24 pid: 24474 timeout: 862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481145.923077:0:24474:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a35180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24474:1869066301346816:192.168.204.11@tcp:104: 00010000:00010000:3.0:1782481145.923108:0:24474:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.923117:0:24474:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.923123:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782481145.923140:0:24474:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782481145.923787:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4a9f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df78b expref: 25 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.923804:0:24474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79ab800/0x65dae4c042ee4aa6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df78b expref: 24 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.923811:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:3.0:1782481145.923815:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782481145.923829:0:24474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cb79ab800, rc 0) 00000100:00100000:3.0:1782481145.923862:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+24:18824:x1869066281322496:12345-192.168.204.11@tcp:101:dd.0 Request processed in 12012us (12223us total) trans 12884901905 rc 0/0 00000100:00100000:3.0:1782481145.923870:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:0.0:1782481145.928060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481145.928259:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281322880 00000100:00100000:1.0:1782481145.928269:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281322880 00000100:00100000:1.0:1782481145.928329:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:1.0:1782481145.928340:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+24:18824:x1869066281322880:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:1.0:1782481145.928365:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481145.928503:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ab4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df792 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.928535:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.928549:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.928560:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.928676:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ab4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df792 expref: 26 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.928806:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df792 expref: 25 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.928815:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:1.0:1782481145.928825:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782481145.928829:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca7d74000, rc 0) 00000100:00100000:1.0:1782481145.928924:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+25:18824:x1869066281322880:12345-192.168.204.11@tcp:101:dd.0 Request processed in 586us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.928932:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:0.0:1782481145.932073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481145.932204:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281323136 00000100:00100000:1.0:1782481145.932213:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281323136 00000100:00100000:1.0:1782481145.932298:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:1.0:1782481145.932310:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+25:18824:x1869066281323136:12345-192.168.204.11@tcp:36:dd.0 00010000:00010000:1.0:1782481145.932596:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.932613:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.932625:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782481145.932668:0:22659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:1.0:1782481145.932713:0:22659:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004b78fae reply state 000000003480177c transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.932726:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.932734:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:1.0:1782481145.932737:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782481145.932740:0:22659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782481145.932872:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+28:18824:x1869066281323136:12345-192.168.204.11@tcp:36:dd.0 Request processed in 563us (807us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1782481145.932895:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 45 00000020:00080000:1.0:1782481145.932900:0:22659:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782481145.935041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481145.935134:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281323264 00000100:00100000:2.0:1782481145.935144:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281323264 00000100:00100000:2.0:1782481145.935202:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:2.0:1782481145.935212:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+28:18824:x1869066281323264:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:2.0:1782481145.935235:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481145.935254:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ac9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df799 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.935307:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ac9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df799 expref: 29 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.935321:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ac9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df799 expref: 29 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.935338:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:2.0:1782481145.935341:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782481145.935345:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4000, rc 0) 00000100:00100000:2.0:1782481145.935420:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+29:18824:x1869066281323264:12345-192.168.204.11@tcp:101:dd.0 Request processed in 210us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481145.935427:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:0.0:1782481145.944186:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481145.944336:0:22647:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281323520 00000100:00100000:1.0:1782481145.944346:0:22647:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281323520 00000100:00100000:1.0:1782481145.944430:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:1.0:1782481145.944442:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+29:18824:x1869066281323520:12345-192.168.204.11@tcp:103:dd.0 00010000:00010000:1.0:1782481145.944458:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481145.944484:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ac9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df799 expref: 29 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481145.944509:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:1.0:1782481145.944514:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481145.944575:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+28:18824:x1869066281323520:12345-192.168.204.11@tcp:103:dd.0 Request processed in 135us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481145.944582:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:0.0:1782481145.946776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481145.946982:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281323648 00000100:00100000:3.0:1782481145.946991:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281323648 00000100:00100000:3.0:1782481145.947033:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:3.0:1782481145.947042:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+28:18824:x1869066281323648:12345-192.168.204.11@tcp:58:dd.0 00010000:00010000:3.0:1782481145.947162:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.947178:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481145.947188:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782481145.948800:0:24474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782481145.948998:0:24474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1782481145.949132:0:24474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1782481145.949231:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+28:18824:x1869066281323648:12345-192.168.204.11@tcp:58:dd.0 Request processed in 2184us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481145.949241:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:0.0:1782481145.951660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481145.951774:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281323776 00000100:00100000:2.0:1782481145.951784:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281323776 00000100:00100000:2.0:1782481145.951852:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:2.0:1782481145.951876:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c885ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+28:18824:x1869066281323776:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:2.0:1782481145.951899:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481145.951919:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ad7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df7a0 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.951968:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.951981:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ad7 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a0 expref: 29 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.951999:0:22661:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.952012:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ad7 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a0 expref: 29 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.952024:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:2.0:1782481145.952027:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782481145.952030:0:22661:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ad7 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a0 expref: 29 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481145.952039:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4000, rc 0) 00000100:00100000:2.0:1782481145.952105:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c885ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+29:18824:x1869066281323776:12345-192.168.204.11@tcp:101:dd.0 Request processed in 230us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481145.952112:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00010000:00010000:3.0:1782481146.268742:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481146.332265:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c885b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869066301347328:0@lo:400:kworker.0 00000100:00100000:0.0:1782481146.332356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481146.332403:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1869066301347840:0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.332527:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c885b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301347200:0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.332558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481146.332577:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1869066301347712:0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.332596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481146.332632:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301347328 00000100:00100000:1.0:1782481146.332639:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301347328 00000100:00100000:1.0:1782481146.332679:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301347712 00000100:00100000:1.0:1782481146.332682:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301347712 00000100:00080000:1.0:1782481146.332730:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782481146.332759:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782481146.332767:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869066301347328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.332825:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869066301347328:12345-0@lo:400:kworker.0 Request processed in 59us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.332833:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782481146.332853:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782481146.332859:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869066301347712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.332889:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869066301347712:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.332895:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782481146.332934:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1869066301347712:0@lo:400:kworker.0 00000100:00100000:0.0:1782481146.333077:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481146.333124:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c885b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869066301347328:0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.333219:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301347840 00000100:00100000:1.0:1782481146.333224:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301347840 00000100:00100000:1.0:1782481146.333259:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782481146.333265:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869066301347840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.333298:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869066301347840:12345-0@lo:400:kworker.0 Request processed in 33us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.333304:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782481146.333494:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301347200 00000100:00100000:2.0:1782481146.333498:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301347200 00000100:00100000:2.0:1782481146.333547:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782481146.333555:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301347200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.333591:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301347200:12345-0@lo:400:kworker.0 Request processed in 38us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481146.333598:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782481146.333619:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c885bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301346944:0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.333649:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481146.333672:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301347456:0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.333712:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481146.333729:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1869066301347968:0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.333754:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481146.333769:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782481146.333774:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5c885bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301347072:0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.333799:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481146.333813:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301347584:0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.333832:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481146.333848:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b882abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1869066301348096:0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.333868:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481146.333889:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301347456 00000100:00100000:2.0:1782481146.333892:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301347456 00000100:00100000:2.0:1782481146.333911:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301347072 00000100:00100000:2.0:1782481146.333914:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301347072 00000100:00100000:2.0:1782481146.333931:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782481146.333937:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301347456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.333968:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301347456:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481146.333984:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782481146.333996:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782481146.334001:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301347072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.334028:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1869066301347072:12345-0@lo:400:kworker.0 Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481146.334035:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782481146.334062:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c885bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1869066301347072:0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.334072:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301347456:0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.334092:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301347968 00000100:00100000:2.0:1782481146.334095:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301347968 00000100:00100000:2.0:1782481146.334113:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301347584 00000100:00100000:2.0:1782481146.334115:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301347584 00000100:00100000:2.0:1782481146.334123:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301348096 00000100:00100000:2.0:1782481146.334125:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301348096 00000100:00100000:2.0:1782481146.334138:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782481146.334143:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869066301347968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.334267:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c885b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301347200:0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.334288:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782481146.334294:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869066301347584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.334327:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869066301347584:12345-0@lo:400:kworker.0 Request processed in 34us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.334333:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782481146.334345:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782481146.334352:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869066301348096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481146.334409:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869066301348096:12345-0@lo:400:kworker.0 Request processed in 58us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.334416:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782481146.334453:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869066301347584:0@lo:400:kworker.0 00010000:00080000:1.0:1782481146.334464:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b882abb80 x1869066301348096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481146.334474:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1869066301348096:0@lo:400:kworker.0 00000100:00100000:3.0:1782481146.334977:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301348224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782481146.335008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481146.335036:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301348224 00000100:00100000:3.0:1782481146.335041:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301348224 00000100:00100000:3.0:1782481146.335067:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782481146.335073:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301348224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782481146.335092:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1782481146.335124:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301348224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481146.335131:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782481146.335273:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301348480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782481146.335296:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481146.335357:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301348224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782481146.335369:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782481146.335374:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301348352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782481146.335406:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481146.336268:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301348480 00000100:00100000:3.0:1782481146.336274:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301348480 00000100:00100000:3.0:1782481146.336299:0:24168:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301348352 00000100:00100000:3.0:1782481146.336311:0:24168:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301348352 00000100:00100000:3.0:1782481146.336329:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782481146.336336:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301348480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782481146.336350:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1782481146.336405:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869066301348480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481146.336411:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782481146.336489:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782481146.336498:0:24168:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301348352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782481146.336509:0:24168:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1782481146.336541:0:24168:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869066301348352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481146.336548:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782481146.336580:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1869066301348480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782481146.336607:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1869066301348352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782481146.336727:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782481146.336733:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782481146.336735:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782481146.336737:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1782481146.336766:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f5b882ab100 x1869066301347840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481146.336779:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1869066301347840:0@lo:400:kworker.0 00000100:00100000:0.0:1782481146.336801:0:22652:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301346944 00000100:00100000:0.0:1782481146.336805:0:22652:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301346944 00000100:00100000:0.0:1782481146.336845:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782481146.336852:0:22652:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3649:x1869066301346944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481146.336904:0:22652:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:93f44a9c-11b5-4eed-b910-753bd776bd7b+24:3649:x1869066301346944:12345-0@lo:400:kworker.0 Request processed in 52us (3253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481146.336910:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1782481146.337019:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5c885bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:93f44a9c-11b5-4eed-b910-753bd776bd7b:3649:1869066301346944:0@lo:400:kworker.0 00000100:00100000:2.0:1782481146.339924:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869066301347968:12345-0@lo:400:kworker.0 Request processed in 5770us (6158us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481146.339939:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782481146.339978:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b882a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1869066301347968:0@lo:400:kworker.0 00000040:00080000:3.0:1782481146.781938:0:22695:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1782481146.781949:0:22695:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782481146.781976:0:22695:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1782481146.781985:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1782481146.782134:0:22695:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a36d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22695:1869066301348608:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782481146.782227:0:22695:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832ccc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782481146.790819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481146.791036:0:22695:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a36d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22695:1869066301348608:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782481146.791238:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281323904 00000100:00100000:1.0:1782481146.791245:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281323904 00000100:00100000:1.0:1782481146.791319:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:1.0:1782481146.791329:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+29:18825:x1869066281323904:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782481146.791370:0:22660:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782481146.791507:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+29:18825:x1869066281323904:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 179us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.791515:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00080000:0.0:1782481146.792512:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782481146.808632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481146.808725:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281324032 00000100:00100000:1.0:1782481146.808745:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281324032 00000100:00100000:1.0:1782481146.808808:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:1.0:1782481146.808831:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+29:18825:x1869066281324032:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782481146.808900:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.808917:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.808948:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.808966:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.808973:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.808980:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809003:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809012:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809019:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782481146.809063:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782481146.809068:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782481146.809083:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809094:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809101:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809121:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809127:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d75200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1782481146.809132:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809140:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809153:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f5c886fc500) 00010000:00010000:1.0:1782481146.809157:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481146.809162:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809169:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75200/0x65dae4c042ee4ade lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809181:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809187:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809193:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809214:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fdde400 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1782481146.809217:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809234:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809242:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9f5ca08c4700) 00010000:00010000:1.0:1782481146.809245:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481146.809248:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809254:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4ae5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809269:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.809276:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.810102:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.810113:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddfe00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1782481146.810118:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.810125:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.810136:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:1.0:1782481146.810139:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481146.810142:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.810339:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddfe00/0x65dae4c042ee4aec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481146.810501:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+29:18825:x1869066281324032:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 Request processed in 1680us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.810511:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:2.0:1782481146.814844:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481146.814925:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281324288 00000100:00100000:1.0:1782481146.814935:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281324288 00000100:00100000:1.0:1782481146.815005:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:1.0:1782481146.815017:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+29:18825:x1869066281324288:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782481146.815037:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481146.815056:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4af3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df7a7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816042:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816062:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816074:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782481146.816087:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782481146.816334:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816342:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816367:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816385:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddf600 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:1.0:1782481146.816390:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816399:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816412:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:1.0:1782481146.816736:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782481146.816742:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816750:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4afa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816802:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4af3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a7 expref: 31 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816813:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f5c886fc500) 00010000:00010000:1.0:1782481146.816816:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782481146.816820:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4af3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a7 expref: 31 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.816830:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddf200, rc 0) 00000100:00100000:1.0:1782481146.816906:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+30:18825:x1869066281324288:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 1891us (2072us total) trans 12884901908 rc 301/301 00000100:00100000:1.0:1782481146.816924:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:0.0:1782481146.821067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.821168:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281324416 00000100:00100000:2.0:1782481146.821178:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281324416 00000100:00100000:2.0:1782481146.821247:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:2.0:1782481146.821258:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+30:18825:x1869066281324416:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782481146.821297:0:24474:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782481146.821585:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+30:18825:x1869066281324416:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 328us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481146.821594:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:0.0:1782481146.834936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.835024:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281324672 00000100:00100000:2.0:1782481146.835036:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281324672 00000100:00100000:2.0:1782481146.835096:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:2.0:1782481146.835108:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+30:18825:x1869066281324672:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782481146.835128:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481146.835302:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b08 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df7ae expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782481146.839092:0:22660:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:2.0:1782481146.839108:0:22660:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1782481146.839211:0:22660:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1782481146.840084:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b0f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.840101:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b0f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.840113:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b0f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.840999:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b08 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ae expref: 33 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.841027:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b0f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ae expref: 32 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.841057:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5c886fca00) 00010000:00010000:2.0:1782481146.841060:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782481146.841064:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5ca6eb4200, rc 0) 00000100:00100000:2.0:1782481146.841372:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+32:18825:x1869066281324672:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 6265us (6442us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1782481146.841390:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:0.0:1782481146.853969:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.854146:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281324928 00000100:00100000:2.0:1782481146.854156:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281324928 00000100:00100000:2.0:1782481146.854209:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:2.0:1782481146.854220:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+32:18825:x1869066281324928:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782481146.854281:0:24474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481146.854308:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b0f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ae expref: 32 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854327:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5c886fca00) 00010000:00010000:2.0:1782481146.854338:0:24474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782481146.854359:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854383:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854394:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854409:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854457:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854464:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854515:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854523:0:24474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854530:0:24474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854536:0:24474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481146.854540:0:24474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854547:0:24474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854555:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:2.0:1782481146.854558:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481146.854561:0:24474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854567:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b1d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854577:0:24474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854589:0:24474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854594:0:24474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854599:0:24474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481146.854945:0:24474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854954:0:24474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854963:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd13de0b4 (ffff9f5c886fc800) 00010000:00010000:2.0:1782481146.854965:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481146.854968:0:24474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.854974:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b24 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd13de0b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481146.855068:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+31:18825:x1869066281324928:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 848us (1377us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782481146.855077:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:0.0:1782481146.858148:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481146.858230:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281325056 00000100:00100000:1.0:1782481146.858240:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281325056 00000100:00100000:1.0:1782481146.858297:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:1.0:1782481146.858307:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+31:18825:x1869066281325056:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782481146.858326:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481146.858346:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b2b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df7b5 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.858392:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4b32 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.858405:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4b32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.858416:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4b32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.858538:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b2b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7b5 expref: 33 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.858556:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf600/0x65dae4c042ee4b32 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7b5 expref: 32 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.858565:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:1.0:1782481146.858568:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782481146.858571:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddf600, rc 0) 00000100:00100000:1.0:1782481146.858645:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+32:18825:x1869066281325056:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 339us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.858659:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:3.0:1782481146.862762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.862814:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281325312 00000100:00100000:2.0:1782481146.862823:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281325312 00000100:00100000:2.0:1782481146.862879:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:2.0:1782481146.862888:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+32:18825:x1869066281325312:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782481146.862967:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.862996:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.863006:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782481146.863177:0:24474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1782481146.863188:0:24474:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763378493567ns, next at 764378491211ns, rc = 0 00000004:00010000:2.0:1782481146.863246:0:24474:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b77c6226 reply state 000000001f48bbd8 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.863259:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.863267:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:2.0:1782481146.863270:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782481146.863272:0:24474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782481146.863369:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+34:18825:x1869066281325312:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 481us (617us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1782481146.863386:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:0.0:1782481146.865295:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481146.865389:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281325440 00000100:00100000:1.0:1782481146.865398:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281325440 00000100:00100000:1.0:1782481146.865466:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:1.0:1782481146.865477:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+34:18825:x1869066281325440:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782481146.865498:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481146.865517:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df7bc expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.865566:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7bc expref: 35 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.865580:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7bc expref: 35 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.865597:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:1.0:1782481146.865600:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782481146.865616:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddf200, rc 0) 00000100:00100000:1.0:1782481146.865674:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+35:18825:x1869066281325440:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 198us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.865681:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:0.0:1782481146.868299:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.868402:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281325568 00000100:00100000:2.0:1782481146.868412:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281325568 00000100:00100000:2.0:1782481146.868502:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:2.0:1782481146.868511:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2405:x1869066281325568:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782481146.868791:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:2405:x1869066281325568:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 280us (500us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1782481146.868799:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00080000:0.0:1782481146.869581:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782481146.871814:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481146.872171:0:22662:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281325824 00000100:00100000:1.0:1782481146.872181:0:22662:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281325824 00000100:00100000:1.0:1782481146.872312:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1782481146.872323:0:22662:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+35:18825:x1869066281325824:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782481146.872549:0:22662:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+36:18825:x1869066281325824:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 227us (742us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1782481146.872569:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1782481146.879803:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.880240:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281326080 00000100:00100000:2.0:1782481146.880264:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281326080 00000100:00100000:2.0:1782481146.880329:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:2.0:1782481146.880340:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+36:18825:x1869066281326080:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782481146.880506:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+36:18825:x1869066281326080:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 167us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481146.880513:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:0.0:1782481146.885236:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481146.885389:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281326208 00000100:00100000:1.0:1782481146.885399:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281326208 00000100:00100000:1.0:1782481146.885470:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:1.0:1782481146.885481:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+36:18825:x1869066281326208:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782481146.885505:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481146.885525:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4b47 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df7c3 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.885616:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf400/0x65dae4c042ee4b4e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.885630:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf400/0x65dae4c042ee4b4e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.885643:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf400/0x65dae4c042ee4b4e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782481146.885731:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782481146.885753:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf400/0x65dae4c042ee4b4e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.885779:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fdde400/0x65dae4c042ee4b47 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7c3 expref: 38 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.885797:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf400/0x65dae4c042ee4b4e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7c3 expref: 37 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.885824:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:1.0:1782481146.885827:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782481146.885831:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddf400, rc 0) 00000100:00100000:1.0:1782481146.885883:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+37:18825:x1869066281326208:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 405us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.885891:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:3.0:1782481146.889955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481146.890961:0:24164:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281326336 00000100:00100000:1.0:1782481146.890975:0:24164:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281326336 00000100:00100000:1.0:1782481146.893255:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:1.0:1782481146.893279:0:24164:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+6:2404:x1869066281326336:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782481146.893300:0:24164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481146.893321:0:24164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df7ca expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782481146.893349:0:24164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e80fa, blocks: 0x0 00010000:00010000:1.0:1782481146.893370:0:24164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=763s v=(0 0) 00010000:00010000:1.0:1782481146.893384:0:24164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481146.893393:0:24164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ca expref: 7 pid: 24164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.893411:0:24164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ca expref: 7 pid: 24164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.893425:0:24164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddf800, rc 0) 00000100:00100000:1.0:1782481146.893501:0:24164:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:2404:x1869066281326336:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 233us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.893508:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:0.0:1782481146.900763:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.901941:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281326592 00000100:00100000:2.0:1782481146.901960:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281326592 00000100:00100000:2.0:1782481146.902036:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:2.0:1782481146.902047:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+37:18825:x1869066281326592:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782481146.902154:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+37:18825:x1869066281326592:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 108us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481146.902162:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:0.0:1782481146.910069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481146.910149:0:22659:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281326720 00000100:00100000:1.0:1782481146.910158:0:22659:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281326720 00000100:00100000:1.0:1782481146.910225:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:1.0:1782481146.910239:0:22659:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+37:18825:x1869066281326720:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782481146.921318:0:22640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:1.0:1782481146.921337:0:22640:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1782481146.921415:0:22640:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1782481146.921951:0:22659:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+19:18825:x1869066281326720:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 Request processed in 11338us (11516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.921963:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 61 00010000:00010000:3.0:1782481146.922299:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.922312:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.922320:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.922326:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030c00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:3.0:1782481146.922331:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.922339:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.922355:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:3.0:1782481146.922358:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782481146.922362:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.922369:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030c00/0x65dae4c042ee49aa lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481146.922420:0:3650:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301348736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782481146.922479:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782481146.922825:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922834:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922841:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922846:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80030800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481146.922850:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922857:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922866:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9f5c912e1500) 00010000:00010000:0.0:1782481146.922868:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481146.922872:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922882:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80030800/0x65dae4c042ee4956 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922900:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922907:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922912:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922929:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c80031200 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481146.922932:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922939:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922947:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9f5c912e1d00) 00010000:00010000:0.0:1782481146.922949:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481146.922952:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922958:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c80031200/0x65dae4c042ee495d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922971:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922976:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922981:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922987:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111ca00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481146.922989:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.922994:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923010:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9f5c912e1100) 00010000:00010000:0.0:1782481146.923013:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481146.923015:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923021:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111ca00/0x65dae4c042ee4a3d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923034:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923040:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923046:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923050:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca7d75a00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481146.923052:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923058:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923065:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:0.0:1782481146.923067:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481146.923070:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923075:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d75a00/0x65dae4c042ee4ac2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923097:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923103:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923109:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923114:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481146.923117:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923123:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923130:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:0.0:1782481146.923132:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782481146.923135:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.923139:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b39 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481146.923969:0:24746:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301348736 00000100:00100000:1.0:1782481146.923979:0:24746:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301348736 00000100:00100000:1.0:1782481146.924076:0:24746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782481146.924087:0:24746:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1869066301348736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1782481146.924220:0:24746:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782481146.924224:0:24746:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1782481146.924226:0:24746:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782481146.924228:0:24746:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1782481146 -> 1782481146 00002000:00010000:1.0:1782481146.924230:0:24746:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1782481146.924293:0:24746:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1869066301348736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (1814us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1782481146.924300:0:24746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1782481146.924519:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f5b87a14a80/2, rc 0, transno 12884901892 00000100:00100000:3.0:1782481146.924527:0:3650:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1869066301348736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782481146.926635:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.929288:0:25048:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281326848 00000100:00100000:2.0:1782481146.929329:0:25048:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281326848 00000100:00100000:2.0:1782481146.929413:0:25048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:2.0:1782481146.929430:0:25048:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:2405:x1869066281326848:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782481146.929537:0:25048:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:2405:x1869066281326848:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 Request processed in 108us (2911us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481146.929545:0:25048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:1.0:1782481146.937853:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.937941:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281327104 00000100:00100000:2.0:1782481146.937951:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281327104 00000100:00100000:2.0:1782481146.938006:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:2.0:1782481146.938015:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+15:18825:x1869066281327104:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782481146.938064:0:24474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481146.938102:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf400/0x65dae4c042ee4b4e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7c3 expref: 15 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.938122:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:2.0:1782481146.938127:0:24474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782481146.938153:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b5c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.938166:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.938176:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782481146.938308:0:24474:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093c76ce6 reply state 00000000a636d104 transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b5c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.938321:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4200/0x65dae4c042ee4b5c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.938327:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:2.0:1782481146.938329:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782481146.938332:0:24474:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782481146.938453:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+16:18825:x1869066281327104:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 438us (607us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1782481146.938462:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:2.0:1782481146.944073:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481146.944403:0:24164:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281327232 00000100:00100000:1.0:1782481146.944434:0:24164:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281327232 00000100:00100000:1.0:1782481146.944492:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:1.0:1782481146.944502:0:24164:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:18825:x1869066281327232:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782481146.944521:0:24164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481146.944538:0:24164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df7d1 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.944568:0:24164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ca expref: 8 pid: 24164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.944588:0:24164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481146.944593:0:24164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481146.944599:0:24164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 8 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.944636:0:24164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ca expref: 8 pid: 24164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.944650:0:24164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ca expref: 8 pid: 24164 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481146.944663:0:24164:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24164:1869066301348864:192.168.204.11@tcp:104: 00000100:00100000:1.0:1782481146.944769:0:24164:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5cbcf4cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782481146.947807:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481146.947924:0:22645:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281327360 00000100:00100000:0.0:1782481146.947933:0:22645:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281327360 00010000:00010000:0.0:1782481146.947973:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ca expref: 9 pid: 24164 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481146.948031:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:0.0:1782481146.948041:0:22645:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:2405:x1869066281327360:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782481146.948057:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782481146.948083:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ca expref: 9 pid: 24164 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.948096:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ca expref: 9 pid: 24164 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.948119:0:22645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481146.948123:0:22645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481146.948131:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 9 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.948141:0:22645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 9 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481146.948179:0:22645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 9 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481146.948193:0:22645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22645:1869066301348992:192.168.204.11@tcp:105: 00000100:00100000:0.0:1782481146.948285:0:22645:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b810dc540 going to sleep for 11 seconds 00010000:00010000:1.0:1782481146.948520:0:24164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037234495/0x65dae4c042ee4b55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7ca expref: 9 pid: 24164 timeout: 863 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481146.948548:0:24164:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24164:1869066301348864:192.168.204.11@tcp:104: 00010000:00010000:1.0:1782481146.948574:0:24164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 8 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481146.949530:0:24164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5c8fddfc00, rc 0) 00000100:00100000:1.0:1782481146.951254:0:24164:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+8:18825:x1869066281327232:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 6743us (7180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481146.951265:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:3.0:1782481146.965205:0:22645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:22645:1869066301348992:192.168.204.11@tcp:105: 00010000:00010000:3.0:1782481146.965242:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481146.965312:0:22645:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:2405:x1869066281327360:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 17271us (17513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481146.965324:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1782481146.965866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481146.965944:0:24167:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281327488 00000100:00100000:0.0:1782481146.965961:0:24167:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281327488 00000100:00100000:0.0:1782481146.966014:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:0.0:1782481146.966024:0:24167:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5ca5ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:2405:x1869066281327488:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782481146.966175:0:24167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782481146.966179:0:24167:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1782481145 00002000:00010000:0.0:1782481146.966181:0:24167:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1782481144 00002000:00010000:0.0:1782481146.966183:0:24167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1782481146 -> 1782481145 00002000:00010000:0.0:1782481146.966185:0:24167:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1782481146.966239:0:24167:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5ca5ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+8:2405:x1869066281327488:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 216us (373us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1782481146.966245:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:2.0:1782481146.969783:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481146.969862:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281327616 00000100:00100000:3.0:1782481146.969873:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281327616 00000100:00100000:3.0:1782481146.969932:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:3.0:1782481146.969944:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+8:2404:x1869066281327616:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782481146.969987:0:24166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.970008:0:24166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 8 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.970017:0:24166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481146.970022:0:24166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782481146.970026:0:24166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.970061:0:24166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 8 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.970088:0:24166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 8 pid: 24164 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481146.970122:0:24166:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24166:1869066301349120:192.168.204.11@tcp:104: 00000100:00100000:3.0:1782481146.970337:0:24166:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c832ccc00 going to sleep for 11 seconds 00000040:00080000:3.0:1782481146.974842:0:23418:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782481146.977357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.977531:0:22646:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281327744 00000100:00100000:2.0:1782481146.977555:0:22646:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281327744 00010000:00010000:2.0:1782481146.977594:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 9 pid: 24164 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481146.977641:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:2.0:1782481146.977650:0:22646:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:2404:x1869066281327744:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481146.977665:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481146.977687:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 9 pid: 24164 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.977740:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 9 pid: 24164 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.977764:0:22646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782481146.977769:0:22646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782481146.977775:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.977785:0:22646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.977808:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481146.977859:0:22646:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+9:2404:x1869066281327744:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 210us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481146.977867:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00010000:00010000:3.0:1782481146.978295:0:24166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd88ef1/0x65dae4c042ee4b63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d1 expref: 8 pid: 24164 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481146.978324:0:24166:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a36680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24166:1869066301349120:192.168.204.11@tcp:104: 00010000:00010000:3.0:1782481146.978519:0:24166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.978532:0:24166:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.978539:0:24166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.978559:0:24166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.978568:0:24166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.978576:0:24166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.978613:0:24166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:3.0:1782481146.978618:0:24166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.978628:0:24166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.978656:0:24166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.978678:0:24166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4b6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481146.978846:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:2404:x1869066281327616:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 Request processed in 8886us (9053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481146.978855:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:0.0:1782481146.984633:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481146.984986:0:22660:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281328000 00000100:00100000:2.0:1782481146.984997:0:22660:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281328000 00000100:00100000:2.0:1782481146.985073:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:2.0:1782481146.985083:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+16:18825:x1869066281328000:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782481146.985164:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.985180:0:22660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df792 expref: 16 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.985189:0:22660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.985224:0:22660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df792 expref: 16 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.985238:0:22660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df792 expref: 16 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481146.985252:0:22660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22660:1869066301349248:192.168.204.11@tcp:104: 00000100:00100000:2.0:1782481146.985338:0:22660:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f30240 going to sleep for 11 seconds 00000100:00100000:0.0:1782481146.989162:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1782481146.989323:0:22645:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281328128 00000100:00100000:3.0:1782481146.989333:0:22645:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281328128 00010000:00010000:3.0:1782481146.989421:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df792 expref: 17 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481146.989422:0:22660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22660:1869066301349248:192.168.204.11@tcp:104: 00010000:00010000:2.0:1782481146.989454:0:22660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481146.989457:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:3.0:1782481146.989466:0:22645:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+17:2404:x1869066281328128:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782481146.989481:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481146.989502:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df792 expref: 17 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.989514:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df792 expref: 17 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.989536:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca7d74000/0x65dae4c042ee4abb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df792 expref: 17 pid: 22660 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.990314:0:22645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:3.0:1782481146.990324:0:22645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ad7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a0 expref: 16 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.990335:0:22645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.990354:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.990369:0:22645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481146.990413:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481146.990464:0:22645:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+16:2404:x1869066281328128:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 998us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481146.990474:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00010000:00010000:2.0:1782481146.990897:0:22660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.990907:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.991135:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.991149:0:22660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7bc expref: 16 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.991157:0:22660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.991192:0:22660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7bc expref: 16 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481146.991657:0:22660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7bc expref: 16 pid: 22659 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481146.991674:0:22660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22660:1869066301349376:192.168.204.11@tcp:104: 00000100:00100000:2.0:1782481146.991782:0:22660:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90f30cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782481146.996731:0:22660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22660:1869066301349376:192.168.204.11@tcp:104: 00010000:00010000:2.0:1782481146.996763:0:22660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481147.000510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481147.000668:0:22647:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281328256 00000100:00100000:1.0:1782481147.000689:0:22647:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281328256 00010000:00010000:1.0:1782481147.000750:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7bc expref: 17 pid: 22659 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481147.000792:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:1.0:1782481147.000801:0:22647:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+17:2404:x1869066281328256:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782481147.000816:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481147.000823:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7bc expref: 17 pid: 22659 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481147.000837:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7bc expref: 17 pid: 22659 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481147.000871:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c8fddf200/0x65dae4c042ee4b40 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x33577da1469df7bc expref: 17 pid: 22659 timeout: 863 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481147.000903:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:1.0:1782481147.000908:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481147.005544:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481147.005561:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481147.005672:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481147.005767:0:22647:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+16:2404:x1869066281328256:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 4962us (5261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481147.005778:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00010000:00010000:2.0:1782481147.007791:0:22660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.007808:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782481147.007998:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1782481147.008498:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:2.0:1782481147.008539:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1782481147.008626:0:22660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5b87a14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22660:1869066301349504:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782481147.008993:0:22660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481147.009079:0:22660:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c90fa5780 going to sleep for 11 seconds 00000100:00100000:1.0:1782481147.009531:0:22664:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301349504 00000100:00100000:1.0:1782481147.009539:0:22664:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301349504 00000100:00100000:1.0:1782481147.009624:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782481147.009634:0:22664:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22660:x1869066301349504:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782481147.009756:0:22664:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22660:x1869066301349504:12345-0@lo:1000:mdt00_001.0 Request processed in 124us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481147.009764:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782481147.009867:0:22660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5b87a14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22660:1869066301349504:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1782481147.010035:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:3.0:1782481147.010115:0:22660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb7a36680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22660:1869066301349632:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782481147.010166:0:22660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481147.011464:0:23400:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066301349632 00000100:00100000:2.0:1782481147.011474:0:23400:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066301349632 00000100:00100000:2.0:1782481147.011523:0:23400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782481147.011533:0:23400:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb7a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22660:x1869066301349632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782481147.012038:0:23400:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb7a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22660:x1869066301349632:12345-0@lo:1000:mdt00_001.0 Request processed in 163us (1527us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1782481147.012048:0:23400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782481147.012683:0:22660:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5c87fc9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782481147.012995:0:22660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb7a36680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22660:1869066301349632:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1782481147.013050:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013060:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013189:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013196:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb5800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481147.013201:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013228:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013244:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:0.0:1782481147.013247:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782481147.013324:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013331:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5800/0x65dae4c042ee4b78 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013489:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013497:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013503:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013508:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:0.0:1782481147.013511:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013517:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013526:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:0.0:1782481147.013528:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782481147.013537:0:22660:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ad7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a0 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013562:0:22660:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ad7 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a0 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013571:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ad7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a0 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.013639:0:22660:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4000/0x65dae4c042ee4ad7 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7a0 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481147.013653:0:22660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9f5cb63d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22660:1869066301349760:192.168.204.11@tcp:105: 00000100:00100000:0.0:1782481147.013967:0:22660:0:(client.c:2701:ptlrpc_set_wait()) set ffff9f5b810dc000 going to sleep for 11 seconds 00000100:00100000:0.0:1782481147.018920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481147.018985:0:22662:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281328384 00000100:00100000:1.0:1782481147.018994:0:22662:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281328384 00000100:00100000:1.0:1782481147.019055:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:1.0:1782481147.019077:0:22662:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cc1cbfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+20:18824:x1869066281328384:12345-192.168.204.11@tcp:49:dd.0 00000100:00100000:1.0:1782481147.019213:0:22662:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cc1cbfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+20:18824:x1869066281328384:12345-192.168.204.11@tcp:49:dd.0 Request processed in 149us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481147.019237:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:2.0:1782481147.019622:0:22660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9f5cb63d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22660:1869066301349760:192.168.204.11@tcp:105: 00010000:00010000:2.0:1782481147.019650:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019662:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cb79aa800/0x65dae4c042ee4ad0 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019724:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019739:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019751:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019762:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019779:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019786:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019792:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4800 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481147.019796:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019804:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019816:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:2.0:1782481147.019820:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481147.019824:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019829:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4800/0x65dae4c042ee4b7f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019839:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019845:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019851:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019855:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5ca6eb4e00 already unused, calling callback (ffffffffc19e84f0) 00010000:00010000:2.0:1782481147.019864:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019870:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019878:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:2.0:1782481147.019881:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782481147.019884:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.019890:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb4e00/0x65dae4c042ee4b71 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481147.023739:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+19:18825:x1869066281328000:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 38645us (39103us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1782481147.023753:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 63 00000020:00080000:2.0:1782481147.023761:0:22660:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1782481147.023900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481147.024056:0:24474:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281328512 00000100:00100000:2.0:1782481147.024065:0:24474:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281328512 00000100:00100000:2.0:1782481147.024122:0:24474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 64 00000100:00100000:2.0:1782481147.024139:0:24474:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+19:18824:x1869066281328512:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:2.0:1782481147.024162:0:24474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481147.024184:0:24474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5400/0x65dae4c042ee4b86 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x33577da1469df7d8 expref: -99 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.024219:0:24474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cc2153e00/0x65dae4c042ee4b8d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.024233:0:24474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cc2153e00/0x65dae4c042ee4b8d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.024259:0:24474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cc2153e00/0x65dae4c042ee4b8d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.024398:0:24474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5ca6eb5400/0x65dae4c042ee4b86 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d8 expref: 21 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.024417:0:24474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5cc2153e00/0x65dae4c042ee4b8d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x33577da1469df7d8 expref: 20 pid: 24474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.024427:0:24474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9f5c912e1700) 00010000:00010000:2.0:1782481147.024430:0:24474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782481147.024434:0:24474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f5cc2153e00, rc 0) 00000100:00100000:2.0:1782481147.024474:0:24474:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+20:18824:x1869066281328512:12345-192.168.204.11@tcp:101:dd.0 Request processed in 337us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481147.024481:0:24474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 64 00000040:00080000:3.0:1782481147.026262:0:22695:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1782481147.026271:0:22695:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782481147.026288:0:22695:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1782481147.026293:0:22695:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1782481147.041032:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481147.041112:0:22662:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281328768 00000100:00100000:1.0:1782481147.041123:0:22662:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281328768 00000100:00100000:1.0:1782481147.041182:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:1.0:1782481147.041201:0:22662:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+20:18825:x1869066281328768:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782481147.044306:0:22662:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782481147.044894:0:22662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:0.0:1782481147.045040:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.045058:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.045257:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.045267:0:22662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.045273:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.045298:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.045459:0:22662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782481147.045579:0:22662:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+22:18825:x1869066281328768:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 4385us (4554us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1782481147.045593:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000020:00080000:0.0:1782481147.045600:0:22662:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782481147.051257:0:25052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481147.051273:0:25052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481147.051287:0:25052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c9111c600 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:3.0:1782481147.051291:0:25052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481147.051303:0:25052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481147.051321:0:25052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9f5ca08c4700) 00010000:00010000:3.0:1782481147.051324:0:25052:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782481147.051329:0:25052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481147.051335:0:25052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f5c9111c600/0x65dae4c042ee4b94 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.054999:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481147.055006:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481147.055009:0:25052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481147.193380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1782481147.193597:0:24170:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281328896 00000100:00100000:1.0:1782481147.193609:0:24170:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281328896 00000100:00100000:1.0:1782481147.193686:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:1.0:1782481147.193724:0:24170:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:2407:x1869066281328896:12345-192.168.204.11@tcp:4:dd.0 00002000:00010000:1.0:1782481147.193774:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a3e80f9, atime: 0x6a3e80f8, ctime: 0x6a3e80f9, blocks: 0x0 00010000:00010000:1.0:1782481147.193783:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481147.193800:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=763s v=(0 0) 00010000:00010000:1.0:1782481147.193990:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481147.193997:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481147.194012:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481147.196031:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1782481147.197589:0:24172:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1782481147.197606:0:24172:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1782481147.198205:0:24172:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281329024 00000100:00100000:2.0:1782481147.198216:0:24172:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281329024 00000100:00100000:3.0:1782481147.199000:0:25706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:3.0:1782481147.199013:0:25706:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb63d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+8:2406:x1869066281329024:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:3.0:1782481147.199052:0:25706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481147.199079:0:25706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481147.199088:0:25706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481147.199475:0:25706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481147.199492:0:25706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481147.204068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481147.204107:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481147.204124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481147.204141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481147.204164:0:24167:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281329536 00000100:00100000:0.0:1782481147.204173:0:24167:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281329536 00000100:00100000:0.0:1782481147.204219:0:24167:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281330048 00000100:00100000:0.0:1782481147.204222:0:24167:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281330048 00000100:00100000:0.0:1782481147.204246:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1782481147.204266:0:24167:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2406:x1869066281329536:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1782481147.204328:0:24167:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2406:x1869066281329536:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 64us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481147.204335:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1782481147.204556:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:0.0:1782481147.204565:0:24167:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c9029b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2406:x1869066281330048:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1782481147.204589:0:24167:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c9029b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2406:x1869066281330048:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481147.204602:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00080000:0.0:1782481147.204619:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782481147.204653:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481147.204716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481147.204895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481147.205858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1782481147.205892:0:24166:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281329920 00000100:00100000:0.0:1782481147.205899:0:24166:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281329920 00000100:00100000:0.0:1782481147.207009:0:24166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:0.0:1782481147.207023:0:24166:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b87a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2406:x1869066281329920:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1782481147.207089:0:24166:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b87a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2406:x1869066281329920:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 71us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481147.207164:0:24166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00080000:0.0:1782481147.207198:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782481147.207566:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281329280 00000100:00100000:0.0:1782481147.207573:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281329280 00000100:00100000:0.0:1782481147.207599:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281329792 00000100:00100000:0.0:1782481147.207602:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281329792 00000100:00080000:0.0:1782481147.207618:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782481147.207630:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281329408 00000100:00100000:0.0:1782481147.207633:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281329408 00000100:00080000:0.0:1782481147.207644:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782481147.207656:0:22661:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281329664 00000100:00100000:0.0:1782481147.207659:0:22661:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281329664 00000100:00080000:0.0:1782481147.207670:0:22655:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782481147.207685:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:2.0:1782481147.208481:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:2.0:1782481147.208495:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2406:x1869066281329792:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481147.208557:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+5:2406:x1869066281329792:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 68us (4432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481147.208563:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:2.0:1782481147.208593:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:2.0:1782481147.208599:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2406:x1869066281329408:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481147.208620:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2406:x1869066281329408:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 22us (3904us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481147.208625:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:2.0:1782481147.208634:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:2.0:1782481147.208639:0:22660:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5c90298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2406:x1869066281329664:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481147.208660:0:22660:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5c90298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7492e7e4-41f4-4199-b3ea-6cba6d5bda33+6:2406:x1869066281329664:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 21us (3766us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481147.208665:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:2.0:1782481147.208797:0:22654:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066281329152 00000100:00100000:2.0:1782481147.208802:0:22654:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066281329152 00000100:00100000:2.0:1782481147.208838:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 166 00000100:00100000:2.0:1782481147.208843:0:22654:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5b879ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:2406:x1869066281329152:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1782481147.208870:0:22654:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5b879ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7f2c34bb-9817-469e-8b47-2ebfb872a531+13:2406:x1869066281329152:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 27us (4217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481147.208876:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 166 00000100:00100000:0.0:1782481147.209449:0:22661:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9f5cb1ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+22:2406:x1869066281329280:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1782481147.209525:0:22661:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb1ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:df8b7b41-b102-4c0b-b8a2-94babd71285c+22:2406:x1869066281329280:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 1833us (5474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481147.209538:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 56 00010000:00010000:3.0:1782481147.293490:0:22649:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782481147.335454:0:24161:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1782481147.335472:0:24161:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1782481147.336414:0:24170:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1782481147.336421:0:24170:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1782481145 -> 1782481146 00002000:00010000:0.0:1782481147.336424:0:24170:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1782481145 -> 1782481146 00002000:00010000:0.0:1782481147.336426:0:24170:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1782481147.336444:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.336457:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.336465:0:24170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.336472:0:24170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5c8fddea00 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:0.0:1782481147.336477:0:24170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.336485:0:24170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.336506:0:24170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481147.336513:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dbaa997/0x65dae4c042ee4b9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481147.336683:0:24170:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:df8b7b41-b102-4c0b-b8a2-94babd71285c+7:2407:x1869066281328896:12345-192.168.204.11@tcp:4:dd.0 Request processed in 142957us (143317us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1782481147.336745:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000001:00080000:1.0:1782481147.367406:0:24161:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1782481147.368013:0:25706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1782481147.368019:0:25706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1782481147.368038:0:25706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.368051:0:25706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.368089:0:25706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.368096:0:25706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f5cb79aa200 already unused, calling callback (ffffffffc0ddece0) 00010000:00010000:2.0:1782481147.368101:0:25706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.368110:0:25706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.368129:0:25706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481147.368137:0:25706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014ff7481/0x65dae4c042ee4ba2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481147.368246:0:25706:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9f5cb63d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:df8b7b41-b102-4c0b-b8a2-94babd71285c+5:2406:x1869066281329024:12345-192.168.204.11@tcp:4:dd.0 Request processed in 169231us (172218us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1782481147.368257:0:25706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00010000:00010000:3.0:1782481148.316827:0:25053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782481148.947456:0:25744:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1782481149.340263:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13943 lines, 13943 kept, 0 dropped, 0 bad.