Git Product home page Git Product logo

pinpoint-docker's Introduction

Pinpoint

Pinpoint-Docker for Pinpoint

Official git repository of Dockerized components of the Pinpoint Application Monitoring.
Installing Pinpoint with these docker files will take approximately 10min. to check out the features of pinpoint.

What is Pinpoint

Pinpoint, is the world's leading open-source application monitoring solution - trusted by millions of users around the globe. It supports and helps you understand your application in a glance and allow you to build world-class, high-quality software.

Requirements

How to install Pinpoint?

You can easily bring up an entire Dockerized Pinpoint(latest release) environment by using Docker Compose with any of the provided docker-compose.yml files as below.
With docker-compose.yml under Pinpoint-Docker folder brings up all the environment attached with Pinpoint-QuickStart(sample app). To monitor your agent see configuration part for further details.

git clone https://github.com/pinpoint-apm/pinpoint-docker.git
cd pinpoint-docker
docker-compose pull && docker-compose up -d

Since Pinpoint v2.5.0, URI Metric and Infrastructure Metric are added. These need Apache Pinot cluster to work and docker-compose-metric.yml has been added to provide them. To use URI Metric and Infrastructure Metric, include docker-compose-metric.yml to bring up Pinpoint containers as decribed below.

git clone https://github.com/pinpoint-apm/pinpoint-docker.git
cd pinpoint-docker
docker-compose pull
docker-compose -f docker-compose.yml -f docker-compose-metric.yml up -d

Docker images for Pinpoint web and Pinpoint collector is provided since v2.5.1, so above wouldn't work with v2.5.0 images. To use Pinpoint v2.5.0 metric modules, you need to checkout v2.5.0 and then build the images ahead with below command.

git clone https://github.com/pinpoint-apm/pinpoint-docker.git
cd pinpoint-docker
git checkout {tag}
docker-compose -f docker-compose.yml -f docker-compose-metric.yml build

If you are not interested in metric modules, simply remove -f docker-compose-metric.yml in docker-compose commands.

Below are the list of images provided by this project:

You can replace QuickStart application part with your application to start monitoring.

Below are the list of images required for this project:

  • Apache Zookeeper v3.4.13: For Hbase and Pinpoint cluster
  • Apache Zookeeper v3.8.0: For Pinot cluster
  • Apache Pinot: Tested with v0.11.0 ~ v0.13.0. Please refer to pinot-init in docker-compose-metric.yml to further see tables and schema information for Pinpoint.
  • Kafka: Currently using 3.1-22.04_beta. Please refer to pinpoint-kafka-init in docker-compose-metric.yml to further see topics needed for Pinpoint.

Mysql (optional, 1.8.1+)

The Pinpoint-Mysql is necessary to use 'Alarm' feature. It's server is running on port 13306 and contains the data structure used to register users, groups, and alerts to be sent.

To send email alerts, you must make BATCH_ENABLE=true and change the other mail-related environment variables (MAIL_HOST, MAIL_PORT, MAIL_USERNAME, MAIL_PASSWORD, MAIL_PROPERTIES_MAIL_SMTP_FROM, ...) to the Pinpoint-Web server in .env file.

For more information checkout Setting Alarm in Pinpoint documentation.

Flink configuration (optional)

The Pinpoint-Flink is necessary to use 'Application Inspector' feature.

After all containers are started and ready to go. Pinpoint-Flink server is running on port 8081.

Alarm configuration (optional)

You can check the alarm guide document at the homepage for full understanding. But for the docker image, All is set. fillout variables under #mail server information required in .env file before starting the container

Testing QuickStart application

Now you are ready to monitor the sample application(Pinpoint-QuickStart port 8085) provided. If you can't find any connected application from Pinpoint-Web's first page(port 8080 as default), don't panic and wait for a while. It will take some time for Pinpoint to retrieve the application's information when running for the first time.

Monitoring YOUR Application

Pinpoint-Agent only prepares required libraries for triggering Pinpoint-Agent. Running and configuring agents is manual action done by the user, but don't worry it's very simple.

If you are not familiar with Pinpoint concept, please read: Overview, Agents Installation

You will need to attach Pinpoint-Agent to your application.

Running Pinpoint-Agent docker-compose separately, Examples are here.
Otherwise, you can check how Pinpoint-Quickstart is attached to Pinpoint-Agent with docker-compose.

We'll try to create more examples along the way. If anyone who can share their dockerfile, it's always welcome.

Distributed System

Until now, every components are in one docker, single-node approach, which is excellent for test and development. It provides an easy way to prototype new ideas and use cases, as well as try out new functionality and the latest Pinpoint releases. It’s not intended nor supported for production use.

You can use docker-compose and .env files under each folder to install the modules separately into several servers. If containers are separated, ip configurations in .env must be changed within.

For example, if you want your application running from a docker and rest of Pinpoint in another. You can remove pinpoint-agent and pinpoint-quickstart from docker-compose.yml and run to establish all necessary component of pinpoint. And create another docker-compose.yml just like one under pinpoint-quickstart folder to run your application. Finally, since agent needs to acknowledge the collector ip. collector ip needs to be changed in .env.

Configurations

Configuration relies on supplying docker-compose with environment variables defined in .env file. So it's recommended to change variables only from .env file. With docker-compose in this repository. You can create stand-alone containers that are needed to run most of the features in Pinpoint.

Ports can be also configured in .env file. (Default ports are Pinpoint-Web:8080, Pinpoint-Batch:8079, Quickstart:8085 and Flink:8081 as configured in .env file)

Pinpoint-Zookeeper is just an example of using zookeeper image. You can modify docker-compose files to suit your needs.

For more specific details on what the values represents in .env file. Please check Pinpoint Github Repository or Pinpoint Web properties, Pinpoint Collector properties, Pinpoint Agent configuration.
Please note that only essential configuration options are adopted to pinpoint-docker(docker-compose).

logs

You can check logs produced by these services

docker logs <containerId>

You can also easily change the log level from .env file.

Any Issues or Suggestions?

Feel free to share any problems and suggestions via Pinpoint GitHub Issue page. Contributions on the pinpoint-docker image is also always welcome.

License

Pinpoint is licensed under the Apache License, Version 2.0. See LICENSE for full license text.

Copyright 2018 NAVER Corp.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

pinpoint-docker's People

Contributors

archan0621 avatar emiling avatar ga-ram avatar headless-kjh avatar iamkyu avatar jokimina avatar koo-taejin avatar kyungtae-k avatar qudongfang avatar roysrose avatar stoneknocker avatar won983212 avatar yjqg6666 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

pinpoint-docker's Issues

Readme.md file question...

It's nothing important, but... wouldn't it be right to reverse the order of line number 40 and 41?

git clone https://github.com/naver/pinpoint-docker.git
cd pinpoint-docker
git checkout {tag}
docker-compose pull && docker-compose up -d

Question: How to view my application method name in call tree for a transaction?

Hello,

I want to see my java method which took more time in call tree as of now i can see only sql statement under invoke method. I used profiler.include configuration in pinpoint.config file but it show warn msg that "WARN Skip adding interceptor. 'abstract or native method' class=". Could you please help me to configure java method includes in call tree?
image

Thank You.
Subodh

Error displaying binded SQL of v2.0.3

Our microservice using Postgresql 10 and jooq 3.9.4. When we use the pinpoint 2.0.3 docker edition, there's a display error showing binded sql like belowing:

select
  & quot;
public & quot;.& quot;
users & quot;.& quot;
user_id & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
username & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
password & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
enabled & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
name & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
gender & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
email & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
created_date & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
updated_date & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
last_login & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
language & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
mobile & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
nick_name & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
country_code & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
resources_access_type & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
device_channel_id & quot;,
  & quot;
public & quot;.& quot;
users & quot;.& quot;
password_flag & quot;
from
  & quot;
public & quot;.& quot;
users & quot;
where
  & quot;
public & quot;.& quot;
users & quot;.& quot;
username & quot;
= 'gm_admin'

while the original sql is normally displayed:
select "public"."users"."user_id", "public"."users"."username", "public"."users"."password", "public"."users"."enabled", "public"."users"."name", "public"."users"."gender", "public"."users"."email", "public"."users"."created_date", "public"."users"."updated_date", "public"."users"."last_login", "public"."users"."language", "public"."users"."mobile", "public"."users"."nick_name", "public"."users"."country_code", "public"."users"."resources_access_type", "public"."users"."device_channel_id", "public"."users"."password_flag" from "public"."users" where "public"."users"."username" = ?

But when I use the 1.8.5 edition without docker. This problem doesn't occur. The binded sql is displayed as belowing:

select "public"."users"."user_id", "public"."users"."username", "public"."users"."password", "public"."users"."enabled", "public"."users"."name", "public"."users"."gender", "public"."users"."email", "public"."users"."created_date", "public"."users"."updated_date", "public"."users"."last_login", "public"."users"."language", "public"."users"."mobile", "public"."users"."nick_name", "public"."users"."country_code", "public"."users"."resources_access_type", "public"."users"."device_channel_id", "public"."users"."password_flag" from "public"."users" where "public"."users"."username" = 'gm_admin'

Following are the command line for invoking:

java -javaagent:D:\pinpoint-agent-2.0.3\pinpoint-bootstrap.jar -Dpinpoint.agentId=gclife-registry-peer1 -Dpinpoint.applicationName=gclife-registry-peer1 -Xms100m -Xmx100m -jar gclife-registry.jar

java -javaagent:D:\pp-agent\pinpoint-bootstrap-1.8.5.jar -Dpinpoint.agentId=gclife-registry-peer1 -Dpinpoint.applicationName=gclife-registry-peer1 -Xms100m -Xmx100m -jar gclife-registry.jar

I think this gonna be a html problem.

JAVA_OPTS environment variable seems to be ignored.

Hi. pinpoint-web docker use JAVA_OPTS environment for spring.profiles.active. but that variable seem to be ignored.
So pinpoint-web profile is always release only. (i expect that profile is release,batch). I think JAVA_OPTS should be replaced _JAVA_OPTIONS.

Internal transactions like MYSQL, REDIS.. are not visible

Hi All,

Pinpoint Collector :- 2.2.2
Pinpoint Agent :- 2.2.2

We have successfully deployed Pinpoint collector and Web as separate VMs and now need to monitor few of our Java spring based micro services which are running on kubernetes cluster. We have created shared persistence volume and copied Pinpoint agent to it. Our kubernetes container able to share the agent and we are passing Agent path, App name and Id as java options. Now we are able to see the instance is registered and visible initial transactions as below. But we are not able to see internal transactions like MYSQL, REDIS, etc.. Please help us to resolve this.

image

image

Thanks,
Pradeep

Pinpoint collector on the host network cannot connect to pinpoint-hbase container.

What version of pinpoint are you using?

master/v2.1.0

Describe the bug

When I start the pinpoint-hbase container using docker-compose.yml file in pinpoint-base directory and pinpoint collector module in the host network, Pinpoint collector can not connect to pinpoint-hbase container.

What did you do to trigger the bug?

  1. Go to pinpoint-docker/pinpoint-hbase directory.
  2. run the command as $ docker-compose up
  3. And run pinpoint collector module in the host.

Expected behavior

Pinpoint collector can connect pinpoint-hbase container.
Also, I can connect the hbase region server web ui(http://localhost:16301/rs-status)

Logs

Sun Sep 13 13:02:12 KST 2020, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69144: can not resolve c816a9cad0ef,16201,1599968640513 row 'AgentInfo,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=c816a9cad0ef,16201,1599968640513, seqNum=0

org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions:
Sun Sep 13 13:02:12 KST 2020, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69144: can not resolve c816a9cad0ef,16201,1599968640513 row 'AgentInfo,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=c816a9cad0ef,16201,1599968640513, seqNum=0

	at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:329) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:242) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:58) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:219) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:275) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:436) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:310) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:196) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:89) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.MetaScanner.listTableRegionLocations(MetaScanner.java:343) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.HRegionLocator.listRegionLocations(HRegionLocator.java:141) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.HRegionLocator.getAllRegionLocations(HRegionLocator.java:87) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at com.navercorp.pinpoint.common.hbase.ConnectionFactoryBean.afterPropertiesSet(ConnectionFactoryBean.java:89) ~[classes/:?]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1855) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1792) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:595) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:517) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:323) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:226) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:321) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:330) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:113) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:704) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:196) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1358) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1204) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:557) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:517) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:323) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:226) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:321) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:330) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:113) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1699) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1444) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:594) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:517) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:323) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:226) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:321) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1304) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1224) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:884) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:788) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:227) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1358) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1204) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:557) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:517) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:323) ~[spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:226) [spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:321) [spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202) [spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:893) [spring-beans-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:879) [spring-context-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:551) [spring-context-5.2.7.RELEASE.jar:5.2.7.RELEASE]
	at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141) [spring-boot-2.2.8.RELEASE.jar:2.2.8.RELEASE]
	at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:747) [spring-boot-2.2.8.RELEASE.jar:2.2.8.RELEASE]
	at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:397) [spring-boot-2.2.8.RELEASE.jar:2.2.8.RELEASE]
	at org.springframework.boot.SpringApplication.run(SpringApplication.java:315) [spring-boot-2.2.8.RELEASE.jar:2.2.8.RELEASE]
	at com.navercorp.pinpoint.collector.CollectorStarter.start(CollectorStarter.java:32) [classes/:?]
	at com.navercorp.pinpoint.collector.CollectorApp.main(CollectorApp.java:18) [classes/:?]
Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=69144: can not resolve c816a9cad0ef,16201,1599968640513 row 'AgentInfo,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=c816a9cad0ef,16201,1599968640513, seqNum=0
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:178) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:80) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) ~[?:?]
	at java.lang.Thread.run(Thread.java:844) ~[?:?]
Caused by: java.net.UnknownHostException: can not resolve c816a9cad0ef,16201,1599968640513
	at org.apache.hadoop.hbase.ipc.AbstractRpcClient.createAddr(AbstractRpcClient.java:429) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.ipc.AbstractRpcClient.createBlockingRpcChannel(AbstractRpcClient.java:507) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getClient(ConnectionManager.java:1694) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ScannerCallable.prepare(ScannerCallable.java:168) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.prepare(ScannerCallableWithReplicas.java:400) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:140) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:80) ~[hbase-shaded-client-1.4.13.jar:1.4.13]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641) ~[?:?]
	at java.lang.Thread.run(Thread.java:844) ~[?:?]

Additional context

Fix the Region server hostname and ipc address and port.

2020-03-24 15:14:20 [INFO ](c.n.p.p.s.TcpDataSender@Default ) request fail. request:com.navercorp.pinpoint.profiler.metadata.ApiMetaData@e3c30ea Caused:timeout com.navercorp.pinpoint.rpc.PinpointSocketException: timeout

Hello, thank you very much for having solved the previous problems. I want to consult a particular situation that is happening to me, I downloaded the latest version of pinpoint docker, and everything is working correctly including the test app, but when I want to link the application I have, the server throws the following message:

2020-03-24 15:14:20 [INFO ](c.n.p.p.s.TcpDataSender@Default    ) request fail. request:com.navercorp.pinpoint.profiler.metadata.ApiMetaData@e3c30ea Caused:timeout
com.navercorp.pinpoint.rpc.PinpointSocketException: timeout
	at com.navercorp.pinpoint.rpc.DefaultFuture.fireTimeout(DefaultFuture.java:120)
	at com.navercorp.pinpoint.rpc.DefaultFuture.run(DefaultFuture.java:235)
	at org.jboss.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:556)
	at org.jboss.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:632)
	at org.jboss.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:369)
	at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
	at java.lang.Thread.run(Thread.java:745)

I tested networktest.sh and the result was successful, I'm currently using the THRIFT protocol. I would be grateful if someone could guide me towards solving this problem.

Thank you very much.

pinpoint-web start error

After execute docker-compose pull && docker-compose up -d,I couldn't visit pinpoint web server.The link http://localhost:8079/ was invalid.
So I'm enter the pinpoint web container, execute docker exec -it xxx bash.
cd to /usr/local/tomcat/logs this directory,check logs,got some errors info from localhost.xxxx.log

root@1931f93812e8:/usr/local/tomcat/logs# tail -f catalina.2020-09-05.log

	Caused by: org.springframework.beans.factory.BeanCreationException: Err
or creating bean with name 'hbaseTemplate' defined in class path resource [appl
icationContext-web-hbase.xml]: Cannot resolve reference to bean 'hbaseTableFact
ory' while setting bean property 'tableFactory'; nested exception is org.spring
framework.beans.factory.BeanCreationException: Error creating bean with name 'h
baseTableFactory' defined in class path resource [applicationContext-web-hbase.
xml]: Cannot resolve reference to bean 'connectionFactory' while setting constr
uctor argument; nested exception is org.springframework.beans.factory.BeanCreat
ionException: Error creating bean with name 'connectionFactory' defined in clas
s path resource [applicationContext-web-hbase.xml]: Invocation of init method f
ailed; nested exception is com.navercorp.pinpoint.common.hbase.HbaseSystemExcep
tion: java.lang.reflect.InvocationTargetException; nested exception is java.io.
IOException: java.lang.reflect.InvocationTargetException
		at org.springframework.beans.factory.support.BeanDefinitionValu
eResolver.resolveReference(BeanDefinitionValueResolver.java:359)
		at org.springframework.beans.factory.support.BeanDefinitionValu
eResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:15
34)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1281)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
		at org.springframework.beans.factory.support.AbstractBeanFactor
y$1.getObject(AbstractBeanFactory.java:312)
		at org.springframework.beans.factory.support.DefaultSingletonBe
anRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
		at org.springframework.beans.factory.support.AbstractBeanFactor
y.doGetBean(AbstractBeanFactory.java:308)
		at org.springframework.beans.factory.support.AbstractBeanFactor
y.getBean(AbstractBeanFactory.java:202)
		at org.springframework.beans.factory.config.DependencyDescripto
r.resolveCandidate(DependencyDescriptor.java:208)
		at org.springframework.beans.factory.support.DefaultListableBea
nFactory.doResolveDependency(DefaultListableBeanFactory.java:1136)
		at org.springframework.beans.factory.support.DefaultListableBea
nFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
		at org.springframework.beans.factory.support.ConstructorResolve
r.resolveAutowiredArgument(ConstructorResolver.java:835)
		at org.springframework.beans.factory.support.ConstructorResolve
r.createArgumentArray(ConstructorResolver.java:741)
		... 56 more
	Caused by: org.springframework.beans.factory.BeanCreationException: Err
or creating bean with name 'hbaseTableFactory' defined in class path resource [
applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'connection
Factory' while setting constructor argument; nested exception is org.springfram
ework.beans.factory.BeanCreationException: Error creating bean with name 'conne
ctionFactory' defined in class path resource [applicationContext-web-hbase.xml]
: Invocation of init method failed; nested exception is com.navercorp.pinpoint.
common.hbase.HbaseSystemException: java.lang.reflect.InvocationTargetException;
 nested exception is java.io.IOException: java.lang.reflect.InvocationTargetExc
eption
		at org.springframework.beans.factory.support.BeanDefinitionValu
eResolver.resolveReference(BeanDefinitionValueResolver.java:359)
		at org.springframework.beans.factory.support.BeanDefinitionValu
eResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
		at org.springframework.beans.factory.support.ConstructorResolve
r.resolveConstructorArguments(ConstructorResolver.java:648)
		at org.springframework.beans.factory.support.ConstructorResolve
r.autowireConstructor(ConstructorResolver.java:145)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:11
98)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:110
0)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
		at org.springframework.beans.factory.support.AbstractBeanFactor
y$1.getObject(AbstractBeanFactory.java:312)
		at org.springframework.beans.factory.support.DefaultSingletonBe
anRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
		at org.springframework.beans.factory.support.AbstractBeanFactor
y.doGetBean(AbstractBeanFactory.java:308)
		at org.springframework.beans.factory.support.AbstractBeanFactor
y.getBean(AbstractBeanFactory.java:197)
		at org.springframework.beans.factory.support.BeanDefinitionValu
eResolver.resolveReference(BeanDefinitionValueResolver.java:351)
		... 70 more
	Caused by: org.springframework.beans.factory.BeanCreationException: Err
or creating bean with name 'connectionFactory' defined in class path resource [
applicationContext-web-hbase.xml]: Invocation of init method failed; nested exc
eption is com.navercorp.pinpoint.common.hbase.HbaseSystemException: java.lang.r
eflect.InvocationTargetException; nested exception is java.io.IOException: java
.lang.reflect.InvocationTargetException
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1631)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:553)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
		at org.springframework.beans.factory.support.AbstractBeanFactor
y$1.getObject(AbstractBeanFactory.java:312)
		at org.springframework.beans.factory.support.DefaultSingletonBe
anRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
		at org.springframework.beans.factory.support.AbstractBeanFactor
y.doGetBean(AbstractBeanFactory.java:308)
		at org.springframework.beans.factory.support.AbstractBeanFactor
y.getBean(AbstractBeanFactory.java:197)
		at org.springframework.beans.factory.support.BeanDefinitionValu
eResolver.resolveReference(BeanDefinitionValueResolver.java:351)
		... 82 more
	Caused by: com.navercorp.pinpoint.common.hbase.HbaseSystemException: ja
va.lang.reflect.InvocationTargetException; nested exception is java.io.IOExcept
ion: java.lang.reflect.InvocationTargetException
		at com.navercorp.pinpoint.common.hbase.ConnectionFactoryBean.af
terPropertiesSet(ConnectionFactoryBean.java:79)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1689
)
		at org.springframework.beans.factory.support.AbstractAutowireCa
pableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1627)
		... 89 more
	Caused by: java.io.IOException: java.lang.reflect.InvocationTargetExcep
tion
		at org.apache.hadoop.hbase.client.ConnectionFactory.createConne
ction(ConnectionFactory.java:240)
		at org.apache.hadoop.hbase.client.ConnectionFactory.createConne
ction(ConnectionFactory.java:218)
		at org.apache.hadoop.hbase.client.ConnectionFactory.createConne
ction(ConnectionFactory.java:150)
		at com.navercorp.pinpoint.common.hbase.ConnectionFactoryBean.af
terPropertiesSet(ConnectionFactoryBean.java:76)
		... 91 more
	Caused by: java.lang.reflect.InvocationTargetException
		at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Nativ
e Method)
		at sun.reflect.NativeConstructorAccessorImpl.newInstance(Native
ConstructorAccessorImpl.java:62)
		at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(De
legatingConstructorAccessorImpl.java:45)
		at java.lang.reflect.Constructor.newInstance(Constructor.java:4
23)
		at org.apache.hadoop.hbase.client.ConnectionFactory.createConne
ction(ConnectionFactory.java:238)
		... 94 more
	Caused by: java.lang.NumberFormatException: For input string: ""
		at java.lang.NumberFormatException.forInputString(NumberFormatE
xception.java:65)
		at java.lang.Integer.parseInt(Integer.java:592)
		at java.lang.Integer.parseInt(Integer.java:615)
		at org.apache.hadoop.conf.Configuration.getInt(Configuration.ja
va:1104)
		at org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServer
sStringFromHbaseConfig(ZKConfig.java:306)
		at org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServer
sString(ZKConfig.java:328)
		at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(Zo
oKeeperWatcher.java:178)
		at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(Zo
oKeeperWatcher.java:153)
		at org.apache.hadoop.hbase.client.ZooKeeperKeepAliveConnection.
<init>(ZooKeeperKeepAliveConnection.java:43)
		at org.apache.hadoop.hbase.client.ConnectionManager$HConnection
Implementation.getKeepAliveZooKeeperWatcher(ConnectionManager.java:1706)
		at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterI
d(ZooKeeperRegistry.java:104)
		at org.apache.hadoop.hbase.client.ConnectionManager$HConnection
Implementation.retrieveClusterId(ConnectionManager.java:916)
		at org.apache.hadoop.hbase.client.ConnectionManager$HConnection
Implementation.<init>(ConnectionManager.java:659)
		at org.apache.hadoop.hbase.client.ConnectionManager$HConnection
Implementation.<init>(ConnectionManager.java:637)
		... 99 more
05-Sep-2020 09:09:35.440 INFO [localhost-startStop-1] org.apache.catalina.core.
ApplicationContext.log Closing Spring root WebApplicationContext
05-Sep-2020 09:09:38.125 INFO [localhost-startStop-1] org.apache.catalina.core.
ApplicationContext.log Shutting down log4j

Pinpoint Agent load failure

I use pinpoint-docker to monitor the spring-boot project in the host and the following problems occur, I do n’t know how to solve it, please help me。
console log:
2020-03-03 23:27:45 INFO Found plugins:D:\project\java-project\ordinary-cloud\pinpoint-agent-1.8.5.tar\pinpoint-agent-1.8.5\plugin\scala-library-2.11.11.jar
2020-03-03 23:27:45 INFO Found plugins:D:\project\java-project\ordinary-cloud\pinpoint-agent-1.8.5.tar\pinpoint-agent-1.8.5\plugin\spray-json_2.12-1.3.4.jar
2020-03-03 23:27:45 INFO appendToBootstrapClassLoader:D:\project\java-project\ordinary-cloud\pinpoint-agent-1.8.5.tar\pinpoint-agent-1.8.5\boot\pinpoint-commons-1.8.5.jar
2020-03-03 23:27:45 INFO appendToBootstrapClassLoader:D:\project\java-project\ordinary-cloud\pinpoint-agent-1.8.5.tar\pinpoint-agent-1.8.5\boot\pinpoint-bootstrap-core-1.8.5.jar
2020-03-03 23:27:45 INFO appendToBootstrapClassLoader:D:\project\java-project\ordinary-cloud\pinpoint-agent-1.8.5.tar\pinpoint-agent-1.8.5\boot\pinpoint-bootstrap-core-optional-1.8.5.jar
2020-03-03 23:27:45 INFO appendToBootstrapClassLoader:D:\project\java-project\ordinary-cloud\pinpoint-agent-1.8.5.tar\pinpoint-agent-1.8.5\boot\pinpoint-bootstrap-java8-1.8.5.jar
2020-03-03 23:27:45 INFO appendToBootstrapClassLoader:D:\project\java-project\ordinary-cloud\pinpoint-agent-1.8.5.tar\pinpoint-agent-1.8.5\boot\pinpoint-bootstrap-java9-1.8.5.jar
2020-03-03 23:27:45 INFO appendToBootstrapClassLoader:D:\project\java-project\ordinary-cloud\pinpoint-agent-1.8.5.tar\pinpoint-agent-1.8.5\boot\pinpoint-annotations-1.8.5.jar
2020-03-03 23:27:45 INFO parentClassLoader:BootStrapClassLoader:null
2020-03-03 23:27:45 INFO check -Dpinpoint.agentId
2020-03-03 23:27:45 WARN -Dpinpoint.agentId is null. value:null


  • Pinpoint Agent load failure

Error in line: ARG INSTALL_URL=https://github.com/naver/pinpoint/releases/download/${PINPOINT_VERSION}/pinpoint-agent-${PINPOINT_VERSION}.tar.gz

Hi, first of all thank you very much for this fantastic software. I am trying to upgrade from version 1.8.5 to 2.0.1. But I have the following bugs.
-When I run "docker-compose pull" it fails me because it searches in: https://hub.docker.com/u/pinpointdocker for the 2.0.0 tag, and it doesn't find it because the last update was 6 months ago in version 1.8.5.
-If I decide to execute the following command "docker-compose up -d" I have to change all the lines in Dockerfile that have a variable pinpoint version to a hardcoded one. Example of this:

ARG INSTALL_URL=https://github.com/naver/pinpoint/releases/download/${PINPOINT_VERSION}/pinpoint-agent-${PINPOINT_VERSION}.tar.gz

I must change it to:

ARG INSTALL_URL=https://github.com/naver/pinpoint/releases/download/1.8.5/pinpoint-agent-1.8.5.tar.gz

This is because it can't find version 2.0.0 of this file at that address. This error is replicated in the collector, hbase, mysql, etc.

There is a way to fix this by bringing version 2.0.0 instead of 1.8.5?

Thank you very much.

Greetings

Pinpoint hbase tables not creating in kubernetes

Using pinpointdocker/pinpoint-hbase:1.8.5 for hbase.
Docker run is creating the hbase tables. But in kubernetes, tables are not getting created.
Do i need to do execute any script to create tables in kubernetes?

Cannot Change profiler.transport.grpc.collector.ip in pinpoint-agent-2.0.1/pinpoint.config

Even I change the profiler.transport.grpc.collector.ip property in pinpoint.config. Application still try to access 127.0.0.1. Why is it like this?

I use version 2.0.1 for both pinpoint-docker and pinpoint-agent.

Logs on startup:

2020-04-15 12:53:25 [WARN ](c.n.p.p.AgentInfoSender            ) request failed.
io.grpc.StatusRuntimeException: UNAVAILABLE: io exception
	at pinpoint.agent/pinpoint.agent/io.grpc.Status.asRuntimeException(Status.java:526)
	at pinpoint.agent/pinpoint.agent/io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:420)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:459)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:63)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:546)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$600(ClientCallImpl.java:467)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:584)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:830)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: no further information: /127.0.0.1:9991
Caused by: java.net.ConnectException: Connection refused: no further information
	at java.base/sun.nio.ch.Net.pollConnect(Native Method)
	at java.base/sun.nio.ch.Net.pollConnectNow(Net.java:579)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:820)
	at pinpoint.agent/pinpoint.agent/io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:330)
	at pinpoint.agent/pinpoint.agent/io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
	at pinpoint.agent/pinpoint.agent/io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702)
	at pinpoint.agent/pinpoint.agent/io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
	at pinpoint.agent/pinpoint.agent/io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
	at pinpoint.agent/pinpoint.agent/io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
	at pinpoint.agent/pinpoint.agent/io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
	at pinpoint.agent/pinpoint.agent/io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:830)
2020-04-15 12:53:25.640  INFO 13660 --- [  restartedMain] org.apache.catalina.core.StandardEngine  : Starting Servlet engine: [Apache Tomcat/9.0.29]
2020-04-15 12:53:25 [WARN ](c.n.p.p.AgentInfoSender            ) request failed.
io.grpc.StatusRuntimeException: UNAVAILABLE: io exception
	at pinpoint.agent/pinpoint.agent/io.grpc.Status.asRuntimeException(Status.java:526)
	at pinpoint.agent/pinpoint.agent/io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:420)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:459)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:63)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:546)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$600(ClientCallImpl.java:467)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:584)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at pinpoint.agent/pinpoint.agent/io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:830)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: no further information: /127.0.0.1:9991

Agent and quickstart containers failed to start

What version of pinpoint are you using?

master/v2.1.0

Describe the bug

When I clone repos from github and exec docker-compose pull && docker-compose up -d i see errors in docker logs in agent & quickstart:

~/pinpoint-docker# docker logs pinpoint-agent
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
+ sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory

What did you do to trigger the bug?

git clone https://github.com/naver/pinpoint-docker.git
cd pinpoint-docker
docker-compose pull && docker-compose up -d

Expected behavior

Quickstart Logs

$ docker-compose -f pinpoint-quickstart/docker-compose.yml up

Creating pinpoint-agent ... done
Creating pinpoint-quickstart ... done
Attaching to pinpoint-agent, pinpoint-quickstart
pinpoint-agent         | + sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
pinpoint-agent         | sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory

... snip ....

pinpoint-quickstart    | 09-14 07:09:31.719 INFO  PinpointStarter                     : agent config:/pinpoint-agent/pinpoint-root.config
pinpoint-agent exited with code 1
pinpoint-quickstart    | 09-14 07:09:31.755 INFO  PinpointStarter                     : pinpoint agent [com.navercorp.pinpoint.profiler.DefaultAgent] starting...
pinpoint-quickstart    | 09-14 07:09:31.808 INFO  Log4j2LoggingSystem                 : logPath:file:/pinpoint-agent/profiles/release/log4j2.xml
pinpoint-quickstart    | 09-14 07:09:31.832 INFO  Log4j2LoggingSystem                 : patch ReflectionUtil codeSource:(file:/pinpoint-agent/lib/log4j-api-2.3.jar <no signer certificates>)
pinpoint-agent         | + sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
pinpoint-agent         | sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
pinpoint-agent         | + sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
pinpoint-agent         | sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
pinpoint-agent         | + sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
pinpoint-agent         | sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
pinpoint-agent exited with code 1
pinpoint-agent         | + sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
pinpoint-agent         | sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
pinpoint-agent         | + sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
pinpoint-agent         | sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
pinpoint-agent         | + sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
pinpoint-agent         | sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
pinpoint-agent         | + sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
pinpoint-agent         | sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory
pinpoint-agent         | + sed -i '/profiler.transport.module=/ s/=.*/=/' /pinpoint-agent/profiles//pinpoint.config
pinpoint-agent         | sed: /pinpoint-agent/profiles//pinpoint.config: No such file or directory

System:

Virtualization: kvm
Operating System: Ubuntu 20.04 LTS
Kernel: Linux 5.4.0-33-generic
Architecture: x86-64

localhost:8079/main working great.

pull access denied for pinpointdocker/pinpoint-flink

[root@ansiblemaster pinpoint-docker-2.2.2]# docker-compose pull
Pulling pinpoint-mysql (pinpointdocker/pinpoint-mysql:2.2.2)...
2.2.2: Pulling from pinpointdocker/pinpoint-mysql
Digest: sha256:98254030405a0e922435a557ce6c5c4f017381e7ff5d29accb09250b56641427
Status: Image is up to date for pinpointdocker/pinpoint-mysql:2.2.2
Pulling zoo1 (zookeeper:3.4)...
3.4: Pulling from library/zookeeper
Digest: sha256:3882d9493d387ba77b7b69e2a031b9396477ec29483d51ceaed645c1389182e5
Status: Image is up to date for zookeeper:3.4
Pulling pinpoint-hbase (pinpointdocker/pinpoint-hbase:2.2.2)...
2.2.2: Pulling from pinpointdocker/pinpoint-hbase
Digest: sha256:444ece9391c58eb44eac145470d6157e67251a58d676fa2bb2e719188641b061
Status: Image is up to date for pinpointdocker/pinpoint-hbase:2.2.2
Pulling pinpoint-collector (pinpointdocker/pinpoint-collector:2.2.2)...
2.2.2: Pulling from pinpointdocker/pinpoint-collector
Digest: sha256:203b1c999c2eba1fe03087c971bdf8fa5f99745e2fd28936b90a8a4ecb2cc2cd
Status: Image is up to date for pinpointdocker/pinpoint-collector:2.2.2
Pulling pinpoint-agent (pinpointdocker/pinpoint-agent:2.2.2)...
2.2.2: Pulling from pinpointdocker/pinpoint-agent
Digest: sha256:33d74c34fb51b81fb21e74859ea6d8d80dde663e24be3ad9a68b7d98a5ba5f78
Status: Image is up to date for pinpointdocker/pinpoint-agent:2.2.2
Pulling pinpoint-quickstart (pinpointdocker/pinpoint-quickstart:latest)...
latest: Pulling from pinpointdocker/pinpoint-quickstart
Digest: sha256:3a241f64d8fa17bf55b6da01e53cc5ac746ab1a2c0e4d48195e78de3cce15052
Status: Image is up to date for pinpointdocker/pinpoint-quickstart:latest
Pulling pinpoint-web (pinpointdocker/pinpoint-web:2.2.2)...
2.2.2: Pulling from pinpointdocker/pinpoint-web
Digest: sha256:75be6fd9246fb4abed471327823c2ea1703fa565a6c97433953d6335377d4426
Status: Image is up to date for pinpointdocker/pinpoint-web:2.2.2
Pulling zoo2 (zookeeper:3.4)...
3.4: Pulling from library/zookeeper
Digest: sha256:3882d9493d387ba77b7b69e2a031b9396477ec29483d51ceaed645c1389182e5
Status: Image is up to date for zookeeper:3.4
Pulling zoo3 (zookeeper:3.4)...
3.4: Pulling from library/zookeeper
Digest: sha256:3882d9493d387ba77b7b69e2a031b9396477ec29483d51ceaed645c1389182e5
Status: Image is up to date for zookeeper:3.4
Pulling jobmanager (pinpointdocker/pinpoint-flink:2.2.2)...
ERROR: pull access denied for pinpointdocker/pinpoint-flink, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

Suggest expose thrift port

I found in the docker-compose.yaml the port 9994,9995,9996 are not exposed, and if I start the pinpoint docker, and use the agent in other machine (not in docker), the agent can not send span datas to the collector, and I expose the 9994,9995,9996(udp), and change the configuration to profiler.transport.module=THRIFT then it works.

I found similar issues in pinpoint-apm/pinpoint#6563

hbase can not be connected in kubernetes

I deploy pinpoint into kubernetes cluster, but the Collector can NOT connect hbase.

I use deployment deploy pod, hbase name is random string.

My yaml:

---
apiVersion: apps/v1
kind: Deployment
metadata:
  name: pinpoint-hbase
  labels:
    app: pinpoint-hbase
spec:
  replicas: 1
  selector:
    matchLabels:
      app: pinpoint-hbase
      tier: backend
  template:
    metadata:
      labels:
        app: pinpoint-hbase
        tier: backend
    spec:
      containers:
      - name: pinpoint-hbase
        image: pinpointdocker/pinpoint-hbase:2.0.1
        command: ['sh', '-c']
        args: ['echo pinpoint-hbase > /opt/hbase/hbase-1.2.6/conf/regionservers && /opt/hbase/hbase-1.2.6/bin/hbase master start']
        env:
        - name: PINPOINT_HBASE_NAME
          value: pinpoint-hbase
        volumeMounts:
        - name: pinpoint-hbase
          mountPath: /home/pinpoint/hbase
        - name: pinpoint-zookeeper
          mountPath: /home/pinpoint/zookeeper
      volumes:
      - name: pinpoint-hbase
        persistentVolumeClaim:
          claimName: pinpoint-hbase
      - name: pinpoint-zookeeper
        persistentVolumeClaim:
          claimName: pinpoint-zookeeper
---

apiVersion: apps/v1
kind: Deployment
metadata:
  name: pinpoint-collector
  labels:
    app: pinpoint-collector
spec:
  replicas: 1
  selector:
    matchLabels:
      app: pinpoint-collector
      tier: backend
  template:
    metadata:
      labels:
        app: pinpoint-collector
        tier: backend
    spec:
      containers:
      - name: pinpoint-collector
        image: pinpointdocker/pinpoint-collector:2.0.1
        env:
        - name: SPRING_PROFILES
          value: release
        - name: CLUSTER_ENABLE
          value: 'false'
        - name: CLUSTER_ZOOKEEPER_ADDRESS
          value: pinpoint-hbase
        - name: HBASE_HOST
          value: pinpoint-hbase
        - name: HBASE_PORT
          value: '2181'
        - name: FLINK_CLUSTER_ENABLE
          value: 'false'
        - name: PINPOINT_COLLECTOR_NAME
          value: pinpoint-collector
---
apiVersion: v1
kind: Service
metadata:
  labels:
    app: pinpoint-hbase
  name: pinpoint-hbase
spec:
  ports:
    - port: 2181
      protocol: TCP
      name: zookeeper
    - port: 60000
      protocol: TCP
      name: api
    - port: 16010
      protocol: TCP
      name: webui
    - port: 60020
      protocol: TCP
      name: regionserver-api
    - port: 16030
      protocol: TCP
      name: regionserver-webui
  selector:
    app: pinpoint-hbase
    tier: backend
---
apiVersion: v1
kind: Service
metadata:
  labels:
    app: pinpoint-collector
  name: pinpoint-collector
spec:
  ports:
    - port: 9991
      protocol: TCP
      name: agent
    - port: 9992
      protocol: TCP
      name: stat
    - port: 9993
      protocol: TCP
      name: span
    - port: 9994
      protocol: TCP
      name: base
    - port: 9995
      protocol: UDP
      name: statudp
    - port: 9996
      protocol: UDP
      name: spanudp
  selector:
    app: pinpoint-collector
    tier: backend

Pod list:

pinpoint-collector-6495c484b6-qfpln              1/1     Running   0          4m42s
pinpoint-hbase-7658695468-7jmmq                  1/1     Running   0          5m23s

Service lit:

pinpoint-collector              ClusterIP   10.110.109.27    <none>        9991/TCP,9992/TCP,9993/TCP,9994/TCP,9995/UDP,9996/UDP   17h
pinpoint-hbase                  ClusterIP   10.100.137.249   <none>        2181/TCP,60000/TCP,16010/TCP,60020/TCP,16030/TCP        17h

Collector log:

org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions:
Thu Mar 26 12:03:42 CST 2020, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=68411: row 'ApplicationMapStatisticsCaller_Ver2,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=pinpoint-hbase-7658695468-7jmmq,46629,1585194839886, seqNum=0

	at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:276)
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210)
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
	at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:327)
	at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:302)
	at org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:167)
	at org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:162)
	at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:797)
	at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:193)
	at org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:89)
	at org.apache.hadoop.hbase.client.MetaScanner.listTableRegionLocations(MetaScanner.java:343)
	at org.apache.hadoop.hbase.client.HRegionLocator.listRegionLocations(HRegionLocator.java:141)
	at org.apache.hadoop.hbase.client.HRegionLocator.getAllRegionLocations(HRegionLocator.java:87)
	at com.navercorp.pinpoint.common.hbase.ConnectionFactoryBean.afterPropertiesSet(ConnectionFactoryBean.java:83)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1689)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1627)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:553)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1534)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1281)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
	at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1136)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:583)
	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:364)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1269)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
	at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1136)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:583)
	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:364)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1269)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
	at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1136)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:835)
	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:189)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getSingletonFactoryBeanForTypeCheck(AbstractAutowireCapableBeanFactory.java:928)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getTypeForFactoryBean(AbstractAutowireCapableBeanFactory.java:805)
	at org.springframework.beans.factory.support.AbstractBeanFactory.isTypeMatch(AbstractBeanFactory.java:564)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doGetBeanNamesForType(DefaultListableBeanFactory.java:432)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanNamesForType(DefaultListableBeanFactory.java:403)
	at org.springframework.beans.factory.BeanFactoryUtils.beanNamesForTypeIncludingAncestors(BeanFactoryUtils.java:206)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1265)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1099)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:583)
	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:364)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1269)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getSingletonFactoryBeanForTypeCheck(AbstractAutowireCapableBeanFactory.java:928)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getTypeForFactoryBean(AbstractAutowireCapableBeanFactory.java:805)
	at org.springframework.beans.factory.support.AbstractBeanFactory.isTypeMatch(AbstractBeanFactory.java:564)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doGetBeanNamesForType(DefaultListableBeanFactory.java:432)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanNamesForType(DefaultListableBeanFactory.java:403)
	at org.springframework.beans.factory.BeanFactoryUtils.beanNamesForTypeIncludingAncestors(BeanFactoryUtils.java:206)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1265)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1099)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:583)
	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:364)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1269)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getSingletonFactoryBeanForTypeCheck(AbstractAutowireCapableBeanFactory.java:928)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getTypeForFactoryBean(AbstractAutowireCapableBeanFactory.java:805)
	at org.springframework.beans.factory.support.AbstractBeanFactory.isTypeMatch(AbstractBeanFactory.java:564)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doGetBeanNamesForType(DefaultListableBeanFactory.java:432)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanNamesForType(DefaultListableBeanFactory.java:403)
	at org.springframework.beans.factory.BeanFactoryUtils.beanNamesForTypeIncludingAncestors(BeanFactoryUtils.java:206)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1265)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1099)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:583)
	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:364)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1269)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:634)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:634)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getSingletonFactoryBeanForTypeCheck(AbstractAutowireCapableBeanFactory.java:928)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getTypeForFactoryBean(AbstractAutowireCapableBeanFactory.java:805)
	at org.springframework.beans.factory.support.AbstractBeanFactory.isTypeMatch(AbstractBeanFactory.java:564)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doGetBeanNamesForType(DefaultListableBeanFactory.java:432)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanNamesForType(DefaultListableBeanFactory.java:403)
	at org.springframework.beans.factory.BeanFactoryUtils.beanNamesForTypeIncludingAncestors(BeanFactoryUtils.java:206)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1265)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1099)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:835)
	at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:189)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:634)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:634)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getSingletonFactoryBeanForTypeCheck(AbstractAutowireCapableBeanFactory.java:928)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getTypeForFactoryBean(AbstractAutowireCapableBeanFactory.java:805)
	at org.springframework.beans.factory.support.AbstractBeanFactory.isTypeMatch(AbstractBeanFactory.java:564)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doGetBeanNamesForType(DefaultListableBeanFactory.java:432)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanNamesForType(DefaultListableBeanFactory.java:403)
	at org.springframework.beans.factory.BeanFactoryUtils.beanNamesForTypeIncludingAncestors(BeanFactoryUtils.java:206)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1265)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1099)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:583)
	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:364)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1269)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:634)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
	at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
	at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:634)
	at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getSingletonFactoryBeanForTypeCheck(AbstractAutowireCapableBeanFactory.java:928)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getTypeForFactoryBean(AbstractAutowireCapableBeanFactory.java:805)
	at org.springframework.beans.factory.support.AbstractBeanFactory.isTypeMatch(AbstractBeanFactory.java:564)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doGetBeanNamesForType(DefaultListableBeanFactory.java:432)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanNamesForType(DefaultListableBeanFactory.java:403)
	at org.springframework.beans.factory.BeanFactoryUtils.beanNamesForTypeIncludingAncestors(BeanFactoryUtils.java:206)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1265)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1099)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:583)
	at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:87)
	at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:364)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1269)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
	at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761)
	at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:867)
	at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:543)
	at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:443)
	at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:325)
	at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107)
	at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4770)
	at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5236)
	at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
	at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:754)
	at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:730)
	at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:744)
	at org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1135)
	at org.apache.catalina.startup.HostConfig$DeployDirectory.run(HostConfig.java:1869)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=68411: row 'ApplicationMapStatisticsCaller_Ver2,,00000000000000' on table 'hbase:meta' at region=hbase:meta,,1.1588230740, hostname=pinpoint-hbase-7658695468-7jmmq,46629,1585194839886, seqNum=0
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:169)
	at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
	... 3 more
Caused by: java.net.UnknownHostException: pinpoint-hbase-7658695468-7jmmq
	at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.<init>(AbstractRpcClient.java:315)
	at org.apache.hadoop.hbase.ipc.AbstractRpcClient.createBlockingRpcChannel(AbstractRpcClient.java:267)
	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getClient(ConnectionManager.java:1655)
	at org.apache.hadoop.hbase.client.ScannerCallable.prepare(ScannerCallable.java:163)
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.prepare(ScannerCallableWithReplicas.java:376)
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:134)
	... 4 more

The hbase's hostname is pinpoint-hbase-7658695468-7jmmq, but it must use service name.

I can't receive mail

cat .env

BATCH_ENABLE=true
BATCH_SERVER_IP=127.0.0.127
BATCH_FLINK_SERVER=pinpoint-flink-jobmanager

CONFIG_SHOW_APPLICATIONSTAT=true

JDBC_DRIVER=com.mysql.jdbc.Driver
JDBC_URL=jdbc:mysql://pinpoint-mysql:3306/pinpoint?characterEncoding=UTF-8
JDBC_USERNAME=admin
JDBC_PASSWORD=admin
MAIL_HOST=stmp.***.com
MAIL_PORT=25
MAIL_USERNAME=jie1.zhang@****.com
MAIL_PASSWORD=****
MAIL_PROPERTIES_MAIL_TRANSPORT_PROTOCOL=smtp
MAIL_PROPERTIES_MAIL_SMTP_AUTH=true
MAIL_PROPERTIES_MAIL_SMTP_PORT=25
MAIL_PROPERTIES_MAIL_SMTP_FROM=jie1.zhang@****.com
MAIL_PROPERTIES_MAIL_STARTTLS_ENABLE=true
MAIL_PROPERTIES_MAIL_STARTTLS_REQUIRED=true
MAIL_PROPERTIES_MAIL_DEBUG=true

pinpoint-quickstart test app not visible on APM WEB

Hi,

I am going to test pinpoint-quickstart app running on docker with our existing pinpoint collector which is running on VM as non docker container.

I did the following steps.
• git clone https://github.com/naver/pinpoint-docker.git
• cd pinpoint-docker/pinpoint-quickstart
• changed COLLECTOR_IP to X.X.X.X in .env file
• docker-compose pull && docker-compose up -d

Test web app is able to access successfully over port 8000. But pinpoint-agent is restarting frequently. And not able to see application in Pinpoint WEB.

docker ps output as below

image

docker logs 2c1146da0365 (pinpoint-quickstart) as below
Collector IP is 127.0.0.1 and not X.X.X.X

image

docker logs 95f451c577e4 (pinpoint-agent) as below

image

Please help me to resolve this.

Thanks,
Pradeep.

Zookeeper connection error when docker-compose up with poinpoint-hbase.

What version of pinpoint are you using?

master/v2.1.0

Describe the bug

When I start the pinpoint-hbase container using docker-compose.yml file in pinpoint-base directory, Zookeeper connection error occur.

What did you do to trigger the bug?

  1. Go to pinpoint-docker/pinpoint-hbase directory.
  2. run the command as $ docker-compose up

Expected behavior

I can connect the hbase web ui(http://www.localhost:16101/)

Logs

2020-09-13 03:28:51,157 ERROR [main] zookeeper.RecoverableZooKeeper: ZooKeeper create failed after 4 attempts
2020-09-13 03:28:51,158 ERROR [main] master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMaster. 
	at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2512)
	at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:231)
	at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:137)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
	at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2522)
Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: master:600000x0, quorum=zoo1:2181,zoo2:2181,zoo3:2181, baseZNode=/hbase Unexpected KeeperException creating base node
	at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:206)
	at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:187)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:572)
	at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:412)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2505)
	... 5 more
Caused by: org.apache.zookeeper.KeeperException$OperationTimeoutException: KeeperErrorCode = OperationTimeout
	at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.checkZk(RecoverableZooKeeper.java:144)
	at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.createNonSequential(RecoverableZooKeeper.java:565)
	at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.create(RecoverableZooKeeper.java:544)
	at org.apache.hadoop.hbase.zookeeper.ZKUtil.createWithParents(ZKUtil.java:1204)
	at org.apache.hadoop.hbase.zookeeper.ZKUtil.createWithParents(ZKUtil.java:1182)
	at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.createBaseZNodes(ZooKeeperWatcher.java:194)
	... 13 more

Additional context

I think the pinpoint-hbase container is not on the zookeeper bridge network.

Docker-compose start pinpoint-agent fail!

docker-compose start pinpoint-agent fail!

logs

[root@localhost pinpoint-docker-1.8.5]# docker logs -f 6b7b907db533
standard_init_linux.go:211: exec user process caused "no such file or directory"
standard_init_linux.go:211: exec user process caused "no such file or directory"
standard_init_linux.go:211: exec user process caused "no such file or directory"
standard_init_linux.go:211: exec user process caused "no such file or directory"

docker ps

6b7b907db533 pinpointdocker/pinpoint-agent:1.8.5 "/usr/local/bin/conf…" 6 minutes ago Restarting (1) 6 seconds ago pinpoint-agent

  It restart again and again :(

version

pinpoint-docker-1.8.5

docker version

[root@localhost pinpoint-docker-1.8.5]# docker version
Client: Docker Engine - Community
Version: 19.03.12
API version: 1.40
Go version: go1.13.10
Git commit: 48a66213fe
Built: Mon Jun 22 15:46:54 2020
OS/Arch: linux/amd64
Experimental: false

Server: Docker Engine - Community
Engine:
Version: 19.03.9
API version: 1.40 (minimum version 1.12)
Go version: go1.13.10
Git commit: 9d988398e7
Built: Fri May 15 00:24:05 2020
OS/Arch: linux/amd64
Experimental: false
containerd:
Version: 1.2.13
GitCommit: 7ad184331fa3e55e52b890ea95e65ba581ae3429
runc:
Version: 1.0.0-rc10
GitCommit: dc9208a3303feef5b3839f4323d9beb36df0a9dd
docker-init:
Version: 0.18.0
GitCommit: fec3683

attempt

The Internet is full of useless solutions. They say to switch the file format through the set ff command. But I have checked the files one by one, and the file formats are all unix.

Application/Agents Do Not Appear in Web UI

I have started the quickstart collector, web UI and test-app running on Windows Server 2016.
I am however unable to view any transactions in the Web UI, the Test Application was never discovered in the application list.
I get the same result when I use my own collector, web UI and agents.

I also checked the logs in quickstart/logs, no errors were found.
How can I troubleshoot this?

pinpont collector is not able to collect data from agent

I have pinpoint collector and pinpoint web running on kubernetes and Hbase outside of kubernetes
I have installed agent on one of the tomcat server and agent is connected to the collector and I can even see the agent on the web UI
But I don't see any data is being collected by collector and sending it to Hbase
and I am seeing below error in collector logs

2019-05-18 03:09:21 [INFO ](c.n.p.r.s.PinpointServerAcceptor ) channelConnected started. channel:[id: 0xe8bb63b4, /xx.xx.xx.xx:24188 => /xx.xx.xx.xx:9994] 2019-05-18 03:09:21 [INFO ](c.n.p.r.s.DefaultPinpointServer ) DefaultPinpointServer@463b2414 start() started. channel:[id: 0xe8bb63b4, /xx.xx.xx.xx:24188 => /xx.xx.xx.xx:9994]. 2019-05-18 03:09:21 [DEBUG](.n.p.r.s.DefaultPinpointServerState) DefaultPinpointServer@463b2414 stateTo() started. to:CONNECTED 2019-05-18 03:09:21 [INFO ](.n.p.r.s.DefaultPinpointServerState) DefaultPinpointServer@463b2414 stateTo() completed. Socket state change success(updateWanted:CONNECTED ,before:NONE ,current:CONNECTED). 2019-05-18 03:09:21 [DEBUG](.n.p.r.s.DefaultPinpointServerState) DefaultPinpointServer@463b2414 stateTo() started. to:RUN_WITHOUT_HANDSHAKE 2019-05-18 03:09:21 [INFO ](.n.p.r.s.DefaultPinpointServerState) DefaultPinpointServer@463b2414 stateTo() completed. Socket state change success(updateWanted:RUN_WITHOUT_HANDSHAKE ,before:CONNECTED ,current:RUN_WITHOUT_HANDSHAKE). 2019-05-18 03:09:21 [INFO ](c.n.p.r.s.DefaultPinpointServer ) DefaultPinpointServer@463b2414 start() completed. 2019-05-18 03:09:21 [DEBUG](.n.p.r.s.DefaultPinpointServerState) DefaultPinpointServer@463b2414 stateTo() started. to:UNEXPECTED_CLOSE_BY_CLIENT 2019-05-18 03:09:21 [INFO ](.t.AgentLifeCycleChangeEventHandler) AgentLifeCycleChangeEventHandler eventPerformed(). pinpointServer:DefaultPinpointServer@463b2414(remote:/xx.xx.xx.xx:24188, state:UNEXPECTED_CLOSE_BY_CLIENT, healthCheckState:WAIT), code:UNEXPECTED_CLOSE_BY_CLIENT 2019-05-18 03:09:21 [INFO ](.n.p.r.s.DefaultPinpointServerState) DefaultPinpointServer@463b2414 stateTo() completed. Socket state change success(updateWanted:UNEXPECTED_CLOSE_BY_CLIENT ,before:RUN_WITHOUT_HANDSHAKE ,current:UNEXPECTED_CLOSE_BY_CLIENT). 2019-05-18 03:09:21 [INFO ](.c.r.t.t.AgentLifeCycleEventHandler) Handle lifecycle event - pinpointServer:DefaultPinpointServer@463b2414(remote:/xx.xx.xx.xx:24188, state:UNEXPECTED_CLOSE_BY_CLIENT, healthCheckState:WAIT), state:Unexpected Shutdown 2019-05-18 03:09:21 [WARN ](c.n.p.c.r.t.t.AgentEventHandler ) maybe not yet received the handshake data - pinpointServer:DefaultPinpointServer@463b2414(remote:/xx.xx.xx.xx:24188, state:UNEXPECTED_CLOSE_BY_CLIENT, healthCheckState:WAIT) 2019-05-18 03:09:21 [DEBUG](.c.r.t.t.AgentLifeCycleEventHandler) socketId not found, agent does not support life cycle management - pinpointServer:DefaultPinpointServer@463b2414(remote:/xx.xx.xx.xx:24188, state:UNEXPECTED_CLOSE_BY_CLIENT, healthCheckState:WAIT)

can you please help here

Pinpon-docker has mail notification

Hi, I want to ask if this version has posibility to send mail alarms, I modified AlarmMessageSenderImple, then, I compiled project and move AlarmMessageSenderImple.class inside pinpoint-web container in webapp/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/alarm/

package com.navercorp.pinpoint.web.alarm;

import java.util.List;

import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.mail.MailSender;
import org.springframework.mail.SimpleMailMessage;

import com.navercorp.pinpoint.web.alarm.checker.AlarmChecker;
import com.navercorp.pinpoint.web.service.UserGroupService;

public class AlarmMessageSenderImple implements AlarmMessageSender {

    private final Logger logger = LoggerFactory.getLogger(this.getClass());
    
    private MailSender mailSender;

    public void setMailSender(MailSender mailSender) {
	logger.info("debug1");
		this.mailSender = mailSender;
	}

	@Autowired
    private UserGroupService userGroupService;
    
    @Override
    public void sendSms(AlarmChecker checker, int sequenceCount) {
        List<String> receivers = userGroupService.selectPhoneNumberOfMember(checker.getuserGroupId());

        if (receivers.size() == 0) {
            return;
        }

        //for (String message : checker.getSmsMessage()) {
            logger.info("send SMS : {} TODO");

            // TODO Implement logic for sending SMS
        //}
    }

    @Override
    public void sendEmail(AlarmChecker checker, int sequenceCount) {
	logger.info("debug2");
	List<String> receivers = userGroupService.selectEmailOfMember(checker.getuserGroupId());

        if (receivers.size() == 0) {
            return;
        }

        logger.info("send email : {}", checker.getEmailMessage());
        try{
	        SimpleMailMessage message = new SimpleMailMessage(); 
	        message.setTo(receivers.toArray(new String [receivers.size()])); 
	        message.setSubject(String.format("[PINPOINT Alarm - %s]", checker.getRule().getApplicationId())); 
	        message.setText(String.format("%s\n\n%s", checker.getEmailMessage(), checker.getRule().getNotes()));
	        mailSender.send(message);
	logger.info("debug3");
        }catch(Exception e){
        	logger.error("send email error", e);
        }
    }
}

So if I watched log container:

docker logs -f pinpoint-web | grep AlarmMessageSenderImple

So, I only see inject method in log info: logger.info("debug1"); , but I never see sendEmail method I configured all files in web container, described on https://naver.github.io/pinpoint/1.8.0/alarm.html

If I watch SQL Tables alarm_rule has my alert rows, but alarm_history doesn't have rows

Thanks in advace, so Sorry my poor english

Pinpoint Agent not able to connect to pinpoint dockerized collector

Hi team,

We are facing connectivity issues while connecting to dockerized collector from pinpoint agent which is successfully hooked to dockerized application. Attached the output of pinpoint collector port used.

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

559e8b9d9f2f pinpointdocker/pinpoint-collector:1.8.2 "/usr/local/bin/star…" 3 days ago Up 2 days 8080/tcp, 0.0.0.0:9994-9996->9994-9996/tcp, 0.0.0.0:9995-9996->9995-9996/udp pinpoint-collector

Env:
collector deployed on Mac whereas the agent resides on ubuntu trusty

Agent log shows the error message as:
2019-03-01 03:48:57 WARN request failed.
com.navercorp.pinpoint.rpc.PinpointSocketException: reconnecting...
at com.navercorp.pinpoint.rpc.client.ReconnectStateClientHandler.newReconnectException(ReconnectStateClientHandler.java:84)
at com.navercorp.pinpoint.rpc.client.ReconnectStateClientHandler.reconnectFailureFuture(ReconnectStateClientHandler.java:70)
at com.navercorp.pinpoint.rpc.client.ReconnectStateClientHandler.request(ReconnectStateClientHandler.java:89)
at com.navercorp.pinpoint.rpc.client.DefaultPinpointClient.request(DefaultPinpointClient.java:123)
at com.navercorp.pinpoint.profiler.sender.TcpDataSender.doRequest(TcpDataSender.java:344)
at com.navercorp.pinpoint.profiler.sender.TcpDataSender.doRequest(TcpDataSender.java:230)
at com.navercorp.pinpoint.profiler.sender.TcpDataSender.sendPacket(TcpDataSender.java:208)
at com.navercorp.pinpoint.profiler.sender.TcpDataSender$1.execute(TcpDataSender.java:108)
at com.navercorp.pinpoint.profiler.sender.AsyncQueueingExecutor.doExecute(AsyncQueueingExecutor.java:166)
at com.navercorp.pinpoint.profiler.sender.AsyncQueueingExecutor.doExecute(AsyncQueueingExecutor.java:96)
at com.navercorp.pinpoint.profiler.sender.AsyncQueueingExecutor.run(AsyncQueueingExecutor.java:79)
at java.lang.Thread.run(Thread.java:745)
2019-03-01 03:48:57 WARN try reconnect. connectAddress:DnsSocketAddressProvider{host='10.239.51.21', port=9994}
2019-03-01 03:48:57 INFO DefaultPinpointClientHandler@6c152975 initReconnect() started.
2019-03-01 03:48:57 INFO DefaultPinpointClientHandler@6c152975 stateTo() completed. Socket state change success(updateWanted:BEING_CONNECT ,before:NONE ,current:BEING_CONNECT).
2019-03-01 03:48:57 INFO DefaultPinpointClientHandler@6c152975 initReconnect() completed.
2019-03-01 03:49:02 INFO DefaultPinpointClientHandler@6c152975 channelClosed() started.
2019-03-01 03:49:02 INFO DefaultPinpointClientHandler@6c152975 stateTo() completed. Socket state change success(updateWanted:CONNECT_FAILED ,before:BEING_CONNECT ,current:CONNECT_FAILED).
2019-03-01 03:49:02 INFO PinpointClientHandshaker@5c20e602 handshakeAbort() started.
2019-03-01 03:49:02 WARN DefaultPinpointClientHandler@6c152975 exceptionCaught() occurred. state:CONNECT_FAILED. Caused:connection timed out: /10.239.51.21:9994
org.jboss.netty.channel.ConnectTimeoutException: connection timed out: /10.239.51.21:9994
at org.jboss.netty.channel.socket.nio.NioClientBoss.processConnectTimeout(NioClientBoss.java:139)
at org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:83)
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
at org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42)
at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2019-03-01 03:49:02 INFO PinpointClientHandshaker@5c20e602 unexpected state

Agent options used:

-javaagent:/opt/pinpoint/pinpoint-bootstrap-1.8.2.jar, -Dpinpoint.agentId=XXXX, -Dpinpoint.applicationName=UBDS,

We were able to connect if we deploy all components of pinpoint on the same host.

Thanks
Sattish.

request pinpoint-web got 404

docker run:

[root@iZ2ze0ephck4d1aw6rxk8gZ ~]# docker run -itd -p 20000:8080 --env SPRING_PROFILES="release" pinpointdocker/pinpoint-web:2.0.4
1da44fb5c610c68b299650a7b6fe967b78e9cc2a23db4fd6340c7b2dda50ac0f
[root@iZ2ze0ephck4d1aw6rxk8gZ ~]# curl localhost:20000
<!doctype html><title>HTTP Status 404 – Not Found</title><style type="text/css">h1 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:22px;} h2 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:16px;} h3 {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;font-size:14px;} body {font-family:Tahoma,Arial,sans-serif;color:black;background-color:white;} b {font-family:Tahoma,Arial,sans-serif;color:white;background-color:#525D76;} p {font-family:Tahoma,Arial,sans-serif;background:white;color:black;font-size:12px;} a {color:black;} a.name {color:black;} .line {height:1px;background-color:#525D76;border:none;}</style>

HTTP Status 404 – Not Found


Type Status Report

Message Not found

Description The origin server did not find a current representation for the target resource or is not willing to disclose that one exists.


Apache Tomcat/8.5.41

[root@iZ2ze0ephck4d1aw6rxk8gZ ~]#

docker logs:

[root@iZ2ze0ephck4d1aw6rxk8gZ ~]# docker logs --tail 2000 1da44fb5c610
21-Oct-2020 09:06:31.595 INFO [Thread-6] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-8080"]
21-Oct-2020 09:06:31.603 INFO [Thread-6] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["ajp-nio-8009"]
21-Oct-2020 09:06:31.609 INFO [Thread-6] org.apache.catalina.core.StandardService.stopInternal Stopping service [Catalina]
21-Oct-2020 09:06:31.610 INFO [Thread-6] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["http-nio-8080"]
21-Oct-2020 09:06:31.612 INFO [Thread-6] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["ajp-nio-8009"]
21-Oct-2020 09:06:31.614 INFO [Thread-6] org.apache.coyote.AbstractProtocol.destroy Destroying ProtocolHandler ["http-nio-8080"]
21-Oct-2020 09:06:31.615 INFO [Thread-6] org.apache.coyote.AbstractProtocol.destroy Destroying ProtocolHandler ["ajp-nio-8009"]

  • WEB_INF_CLASSES_DIR=/usr/local/tomcat/webapps/ROOT/WEB-INF/classes
  • APPLICATION_WEB_PROPERTIES=/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/pinpoint-web.properties
  • APPLICATION_HBASE_PROPERTIES=/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/profiles/release/hbase-env.properties
  • APPLICATION_BATCH_PROPERTIES=/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • APPLICATION_JDBC_PROPERTIES=/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/jdbc.properties
  • sed -i '/cluster.enable=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/pinpoint-web.properties
  • sed -i '/admin.password=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/pinpoint-web.properties
  • sed -i '/config.sendUsage=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/pinpoint-web.properties
  • sed -i '/config.show.applicationStat=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/pinpoint-web.properties
  • sed -i '/hbase.client.host=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/profiles/release/hbase-env.properties
  • sed -i '/hbase.client.port=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/profiles/release/hbase-env.properties
  • sed -i '/batch.enable=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/batch.server.ip=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/batch.flink.server=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/level value=/ s/=.*/=""/>/g' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/profiles/release/log4j.xml
  • sed -i '/jdbc.driverClassName=/ s/=.*/=com.mysql.jdbc.Driver/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/jdbc.properties
  • sed -i '/jdbc.url=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/jdbc.properties
  • sed -i '/jdbc.username=/ s/=.*/=admin/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/jdbc.properties
  • sed -i '/jdbc.password=/ s/=.*/=admin/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/jdbc.properties
  • sed -i '/alarm.mail.server.url=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.server.port=/ s/=.*/=587/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.server.username=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.server.password=/ s/=.*/=/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.sender.address=/ s/=.*/=[email protected]/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.transport.protocol=/ s/=.*/=smtp/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.smtp.port=/ s/=.*/=587/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.smtp.auth=/ s/=.*/=false/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.smtp.starttls.enable=/ s/=.*/=false/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.smtp.starttls.required=/ s/=.*/=false/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • sed -i '/alarm.mail.debug=/ s/=.*/=false/' /usr/local/tomcat/webapps/ROOT/WEB-INF/classes/batch.properties
  • exec /usr/local/tomcat/bin/catalina.sh run
    Using CATALINA_BASE: /usr/local/tomcat
    Using CATALINA_HOME: /usr/local/tomcat
    Using CATALINA_TMPDIR: /usr/local/tomcat/temp
    Using JRE_HOME: /docker-java-home/jre
    Using CLASSPATH: /usr/local/tomcat/bin/bootstrap.jar:/usr/local/tomcat/bin/tomcat-juli.jar
    21-Oct-2020 09:06:55.768 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version: Apache Tomcat/8.5.41
    21-Oct-2020 09:06:55.774 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: May 4 2019 09:17:16 UTC
    21-Oct-2020 09:06:55.774 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server number: 8.5.41.0
    21-Oct-2020 09:06:55.774 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 4.19.91-18.al7.x86_64
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /usr/lib/jvm/java-8-openjdk-amd64/jre
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 1.8.0_212-8u212-b01-1~deb9u1-b01
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: Oracle Corporation
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /usr/local/tomcat
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /usr/local/tomcat
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/local/tomcat/conf/logging.properties
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
    21-Oct-2020 09:06:55.775 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027
    21-Oct-2020 09:06:55.776 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs=
    21-Oct-2020 09:06:55.776 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/local/tomcat
    21-Oct-2020 09:06:55.776 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/local/tomcat
    21-Oct-2020 09:06:55.776 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/usr/local/tomcat/temp
    21-Oct-2020 09:06:55.776 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded APR based Apache Tomcat Native library [1.2.21] using APR version [1.5.2].
    21-Oct-2020 09:06:55.776 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].
    21-Oct-2020 09:06:55.776 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
    21-Oct-2020 09:06:55.780 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.1.0j 20 Nov 2018]
    21-Oct-2020 09:06:55.864 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
    21-Oct-2020 09:06:55.872 INFO [main] org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using a shared selector for servlet write/read
    21-Oct-2020 09:06:55.882 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-8009"]
    21-Oct-2020 09:06:55.883 INFO [main] org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using a shared selector for servlet write/read
    21-Oct-2020 09:06:55.884 INFO [main] org.apache.catalina.startup.Catalina.load Initialization processed in 497 ms
    21-Oct-2020 09:06:55.903 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina]
    21-Oct-2020 09:06:55.903 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet Engine: Apache Tomcat/8.5.41
    21-Oct-2020 09:06:55.911 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory [/usr/local/tomcat/webapps/ROOT]
    2020-10-21T09:07:01.599 PinpointWebApplicationInitializer::ActiveProfile:release
    21-Oct-2020 09:07:01.857 INFO [localhost-startStop-1] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
    2020-10-21 09:07:04 WARN Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    2020-10-21 09:07:04 WARN Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'hbaseAgentEventDao' defined in file [/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/dao/hbase/HbaseAgentEventDao.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'hbaseTraceDaoFactory' defined in file [/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/dao/hbase/HbaseTraceDaoFactory.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'hbaseTraceDaoV2' defined in file [/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/dao/hbase/HbaseTraceDaoV2.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTemplate' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'hbaseTableFactory' while setting bean property 'tableFactory'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTableFactory' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'connectionFactory' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'connectionFactory' defined in class path resource [applicationContext-web-hbase.xml]: Invocation of init method failed; nested exception is com.navercorp.pinpoint.common.hbase.HbaseSystemException: java.lang.reflect.InvocationTargetException; nested exception is java.io.IOException: java.lang.reflect.InvocationTargetException
    2020-10-21 09:07:04 ERROR Context initialization failed
    org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'hbaseAgentEventDao' defined in file [/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/dao/hbase/HbaseAgentEventDao.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'hbaseTraceDaoFactory' defined in file [/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/dao/hbase/HbaseTraceDaoFactory.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'hbaseTraceDaoV2' defined in file [/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/dao/hbase/HbaseTraceDaoV2.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTemplate' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'hbaseTableFactory' while setting bean property 'tableFactory'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTableFactory' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'connectionFactory' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'connectionFactory' defined in class path resource [applicationContext-web-hbase.xml]: Invocation of init method failed; nested exception is com.navercorp.pinpoint.common.hbase.HbaseSystemException: java.lang.reflect.InvocationTargetException; nested exception is java.io.IOException: java.lang.reflect.InvocationTargetException
    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:189)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:761)
    at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:867)
    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:543)
    at org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:443)
    at org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:325)
    at org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107)
    at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4770)
    at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5236)
    at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
    at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:754)
    at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:730)
    at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:744)
    at org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1135)
    at org.apache.catalina.startup.HostConfig$DeployDirectory.run(HostConfig.java:1869)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
    Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'hbaseTraceDaoFactory' defined in file [/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/dao/hbase/HbaseTraceDaoFactory.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'hbaseTraceDaoV2' defined in file [/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/dao/hbase/HbaseTraceDaoV2.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTemplate' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'hbaseTableFactory' while setting bean property 'tableFactory'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTableFactory' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'connectionFactory' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'connectionFactory' defined in class path resource [applicationContext-web-hbase.xml]: Invocation of init method failed; nested exception is com.navercorp.pinpoint.common.hbase.HbaseSystemException: java.lang.reflect.InvocationTargetException; nested exception is java.io.IOException: java.lang.reflect.InvocationTargetException
    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:189)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getSingletonFactoryBeanForTypeCheck(AbstractAutowireCapableBeanFactory.java:928)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getTypeForFactoryBean(AbstractAutowireCapableBeanFactory.java:805)
    at org.springframework.beans.factory.support.AbstractBeanFactory.isTypeMatch(AbstractBeanFactory.java:564)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doGetBeanNamesForType(DefaultListableBeanFactory.java:432)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanNamesForType(DefaultListableBeanFactory.java:403)
    at org.springframework.beans.factory.BeanFactoryUtils.beanNamesForTypeIncludingAncestors(BeanFactoryUtils.java:206)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1265)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1099)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:835)
    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
    ... 28 more
    Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'hbaseTraceDaoV2' defined in file [/usr/local/tomcat/webapps/ROOT/WEB-INF/classes/com/navercorp/pinpoint/web/dao/hbase/HbaseTraceDaoV2.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTemplate' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'hbaseTableFactory' while setting bean property 'tableFactory'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTableFactory' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'connectionFactory' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'connectionFactory' defined in class path resource [applicationContext-web-hbase.xml]: Invocation of init method failed; nested exception is com.navercorp.pinpoint.common.hbase.HbaseSystemException: java.lang.reflect.InvocationTargetException; nested exception is java.io.IOException: java.lang.reflect.InvocationTargetException
    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:189)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
    at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1136)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:835)
    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
    ... 42 more
    Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTemplate' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'hbaseTableFactory' while setting bean property 'tableFactory'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTableFactory' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'connectionFactory' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'connectionFactory' defined in class path resource [applicationContext-web-hbase.xml]: Invocation of init method failed; nested exception is com.navercorp.pinpoint.common.hbase.HbaseSystemException: java.lang.reflect.InvocationTargetException; nested exception is java.io.IOException: java.lang.reflect.InvocationTargetException
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:359)
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1534)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1281)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
    at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:208)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1136)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:835)
    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
    ... 56 more
    Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'hbaseTableFactory' defined in class path resource [applicationContext-web-hbase.xml]: Cannot resolve reference to bean 'connectionFactory' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'connectionFactory' defined in class path resource [applicationContext-web-hbase.xml]: Invocation of init method failed; nested exception is com.navercorp.pinpoint.common.hbase.HbaseSystemException: java.lang.reflect.InvocationTargetException; nested exception is java.io.IOException: java.lang.reflect.InvocationTargetException
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:359)
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
    at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648)
    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1198)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1100)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:511)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
    ... 70 more
    Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'connectionFactory' defined in class path resource [applicationContext-web-hbase.xml]: Invocation of init method failed; nested exception is com.navercorp.pinpoint.common.hbase.HbaseSystemException: java.lang.reflect.InvocationTargetException; nested exception is java.io.IOException: java.lang.reflect.InvocationTargetException
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1631)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:553)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481)
    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:308)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
    ... 82 more
    Caused by: com.navercorp.pinpoint.common.hbase.HbaseSystemException: java.lang.reflect.InvocationTargetException; nested exception is java.io.IOException: java.lang.reflect.InvocationTargetException
    at com.navercorp.pinpoint.common.hbase.ConnectionFactoryBean.afterPropertiesSet(ConnectionFactoryBean.java:79)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1689)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1627)
    ... 89 more
    Caused by: java.io.IOException: java.lang.reflect.InvocationTargetException
    at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:240)
    at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:218)
    at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:150)
    at com.navercorp.pinpoint.common.hbase.ConnectionFactoryBean.afterPropertiesSet(ConnectionFactoryBean.java:76)
    ... 91 more
    Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at org.apache.hadoop.hbase.client.ConnectionFactory.createConnection(ConnectionFactory.java:238)
    ... 94 more
    Caused by: java.lang.NumberFormatException: For input string: ""
    at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
    at java.lang.Integer.parseInt(Integer.java:592)
    at java.lang.Integer.parseInt(Integer.java:615)
    at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1104)
    at org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersStringFromHbaseConfig(ZKConfig.java:306)
    at org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:328)
    at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.(ZooKeeperWatcher.java:178)
    at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.(ZooKeeperWatcher.java:153)
    at org.apache.hadoop.hbase.client.ZooKeeperKeepAliveConnection.(ZooKeeperKeepAliveConnection.java:43)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getKeepAliveZooKeeperWatcher(ConnectionManager.java:1706)
    at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:104)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.retrieveClusterId(ConnectionManager.java:916)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(ConnectionManager.java:659)
    at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.(ConnectionManager.java:637)
    ... 99 more
    21-Oct-2020 09:07:04.423 SEVERE [localhost-startStop-1] org.apache.catalina.core.StandardContext.startInternal One or more listeners failed to start. Full details will be found in the appropriate container log file
    21-Oct-2020 09:07:04.428 SEVERE [localhost-startStop-1] org.apache.catalina.core.StandardContext.startInternal Context [] startup failed due to previous errors
    21-Oct-2020 09:07:04.446 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/usr/local/tomcat/webapps/ROOT] has finished in [8,535] ms
    21-Oct-2020 09:07:04.448 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"]
    21-Oct-2020 09:07:04.491 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-8009"]
    21-Oct-2020 09:07:04.494 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in 8609 ms
    [root@iZ2ze0ephck4d1aw6rxk8gZ ~]#

Error while uploading pinpoint-flink-job-2.0.2.jar in Apache Flink Dashboard

Issues - my pinpoint setup is running on top of docker , all the services are running well , even the "quickapp" also visible on pinpoint and i am able to see the request coming in.

The problem i am facing now is while uploading the jar - pinpoint-flink-job-2.0.2.jar

org.apache.flink.client.program.ProgramInvocationException: The main method caused an error.
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:545)
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:419)
at org.apache.flink.client.program.OptimizerPlanEnvironment.getOptimizedPlan(OptimizerPlanEnvironment.java:80)
at org.apache.flink.client.program.ClusterClient.getOptimizedPlan(ClusterClient.java:318)
at org.apache.flink.runtime.webmonitor.handlers.JarActionHandler.getJobGraphAndClassLoader(JarActionHandler.java:72)


Caused by: org.apache.flink.api.common.InvalidProgramException: The LocalStreamEnvironment cannot be used when submitting a program through a client, or running in a TestEnvironment context.
at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.(LocalStreamEnvironment.java:68)
at org.apache.flink.streaming.api.environment.LocalStreamEnvironment.(LocalStreamEnvironment.java:58)
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironment(StreamExecutionEnvironment.java:1626)
at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.createLocalEnvironment(StreamExecutionEnvironment.java:1612)
at com.navercorp.pinpoint.flink.Bootstrap.createStreamExecutionEnvironment(Bootstrap.java:163)
at com.navercorp.pinpoint.flink.StatStreamingVer2Job.start(StatStreamingVer2Job.java:57)
at com.navercorp.pinpoint.flink.StatStreamingVer2Job.main(StatStreamingVer2Job.java:48)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528)

Can we run Pinpoint Agent as a daemonset or sidecar across the deployment in any contain ecosystem?

Context:

In my Kubernetes infrastructure, there were 100 of Apps (90% of Spring boot apps + 10% of Node JS App) running on GCP(GKE) Environment.

Questions:

Can i run pinpoint agent as below, I am aware of that Pinpoint agent does byte code instrumentation and it runs along with app container, However just curious to understand which one would be the "Best way to induce/integrate Pinpoint Agent in Spring boot appl running as a container"

  1. Is it right methodology to run Pinpoint java agent as a daemonset

  2. How about running as a side-car container along with spring boot app container along side?

  3. As a default option to run a docker-compose file to run spring boot+Pinpoint Agent as a single container deployment ?

These all are assumptions, Hence please do correct me If I have misinterpreted anything here

pinpoint-quickstart test application not visible on pinpoint web

Hello,

I started to using pinpoint apm with docker compose. In this tutorial (https://github.com/pinpoint-apm/pinpoint-docker).

I executed belowing commands;

git clone https://github.com/naver/pinpoint-docker.git
cd pinpoint-docker
docker-compose pull && docker-compose up -d

All containers up & running.When i open pinpoint web "select your application" is empty, agent statistics&management at settings empty. I didnt change anything else.

I saw an error in pinpoint web log.

ERROR c.n.p.w.b.f.HealthCheckTaskletV2 -- fail call api to flink server. org.springframework.web.client.HttpServerErrorException$InternalServerError: 500 Internal Server Error: [java.lang.RuntimeException: Invalid JobID string 'overview': contains illegal character for hexBinary: overview at org.apache.flink.runtime.webmonitor.handlers.AbstractExecutionGraphRequestHandler.ha... (3627 bytes)] at org.springframework.web.client.HttpServerErrorException.create(HttpServerErrorException.java:100) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:186) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:125) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.web.client.ResponseErrorHandler.handleError(ResponseErrorHandler.java:63) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.web.client.RestTemplate.handleResponse(RestTemplate.java:782) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:740) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:674) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.web.client.RestTemplate.exchange(RestTemplate.java:583) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at com.navercorp.pinpoint.web.batch.flink.HealthCheckTaskletV2.execute(HealthCheckTaskletV2.java:72) [classes!/:2.2.1] at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) [spring-tx-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) [spring-batch-infrastructure-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) [spring-batch-infrastructure-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) [spring-batch-infrastructure-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:148) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.job.flow.JobFlowExecutor.executeStep(JobFlowExecutor.java:68) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.job.flow.support.state.StepState.handle(StepState.java:68) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.job.flow.support.SimpleFlow.resume(SimpleFlow.java:169) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.job.flow.support.SimpleFlow.start(SimpleFlow.java:144) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.job.flow.FlowJob.doExecute(FlowJob.java:137) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:319) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:147) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50) [spring-core-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE] at com.navercorp.pinpoint.web.batch.JobLaunchSupport.run(JobLaunchSupport.java:51) [classes!/:2.2.1] at com.navercorp.pinpoint.web.batch.BatchJobLauncher.flinkCheckJob(BatchJobLauncher.java:66) [classes!/:2.2.1] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212] at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) [spring-context-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) [spring-context-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:93) [spring-context-5.2.7.RELEASE.jar!/:5.2.7.RELEASE] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_212] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_212] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_212] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_212] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_212]

Please help me to resolve this.

Thanks.

pinpoint agent version problem

I have a problem with the pinpoint version.

I cloned the latest version (2.0.4) and run immediately, but the pinpoint-agent version is 2.0.3. in docker container.

image

yml or dockfile bug?

Error opening zip file or JAR manifest missing : /pinpoint-agent/pinpoint-bootstrap-1.8.4.jar
pinpointdocker/pinpoint-quickstart "catalina.sh run" 52 seconds ago Exited (1) 51 seconds ago

when i map volume to a path,error

我在docker-compose.yml 中对 pinpoint-hbase volumes做了映射,(others keep default):

 pinpoint-hbase:
   ......
    volumes:
      - ./data/hbase:/home/pinpoint/hbase
      - ./data/zookeeper:/home/pinpoint/zookeeper

然后就出现启动,打开首页,就会出错,显示‘applicationList.pinpoint’一直在那里转呀转呀的。为什么呀?不科学呀

部分错误日志如下:

pinpoint-web          | 2020-07-22 01:36:01 [ERROR](o.s.b.c.s.AbstractStep             ) Encountered an error executing step alarmStep in job alarmJob
pinpoint-web          | com.navercorp.pinpoint.common.hbase.HbaseSystemException: ApplicationIndex; nested exception is org.apache.hadoop.hbase.TableNotFoundException: ApplicationIndex
pinpoint-web          | 	at com.navercorp.pinpoint.common.hbase.HbaseTemplate2.execute(HbaseTemplate2.java:763)
pinpoint-web          | 	at com.navercorp.pinpoint.common.hbase.HbaseTemplate2.find(HbaseTemplate2.java:190)
pinpoint-web          | 	at com.navercorp.pinpoint.common.hbase.HbaseTemplate2.find(HbaseTemplate2.java:219)
pinpoint-web          | 	at com.navercorp.pinpoint.web.dao.hbase.HbaseApplicationIndexDao.selectAllApplicationNames(HbaseApplicationIndexDao.java:75)
pinpoint-web          | 	at com.navercorp.pinpoint.web.alarm.AlarmReader.beforeStep(AlarmReader.java:69)
pinpoint-web          | 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
pinpoint-web          | 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
pinpoint-web          | 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
pinpoint-web          | 	at java.lang.reflect.Method.invoke(Method.java:498)
pinpoint-web          | 	at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:333)
pinpoint-web          | 	at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190)
pinpoint-web          | 	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
pinpoint-web          | 	at org.springframework.aop.support.DelegatingIntroductionInterceptor.doProceed(DelegatingIntroductionInterceptor.java:133)
pinpoint-web          | 	at org.springframework.aop.support.DelegatingIntroductionInterceptor.invoke(DelegatingIntroductionInterceptor.java:121)
pinpoint-web          | 	at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
pinpoint-web          | 	at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)
pinpoint-web          | 	at com.sun.proxy.$Proxy53.beforeStep(Unknown Source)
pinpoint-web          | 	at org.springframework.batch.core.listener.CompositeStepExecutionListener.beforeStep(CompositeStepExecutionListener.java:77)
pinpoint-web          | 	at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:196)
pinpoint-web          | 	at org.springframework.batch.core.partition.support.TaskExecutorPartitionHandler$1.call(TaskExecutorPartitionHandler.java:139)
pinpoint-web          | 	at org.springframework.batch.core.partition.support.TaskExecutorPartitionHandler$1.call(TaskExecutorPartitionHandler.java:136)
pinpoint-web          | 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
pinpoint-web          | 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
pinpoint-web          | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
pinpoint-web          | 	at java.lang.Thread.run(Thread.java:748)
pinpoint-web          | Caused by: org.apache.hadoop.hbase.TableNotFoundException: ApplicationIndex
pinpoint-web          | 	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegionInMeta(ConnectionManager.java:1301)
pinpoint-web          | 	at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.locateRegion(ConnectionManager.java:1192)
......

Pinpoint Agent always report "Connection refused: /127.0.0.1:9993" periodically while startup application

Hi @RoySRose
I met the same issue. BTW, we had ever use pinpoint 1.8.5 as APM for our product environment, very good tool, but we really need the new feature which supports spring cloud gateway, so we expect to upgrade to 2.0.1. The following is my env and result,

Version is 2.0.1
Got it from 2.0.1 docker release tar file, and the agent was from Pinpoint (not docker) 2.0.1 release tar. No any changes after download.
Started the server with docker-compose up, and launched my app(spring boot 2.2.x) from my PC (not docker) with the following VM options.
-javaagent:./zz-resource/pinpoint-agent-2.0.1/pinpoint-bootstrap-2.0.1.jar -Dpinpoint.applicationName=upms -Dpinpoint.agentId=upms
And I found the console of my app always output the following exception messages periodically
io.grpc.StatusRuntimeException: UNAVAILABLE: io exception
at io.grpc.Status.asRuntimeException(Status.java:526)
at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:420)
at io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
at io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
at io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:459)
at io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:63)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:546)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$600(ClientCallImpl.java:467)
at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:584)
at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /127.0.0.1:9993
Caused by: java.net.ConnectException: Connection refused
... ....

And then I run the linux command, netstat -an | grep 9993, the following output.
udp46 0 0 *.9992 .

At this time, I can access lcoalhost:8079 from browser, but no data collected.

I made one change in docker-compose.yml of root directory.

I changed the ports for image pinpoint-collector,
FROM
ports:

"${COLLECTOR_RECEIVER_AGENT_PORT:-9991}:9991/udp"
"${COLLECTOR_RECEIVER_METADATA_PORT:-9991}:9991/tcp"
"${COLLECTOR_RECEIVER_STAT_PORT:-9992}:9992/udp"
"${COLLECTOR_RECEIVER_SPAN_PORT:-9993}:9993/udp"
TO
ports:
"${COLLECTOR_RECEIVER_AGENT_PORT:-9991}:9991/udp"
"${COLLECTOR_RECEIVER_METADATA_PORT:-9991}:9991/tcp"
"${COLLECTOR_RECEIVER_STAT_PORT:-9992}:9992/tcp"
"${COLLECTOR_RECEIVER_SPAN_PORT:-9993}:9993/tcp"
After this change, TCP port(9992 and 9993) can be connected from the agent of my app while launching, and no socket connection exception thrown again.

But I started all the apps with the same VM options (of course, agentId and applicationName are different), and then access the url (localhost:8079), what it shows is "User -> one app -> MySQL", for gateway, one "User -> gateway", even if the gateway really forwarded the request to one service. For service to service case, no services calling chain was shown.

According to my conclusion, after the change the expose port(9992 and 9993) type from UDP to TCP, data can be collected, but the whole calling chain (between service and service, service and gateway) isn't setup.

pinpoint-quickstart not running

Hi i've run docker-compose after that pinpoint-quickstart on port 8000 still not running but apache-flink is running well.
when i check netstat -an there is no port 8000.

can anyone help me for this issue?

pinpoint-web generates InternalServerError after REST call to jobmanager

What version of pinpoint are you using?
v2.2.1

Describe the bug
pinpoint-web container gets an InternalServerError when it tries to do a REST call to a jobmanager's endpoint:

http://jobmanager:8081/jobs/overview

What did you do to trigger the bug?

Run the pinpoint stack with docker-compose

Additional context

A curl from within the pinpoint-web container on http://jobmanager:8081/jobs returns results:

{"jobs-running":["ff7ef196f1cf71c53e3f96474245cf17"],"jobs-finished":[],"jobs-cancelled":[],"jobs-failed":[]}

A curl from within the pinpoint-web container on http://jobmanager:8081/jobs/overview returns the same error:

java.lang.RuntimeException: Invalid JobID string 'overview': contains illegal character for hexBinary: overview

Logs pinpoint-web

02-09 14:20:00.000 [ scheduler-2] ERROR c.n.p.w.b.f.HealthCheckTaskletV2 -- fail call api to flink server.
org.springframework.web.client.HttpServerErrorException$InternalServerError: 500 Internal Server Error: [java.lang.RuntimeException: Invalid JobID string 'overview': contains illegal character for hexBinary: overview

at org.apache.flink.runtime.webmonitor.handlers.AbstractExecutionGraphRequestHandler.ha... (3627 bytes)]
at org.springframework.web.client.HttpServerErrorException.create(HttpServerErrorException.java:100) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:186) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:125) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.web.client.ResponseErrorHandler.handleError(ResponseErrorHandler.java:63) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.web.client.RestTemplate.handleResponse(RestTemplate.java:782) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:740) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:674) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.web.client.RestTemplate.exchange(RestTemplate.java:583) ~[spring-web-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at com.navercorp.pinpoint.web.batch.flink.HealthCheckTaskletV2.execute(HealthCheckTaskletV2.java:72) [classes!/:2.2.1]
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:407) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.step.tasklet.TaskletStep$ChunkTransactionCallback.doInTransaction(TaskletStep.java:331) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.transaction.support.TransactionTemplate.execute(TransactionTemplate.java:140) [spring-tx-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.batch.core.step.tasklet.TaskletStep$2.doInChunkContext(TaskletStep.java:273) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.scope.context.StepContextRepeatCallback.doInIteration(StepContextRepeatCallback.java:82) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.repeat.support.RepeatTemplate.getNextResult(RepeatTemplate.java:375) [spring-batch-infrastructure-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.repeat.support.RepeatTemplate.executeInternal(RepeatTemplate.java:215) [spring-batch-infrastructure-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.repeat.support.RepeatTemplate.iterate(RepeatTemplate.java:145) [spring-batch-infrastructure-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.step.tasklet.TaskletStep.doExecute(TaskletStep.java:258) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.step.AbstractStep.execute(AbstractStep.java:208) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.job.SimpleStepHandler.handleStep(SimpleStepHandler.java:148) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.job.flow.JobFlowExecutor.executeStep(JobFlowExecutor.java:68) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.job.flow.support.state.StepState.handle(StepState.java:68) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.job.flow.support.SimpleFlow.resume(SimpleFlow.java:169) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.job.flow.support.SimpleFlow.start(SimpleFlow.java:144) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.job.flow.FlowJob.doExecute(FlowJob.java:137) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.job.AbstractJob.execute(AbstractJob.java:319) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.batch.core.launch.support.SimpleJobLauncher$1.run(SimpleJobLauncher.java:147) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50) [spring-core-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.batch.core.launch.support.SimpleJobLauncher.run(SimpleJobLauncher.java:140) [spring-batch-core-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
at com.navercorp.pinpoint.web.batch.JobLaunchSupport.run(JobLaunchSupport.java:51) [classes!/:2.2.1]
at com.navercorp.pinpoint.web.batch.BatchJobLauncher.flinkCheckJob(BatchJobLauncher.java:66) [classes!/:2.2.1]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_212]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_212]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_212]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_212]
at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) [spring-context-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) [spring-context-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:93) [spring-context-5.2.7.RELEASE.jar!/:5.2.7.RELEASE]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_212]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_212]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_212]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_212]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_212]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_212]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]

use default alarm feature

Default alarm feature has been added in Pinpoint v2.0.1.
For docker image it's planned to be added in v2.0.2.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.