Comments (17)
moomindani
commented on July 3, 2024
Thank you for reporting this.
Although I could not replicate the exact same issue, I was able to find related issues about jackson-core and AWS SDK for Java dependency.
Can you try to replace pom.xml with the file shown below, run docker build and docker run again to see if the issue still remains or not?
<project
xmlns="http://maven.apache.org/POM/4.0.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>com.amazonaws</groupId>
<artifactId>HadoopForGlueSparkHistoryServer</artifactId>
<packaging>jar</packaging>
<version>1.0-SNAPSHOT</version>
<name>HadoopForGlueSparkHistoryServer</name>
<url>http://maven.apache.org</url>
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<jdk.version>1.8</jdk.version>
<hadoop.version>2.8.5</hadoop.version>
<awssdk.version>1.11.696</awssdk.version>
<httpclient.version>4.5.9</httpclient.version>
<jackson-core.version>2.10.2</jackson-core.version>
</properties>
<dependencies>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
<version>${hadoop.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-client</artifactId>
<version>${hadoop.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-aws</artifactId>
<version>${hadoop.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>com.amazonaws</groupId>
<artifactId>aws-java-sdk-core</artifactId>
<version>${awssdk.version}</version>
<scope>provided</scope>
<exclusions>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>com.amazonaws</groupId>
<artifactId>aws-java-sdk-s3</artifactId>
<version>${awssdk.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpclient</artifactId>
<version>${httpclient.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
<version>${jackson-core.version}</version>
<scope>provided</scope>
</dependency>
</dependencies>
</project>
from aws-glue-samples.
woodchuck
commented on July 3, 2024
@moomindani Thanks so much for your reply! I rebuilt it with the new pom.xml and encountered the same error. Here are some relevant lines from the build output:
Downloading from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.5.3/jackson-core-2.5.3.pom
Downloaded from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.5.3/jackson-core-2.5.3.pom (4.8 kB at 65 kB/s)
...
Downloading from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.2.3/jackson-core-2.2.3.pom
Downloaded from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.2.3/jackson-core-2.2.3.pom (6.0 kB at 78 kB/s)
...
Downloading from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom
Downloaded from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom (4.9 kB at 62 kB/s)
...
Downloading from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.10.2/jackson-core-2.10.2.pom
Downloaded from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.10.2/jackson-core-2.10.2.pom (4.6 kB at 61 kB/s)
...
Downloading from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.10.2/jackson-core-2.10.2.jar
...
Downloaded from central: https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.10.2/jackson-core-2.10.2.jar (349 kB at 84 kB/s)
...
[INFO] Copying jackson-core-2.10.2.jar to /opt/spark/jars/jackson-core-2.10.2.jar
Let me know if there is any other information I can provide to help with troubleshooting or reproducing the problem.
from aws-glue-samples.
moomindani
commented on July 3, 2024
Sorry for late reply.
After replacing the pom.xml, are you seeing the exact same stack trace?
I would like you to copy and paste the stack trace again in the current status.
If possible, it would be great to run following command and share the output with us.
$ docker run -it -e SPARK_HISTORY_OPTS="$SPARK_HISTORY_OPTS -Dspark.history.fs.logDirectory=s3a://sekiyama-bucket/glue/sparkui/json2parquet/ -Dspark.hadoop.fs.s3a.access.key=AKIAXXXX -Dspark.hadoop.fs.s3a.secret.key=YYYY" -p 18080:18080 glue/sparkui:latest /bin/sh
sh-4.2# ls -la /opt/spark/jars/
from aws-glue-samples.
woodchuck
commented on July 3, 2024
The trace looks the same with the new pom.xml:
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
20/02/20 17:17:29 INFO HistoryServer: Started daemon with process name: 1@6d2132fa2c7a
20/02/20 17:17:29 INFO SignalUtils: Registered signal handler for TERM
20/02/20 17:17:29 INFO SignalUtils: Registered signal handler for HUP
20/02/20 17:17:29 INFO SignalUtils: Registered signal handler for INT
20/02/20 17:17:30 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
20/02/20 17:17:30 INFO SecurityManager: Changing view acls to: root
20/02/20 17:17:30 INFO SecurityManager: Changing modify acls to: root
20/02/20 17:17:30 INFO SecurityManager: Changing view acls groups to:
20/02/20 17:17:30 INFO SecurityManager: Changing modify acls groups to:
20/02/20 17:17:30 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set()
20/02/20 17:17:30 INFO FsHistoryProvider: History server ui acls disabled; users with admin permissions: ; groups with admin permissions
Exception in thread "main" java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.apache.spark.deploy.history.HistoryServer$.main(HistoryServer.scala:280)
at org.apache.spark.deploy.history.HistoryServer.main(HistoryServer.scala)
Caused by: java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.ObjectMapper.enable([Lcom/fasterxml/jackson/core/JsonParser$Feature;)Lcom/fasterxml/jackson/databind/ObjectMapper;
at com.amazonaws.partitions.PartitionsLoader.<clinit>(PartitionsLoader.java:54)
at com.amazonaws.regions.RegionMetadataFactory.create(RegionMetadataFactory.java:30)
at com.amazonaws.regions.RegionUtils.initialize(RegionUtils.java:65)
at com.amazonaws.regions.RegionUtils.getRegionMetadata(RegionUtils.java:53)
at com.amazonaws.regions.RegionUtils.getRegion(RegionUtils.java:107)
at com.amazonaws.services.s3.AmazonS3Client.createSigner(AmazonS3Client.java:4040)
at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:5039)
at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4998)
at com.amazonaws.services.s3.AmazonS3Client.headBucket(AmazonS3Client.java:1413)
at com.amazonaws.services.s3.AmazonS3Client.doesBucketExist(AmazonS3Client.java:1349)
at org.apache.hadoop.fs.s3a.S3AFileSystem.verifyBucketExists(S3AFileSystem.java:276)
at org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:236)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2812)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:100)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2849)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2831)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:389)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at org.apache.spark.deploy.history.FsHistoryProvider.<init>(FsHistoryProvider.scala:117)
at org.apache.spark.deploy.history.FsHistoryProvider.<init>(FsHistoryProvider.scala:86)
... 6 more
Here's the ls output:
sh-4.2# ls -la /opt/spark/jars/
total 219592
drwxr-xr-x 2 1000 1000 4096 Jan 28 14:10 .
drwxr-xr-x 15 1000 1000 4096 Jan 28 14:10 ..
-rw-r--r-- 1 1000 1000 325335 May 1 2019 RoaringBitmap-0.7.45.jar
-rw-r--r-- 1 root root 30035 Jan 28 14:10 accessors-smart-1.2.jar
-rw-r--r-- 1 root root 62983 Jan 28 14:10 activation-1.1.jar
-rw-r--r-- 1 1000 1000 134044 May 1 2019 aircompressor-0.10.jar
-rw-r--r-- 1 1000 1000 334662 May 1 2019 antlr4-runtime-4.7.jar
-rw-r--r-- 1 1000 1000 14766 May 1 2019 aopalliance-repackaged-2.4.0-b34.jar
-rw-r--r-- 1 root root 44925 Jan 28 14:10 apacheds-i18n-2.0.0-M15.jar
-rw-r--r-- 1 root root 691479 Jan 28 14:10 apacheds-kerberos-codec-2.0.0-M15.jar
-rw-r--r-- 1 root root 16560 Jan 28 14:10 api-asn1-api-1.0.0-M20.jar
-rw-r--r-- 1 root root 79912 Jan 28 14:10 api-util-1.0.0-M20.jar
-rw-r--r-- 1 1000 1000 1194003 May 1 2019 arpack_combined_all-0.1.jar
-rw-r--r-- 1 1000 1000 52037 May 1 2019 arrow-format-0.10.0.jar
-rw-r--r-- 1 1000 1000 79283 May 1 2019 arrow-memory-0.10.0.jar
-rw-r--r-- 1 1000 1000 1318940 May 1 2019 arrow-vector-0.10.0.jar
-rw-r--r-- 1 root root 43033 Jan 28 14:10 asm-3.1.jar
-rw-r--r-- 1 root root 53297 Jan 28 14:10 asm-5.0.4.jar
-rw-r--r-- 1 1000 1000 176285 May 1 2019 automaton-1.11-8.jar
-rw-r--r-- 1 root root 303139 Jan 28 14:10 avro-1.7.4.jar
-rw-r--r-- 1 1000 1000 187052 May 1 2019 avro-mapred-1.8.2-hadoop2.jar
-rw-r--r-- 1 root root 980670 Jan 28 14:10 aws-java-sdk-core-1.11.696.jar
-rw-r--r-- 1 root root 591413 Jan 28 14:10 aws-java-sdk-kms-1.11.696.jar
-rw-r--r-- 1 root root 1047485 Jan 28 14:10 aws-java-sdk-s3-1.11.696.jar
-rw-r--r-- 1 1000 1000 187882 May 1 2019 breeze-macros_2.11-0.13.2.jar
-rw-r--r-- 1 1000 1000 15113382 May 1 2019 breeze_2.11-0.13.2.jar
-rw-r--r-- 1 1000 1000 58633 May 1 2019 chill-java-0.9.3.jar
-rw-r--r-- 1 1000 1000 233536 May 1 2019 chill_2.11-0.9.3.jar
-rw-r--r-- 1 root root 188671 Jan 28 14:10 commons-beanutils-1.7.0.jar
-rw-r--r-- 1 root root 206035 Jan 28 14:10 commons-beanutils-core-1.8.0.jar
-rw-r--r-- 1 root root 41123 Jan 28 14:10 commons-cli-1.2.jar
-rw-r--r-- 1 1000 1000 284184 May 1 2019 commons-codec-1.10.jar
-rw-r--r-- 1 root root 58160 Jan 28 14:10 commons-codec-1.4.jar
-rw-r--r-- 1 root root 588337 Jan 28 14:10 commons-collections-3.2.2.jar
-rw-r--r-- 1 1000 1000 37871 May 1 2019 commons-compiler-3.0.9.jar
-rw-r--r-- 1 root root 241367 Jan 28 14:10 commons-compress-1.4.1.jar
-rw-r--r-- 1 root root 298829 Jan 28 14:10 commons-configuration-1.6.jar
-rw-r--r-- 1 1000 1000 134595 May 1 2019 commons-crypto-1.0.0.jar
-rw-r--r-- 1 root root 143602 Jan 28 14:10 commons-digester-1.8.jar
-rw-r--r-- 1 root root 185140 Jan 28 14:10 commons-io-2.4.jar
-rw-r--r-- 1 1000 1000 284220 Jan 28 14:10 commons-lang-2.6.jar
-rw-r--r-- 1 1000 1000 479881 May 1 2019 commons-lang3-3.5.jar
-rw-r--r-- 1 root root 62050 Jan 28 14:10 commons-logging-1.1.3.jar
-rw-r--r-- 1 root root 1599627 Jan 28 14:10 commons-math3-3.1.1.jar
-rw-r--r-- 1 1000 1000 2035066 May 1 2019 commons-math3-3.4.1.jar
-rw-r--r-- 1 1000 1000 273370 Jan 28 14:10 commons-net-3.1.jar
-rw-r--r-- 1 1000 1000 79845 May 1 2019 compress-lzf-1.0.3.jar
-rw-r--r-- 1 1000 1000 164422 May 1 2019 core-1.1.2.jar
-rw-r--r-- 1 root root 69500 Jan 28 14:10 curator-client-2.7.1.jar
-rw-r--r-- 1 root root 186273 Jan 28 14:10 curator-framework-2.7.1.jar
-rw-r--r-- 1 root root 270342 Jan 28 14:10 curator-recipes-2.7.1.jar
-rw-r--r-- 1 1000 1000 10166 May 1 2019 flatbuffers-1.2.0-3f79e055.jar
-rw-r--r-- 1 1000 1000 13911 May 1 2019 generex-1.0.1.jar
-rw-r--r-- 1 root root 190432 Jan 28 14:10 gson-2.2.4.jar
-rw-r--r-- 1 root root 1648200 Jan 28 14:10 guava-11.0.2.jar
-rw-r--r-- 1 root root 45930 Jan 28 14:10 hadoop-annotations-2.8.5.jar
-rw-r--r-- 1 root root 123295 Jan 28 14:10 hadoop-auth-2.8.5.jar
-rw-r--r-- 1 root root 243779 Jan 28 14:10 hadoop-aws-2.8.5.jar
-rw-r--r-- 1 root root 29917 Jan 28 14:10 hadoop-client-2.8.5.jar
-rw-r--r-- 1 root root 3990042 Jan 28 14:10 hadoop-common-2.8.5.jar
-rw-r--r-- 1 root root 4093994 Jan 28 14:10 hadoop-hdfs-client-2.8.5.jar
-rw-r--r-- 1 root root 565322 Jan 28 14:10 hadoop-mapreduce-client-app-2.8.5.jar
-rw-r--r-- 1 root root 785846 Jan 28 14:10 hadoop-mapreduce-client-common-2.8.5.jar
-rw-r--r-- 1 root root 1572117 Jan 28 14:10 hadoop-mapreduce-client-core-2.8.5.jar
-rw-r--r-- 1 root root 67002 Jan 28 14:10 hadoop-mapreduce-client-jobclient-2.8.5.jar
-rw-r--r-- 1 root root 76092 Jan 28 14:10 hadoop-mapreduce-client-shuffle-2.8.5.jar
-rw-r--r-- 1 root root 2454120 Jan 28 14:10 hadoop-yarn-api-2.8.5.jar
-rw-r--r-- 1 root root 230260 Jan 28 14:10 hadoop-yarn-client-2.8.5.jar
-rw-r--r-- 1 root root 1806509 Jan 28 14:10 hadoop-yarn-common-2.8.5.jar
-rw-r--r-- 1 root root 491884 Jan 28 14:10 hadoop-yarn-server-common-2.8.5.jar
-rw-r--r-- 1 1000 1000 178947 May 1 2019 hk2-api-2.4.0-b34.jar
-rw-r--r-- 1 1000 1000 181271 May 1 2019 hk2-locator-2.4.0-b34.jar
-rw-r--r-- 1 1000 1000 118973 May 1 2019 hk2-utils-2.4.0-b34.jar
-rw-r--r-- 1 1000 1000 1671083 May 1 2019 hppc-0.7.2.jar
-rw-r--r-- 1 root root 1485102 Jan 28 14:10 htrace-core4-4.0.1-incubating.jar
-rw-r--r-- 1 root root 774384 Jan 28 14:10 httpclient-4.5.9.jar
-rw-r--r-- 1 root root 326874 Jan 28 14:10 httpcore-4.4.11.jar
-rw-r--r-- 1 root root 565410 Jan 28 14:10 ion-java-1.0.2.jar
-rw-r--r-- 1 1000 1000 1282424 May 1 2019 ivy-2.4.0.jar
-rw-r--r-- 1 root root 33483 Jan 28 14:10 jackson-annotations-2.2.3.jar
-rw-r--r-- 1 1000 1000 46986 May 1 2019 jackson-annotations-2.6.7.jar
-rw-r--r-- 1 1000 1000 258919 Jan 28 14:10 jackson-core-2.6.7.jar
-rw-r--r-- 1 root root 232248 Jan 28 14:10 jackson-core-asl-1.9.13.jar
-rw-r--r-- 1 root root 865838 Jan 28 14:10 jackson-databind-2.2.3.jar
-rw-r--r-- 1 1000 1000 1165323 May 1 2019 jackson-databind-2.6.7.1.jar
-rw-r--r-- 1 root root 48468 Jan 28 14:10 jackson-dataformat-cbor-2.6.7.jar
-rw-r--r-- 1 1000 1000 320444 May 1 2019 jackson-dataformat-yaml-2.6.7.jar
-rw-r--r-- 1 root root 17883 Jan 28 14:10 jackson-jaxrs-1.8.3.jar
-rw-r--r-- 1 root root 780664 Jan 28 14:10 jackson-mapper-asl-1.9.13.jar
-rw-r--r-- 1 1000 1000 32612 May 1 2019 jackson-module-jaxb-annotations-2.6.7.jar
-rw-r--r-- 1 1000 1000 42858 May 1 2019 jackson-module-paranamer-2.7.9.jar
-rw-r--r-- 1 1000 1000 515645 May 1 2019 jackson-module-scala_2.11-2.6.7.1.jar
-rw-r--r-- 1 root root 32319 Jan 28 14:10 jackson-xc-1.8.3.jar
-rw-r--r-- 1 1000 1000 801369 May 1 2019 janino-3.0.9.jar
-rw-r--r-- 1 root root 18490 Jan 28 14:10 java-xmlbuilder-0.4.jar
-rw-r--r-- 1 1000 1000 714194 May 1 2019 javassist-3.18.1-GA.jar
-rw-r--r-- 1 1000 1000 26366 May 1 2019 javax.annotation-api-1.2.jar
-rw-r--r-- 1 1000 1000 5950 May 1 2019 javax.inject-2.4.0-b34.jar
-rw-r--r-- 1 1000 1000 95806 May 1 2019 javax.servlet-api-3.1.0.jar
-rw-r--r-- 1 1000 1000 115534 May 1 2019 javax.ws.rs-api-2.0.1.jar
-rw-r--r-- 1 root root 105134 Jan 28 14:10 jaxb-api-2.2.2.jar
-rw-r--r-- 1 root root 890168 Jan 28 14:10 jaxb-impl-2.2.3-1.jar
-rw-r--r-- 1 root root 4722 Jan 28 14:10 jcip-annotations-1.0-1.jar
-rw-r--r-- 1 1000 1000 16430 May 1 2019 jcl-over-slf4j-1.7.16.jar
-rw-r--r-- 1 root root 18335950 Jan 28 14:10 jdk.tools-1.8.jar
-rw-r--r-- 1 root root 130458 Jan 28 14:10 jersey-client-1.9.jar
-rw-r--r-- 1 1000 1000 167421 May 1 2019 jersey-client-2.22.2.jar
-rw-r--r-- 1 1000 1000 698375 May 1 2019 jersey-common-2.22.2.jar
-rw-r--r-- 1 1000 1000 18098 May 1 2019 jersey-container-servlet-2.22.2.jar
-rw-r--r-- 1 1000 1000 66270 May 1 2019 jersey-container-servlet-core-2.22.2.jar
-rw-r--r-- 1 root root 458739 Jan 28 14:10 jersey-core-1.9.jar
-rw-r--r-- 1 1000 1000 971310 May 1 2019 jersey-guava-2.22.2.jar
-rw-r--r-- 1 root root 147952 Jan 28 14:10 jersey-json-1.9.jar
-rw-r--r-- 1 1000 1000 72733 May 1 2019 jersey-media-jaxb-2.22.2.jar
-rw-r--r-- 1 root root 713089 Jan 28 14:10 jersey-server-1.9.jar
-rw-r--r-- 1 1000 1000 951701 May 1 2019 jersey-server-2.22.2.jar
-rw-r--r-- 1 root root 539735 Jan 28 14:10 jets3t-0.9.0.jar
-rw-r--r-- 1 root root 67758 Jan 28 14:10 jettison-1.1.jar
-rw-r--r-- 1 root root 539912 Jan 28 14:10 jetty-6.1.26.jar
-rw-r--r-- 1 root root 18891 Jan 28 14:10 jetty-sslengine-6.1.26.jar
-rw-r--r-- 1 root root 177131 Jan 28 14:10 jetty-util-6.1.26.jar
-rw-r--r-- 1 root root 27584 Jan 28 14:10 jmespath-java-1.11.696.jar
-rw-r--r-- 1 1000 1000 627814 May 1 2019 joda-time-2.9.3.jar
-rw-r--r-- 1 root root 629506 Jan 28 14:10 joda-time-2.9.4.jar
-rw-r--r-- 1 root root 280515 Jan 28 14:10 jsch-0.1.54.jar
-rw-r--r-- 1 root root 120316 Jan 28 14:10 json-smart-2.3.jar
-rw-r--r-- 1 1000 1000 90660 May 1 2019 json4s-ast_2.11-3.5.3.jar
-rw-r--r-- 1 1000 1000 689977 May 1 2019 json4s-core_2.11-3.5.3.jar
-rw-r--r-- 1 1000 1000 48193 May 1 2019 json4s-jackson_2.11-3.5.3.jar
-rw-r--r-- 1 1000 1000 614765 May 1 2019 json4s-scalap_2.11-3.5.3.jar
-rw-r--r-- 1 root root 100636 Jan 28 14:10 jsp-api-2.1.jar
-rw-r--r-- 1 1000 1000 33015 May 1 2019 jsr305-1.3.9.jar
-rw-r--r-- 1 root root 33031 Jan 28 14:10 jsr305-3.0.0.jar
-rw-r--r-- 1 1000 1000 764569 May 1 2019 jtransforms-2.4.0.jar
-rw-r--r-- 1 1000 1000 4596 May 1 2019 jul-to-slf4j-1.7.16.jar
-rw-r--r-- 1 1000 1000 410874 May 1 2019 kryo-shaded-4.0.2.jar
-rw-r--r-- 1 1000 1000 543699 May 1 2019 kubernetes-client-4.1.2.jar
-rw-r--r-- 1 1000 1000 9386214 May 1 2019 kubernetes-model-4.1.2.jar
-rw-r--r-- 1 1000 1000 3817 May 1 2019 kubernetes-model-common-4.1.2.jar
-rw-r--r-- 1 1000 1000 1045744 Jan 28 14:10 leveldbjni-all-1.8.jar
-rw-r--r-- 1 root root 489884 Jan 28 14:10 log4j-1.2.17.jar
-rw-r--r-- 1 1000 1000 12486 May 1 2019 logging-interceptor-3.12.0.jar
-rw-r--r-- 1 1000 1000 370119 May 1 2019 lz4-java-1.4.0.jar
-rw-r--r-- 1 1000 1000 34603 May 1 2019 machinist_2.11-0.6.1.jar
-rw-r--r-- 1 1000 1000 3142 May 1 2019 macro-compat_2.11-1.1.1.jar
-rw-r--r-- 1 1000 1000 7343426 May 1 2019 mesos-1.4.0-shaded-protobuf.jar
-rw-r--r-- 1 1000 1000 120465 May 1 2019 metrics-core-3.1.5.jar
-rw-r--r-- 1 1000 1000 21247 May 1 2019 metrics-graphite-3.1.5.jar
-rw-r--r-- 1 1000 1000 15824 May 1 2019 metrics-json-3.1.5.jar
-rw-r--r-- 1 1000 1000 39283 May 1 2019 metrics-jvm-3.1.5.jar
-rw-r--r-- 1 1000 1000 5711 May 1 2019 minlog-1.3.0.jar
-rw-r--r-- 1 root root 1208356 Jan 28 14:10 netty-3.7.0.Final.jar
-rw-r--r-- 1 1000 1000 1330219 May 1 2019 netty-3.9.9.Final.jar
-rw-r--r-- 1 1000 1000 3780056 May 1 2019 netty-all-4.1.17.Final.jar
-rw-r--r-- 1 root root 299508 Jan 28 14:10 nimbus-jose-jwt-4.41.1.jar
-rw-r--r-- 1 1000 1000 54391 May 1 2019 objenesis-2.5.1.jar
-rw-r--r-- 1 root root 319099 Jan 28 14:10 okhttp-2.4.0.jar
-rw-r--r-- 1 1000 1000 398122 May 1 2019 okhttp-3.8.1.jar
-rw-r--r-- 1 1000 1000 81811 May 1 2019 okio-1.13.0.jar
-rw-r--r-- 1 root root 64661 Jan 28 14:10 okio-1.4.0.jar
-rw-r--r-- 1 1000 1000 19827 May 1 2019 opencsv-2.3.jar
-rw-r--r-- 1 1000 1000 1565700 May 1 2019 orc-core-1.5.5-nohive.jar
-rw-r--r-- 1 1000 1000 812313 May 1 2019 orc-mapreduce-1.5.5-nohive.jar
-rw-r--r-- 1 1000 1000 27745 May 1 2019 orc-shims-1.5.5.jar
-rw-r--r-- 1 1000 1000 65261 May 1 2019 oro-2.0.8.jar
-rw-r--r-- 1 1000 1000 20235 May 1 2019 osgi-resource-locator-1.0.1.jar
-rw-r--r-- 1 root root 29555 Jan 28 14:10 paranamer-2.3.jar
-rw-r--r-- 1 1000 1000 34654 May 1 2019 paranamer-2.8.jar
-rw-r--r-- 1 1000 1000 1097799 May 1 2019 parquet-column-1.10.1.jar
-rw-r--r-- 1 1000 1000 94995 May 1 2019 parquet-common-1.10.1.jar
-rw-r--r-- 1 1000 1000 848750 May 1 2019 parquet-encoding-1.10.1.jar
-rw-r--r-- 1 1000 1000 723203 May 1 2019 parquet-format-2.4.0.jar
-rw-r--r-- 1 1000 1000 285732 May 1 2019 parquet-hadoop-1.10.1.jar
-rw-r--r-- 1 1000 1000 1048171 May 1 2019 parquet-jackson-1.10.1.jar
-rw-r--r-- 1 root root 533455 Jan 28 14:10 protobuf-java-2.5.0.jar
-rw-r--r-- 1 1000 1000 122774 May 1 2019 py4j-0.10.7.jar
-rw-r--r-- 1 1000 1000 94796 May 1 2019 pyrolite-4.13.jar
-rw-r--r-- 1 1000 1000 15612191 May 1 2019 scala-compiler-2.11.12.jar
-rw-r--r-- 1 1000 1000 5749423 May 1 2019 scala-library-2.11.12.jar
-rw-r--r-- 1 1000 1000 471925 May 1 2019 scala-parser-combinators_2.11-1.1.0.jar
-rw-r--r-- 1 1000 1000 4623075 May 1 2019 scala-reflect-2.11.12.jar
-rw-r--r-- 1 1000 1000 671138 May 1 2019 scala-xml_2.11-1.0.5.jar
-rw-r--r-- 1 root root 105112 Jan 28 14:10 servlet-api-2.5.jar
-rw-r--r-- 1 1000 1000 3522616 May 1 2019 shapeless_2.11-2.3.2.jar
-rw-r--r-- 1 1000 1000 4028 May 1 2019 shims-0.7.45.jar
-rw-r--r-- 1 root root 32119 Jan 28 14:10 slf4j-api-1.7.10.jar
-rw-r--r-- 1 root root 8866 Jan 28 14:10 slf4j-log4j12-1.7.10.jar
-rw-r--r-- 1 1000 1000 269295 May 1 2019 snakeyaml-1.15.jar
-rw-r--r-- 1 root root 995968 Jan 28 14:10 snappy-java-1.0.4.1.jar
-rw-r--r-- 1 1000 1000 2021167 May 1 2019 snappy-java-1.1.7.3.jar
-rw-r--r-- 1 1000 1000 10215969 May 1 2019 spark-catalyst_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 13513957 May 1 2019 spark-core_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 708181 May 1 2019 spark-graphx_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 537610 May 1 2019 spark-kubernetes_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 53049 May 1 2019 spark-kvstore_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 75939 May 1 2019 spark-launcher_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 683952 May 1 2019 spark-mesos_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 183838 May 1 2019 spark-mllib-local_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 8025397 May 1 2019 spark-mllib_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 2392842 May 1 2019 spark-network-common_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 70899 May 1 2019 spark-network-shuffle_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 137626 May 1 2019 spark-repl_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 30063 May 1 2019 spark-sketch_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 9882940 May 1 2019 spark-sql_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 2171609 May 1 2019 spark-streaming_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 8843 May 1 2019 spark-tags_2.11-2.4.3-tests.jar
-rw-r--r-- 1 1000 1000 15461 May 1 2019 spark-tags_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 49195 May 1 2019 spark-unsafe_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 672974 May 1 2019 spark-yarn_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 87192 May 1 2019 spire-macros_2.11-0.13.0.jar
-rw-r--r-- 1 1000 1000 10121868 May 1 2019 spire_2.11-0.13.0.jar
-rw-r--r-- 1 root root 23346 Jan 28 14:10 stax-api-1.0-2.jar
-rw-r--r-- 1 1000 1000 174351 May 1 2019 stream-2.7.0.jar
-rw-r--r-- 1 1000 1000 404970 May 1 2019 univocity-parsers-2.7.3.jar
-rw-r--r-- 1 1000 1000 63777 May 1 2019 validation-api-1.1.0.Final.jar
-rw-r--r-- 1 1000 1000 282930 May 1 2019 xbean-asm6-shaded-4.8.jar
-rw-r--r-- 1 root root 15010 Jan 28 14:10 xmlenc-0.52.jar
-rw-r--r-- 1 root root 94672 Jan 28 14:10 xz-1.0.jar
-rw-r--r-- 1 1000 1000 35518 May 1 2019 zjsonpatch-0.3.0.jar
-rw-r--r-- 1 root root 792964 Jan 28 14:10 zookeeper-3.4.6.jar
-rw-r--r-- 1 1000 1000 2333186 May 1 2019 zstd-jni-1.3.2-2.jar
from aws-glue-samples.
woodchuck
commented on July 3, 2024
I deleted all my images, made sure the pom.xml was the new one, and rebuilt the image. I still get the same error, but now jackson-core-2.10.2.jar is in my jars list at least.
sh-4.2# ls -la /opt/spark/jars/
total 219936
drwxr-xr-x 2 1000 1000 4096 Feb 20 17:39 .
drwxr-xr-x 15 1000 1000 4096 Feb 20 17:39 ..
-rw-r--r-- 1 1000 1000 325335 May 1 2019 RoaringBitmap-0.7.45.jar
-rw-r--r-- 1 root root 30035 Feb 20 17:39 accessors-smart-1.2.jar
-rw-r--r-- 1 root root 62983 Feb 20 17:39 activation-1.1.jar
-rw-r--r-- 1 1000 1000 134044 May 1 2019 aircompressor-0.10.jar
-rw-r--r-- 1 1000 1000 334662 May 1 2019 antlr4-runtime-4.7.jar
-rw-r--r-- 1 1000 1000 14766 May 1 2019 aopalliance-repackaged-2.4.0-b34.jar
-rw-r--r-- 1 root root 44925 Feb 20 17:39 apacheds-i18n-2.0.0-M15.jar
-rw-r--r-- 1 root root 691479 Feb 20 17:39 apacheds-kerberos-codec-2.0.0-M15.jar
-rw-r--r-- 1 root root 16560 Feb 20 17:39 api-asn1-api-1.0.0-M20.jar
-rw-r--r-- 1 root root 79912 Feb 20 17:39 api-util-1.0.0-M20.jar
-rw-r--r-- 1 1000 1000 1194003 May 1 2019 arpack_combined_all-0.1.jar
-rw-r--r-- 1 1000 1000 52037 May 1 2019 arrow-format-0.10.0.jar
-rw-r--r-- 1 1000 1000 79283 May 1 2019 arrow-memory-0.10.0.jar
-rw-r--r-- 1 1000 1000 1318940 May 1 2019 arrow-vector-0.10.0.jar
-rw-r--r-- 1 root root 43033 Feb 20 17:39 asm-3.1.jar
-rw-r--r-- 1 root root 53297 Feb 20 17:39 asm-5.0.4.jar
-rw-r--r-- 1 1000 1000 176285 May 1 2019 automaton-1.11-8.jar
-rw-r--r-- 1 root root 303139 Feb 20 17:39 avro-1.7.4.jar
-rw-r--r-- 1 1000 1000 187052 May 1 2019 avro-mapred-1.8.2-hadoop2.jar
-rw-r--r-- 1 root root 980670 Feb 20 17:39 aws-java-sdk-core-1.11.696.jar
-rw-r--r-- 1 root root 591413 Feb 20 17:39 aws-java-sdk-kms-1.11.696.jar
-rw-r--r-- 1 root root 1047485 Feb 20 17:39 aws-java-sdk-s3-1.11.696.jar
-rw-r--r-- 1 1000 1000 187882 May 1 2019 breeze-macros_2.11-0.13.2.jar
-rw-r--r-- 1 1000 1000 15113382 May 1 2019 breeze_2.11-0.13.2.jar
-rw-r--r-- 1 1000 1000 58633 May 1 2019 chill-java-0.9.3.jar
-rw-r--r-- 1 1000 1000 233536 May 1 2019 chill_2.11-0.9.3.jar
-rw-r--r-- 1 root root 188671 Feb 20 17:39 commons-beanutils-1.7.0.jar
-rw-r--r-- 1 root root 206035 Feb 20 17:39 commons-beanutils-core-1.8.0.jar
-rw-r--r-- 1 root root 41123 Feb 20 17:39 commons-cli-1.2.jar
-rw-r--r-- 1 1000 1000 284184 May 1 2019 commons-codec-1.10.jar
-rw-r--r-- 1 root root 58160 Feb 20 17:39 commons-codec-1.4.jar
-rw-r--r-- 1 root root 588337 Feb 20 17:39 commons-collections-3.2.2.jar
-rw-r--r-- 1 1000 1000 37871 May 1 2019 commons-compiler-3.0.9.jar
-rw-r--r-- 1 root root 241367 Feb 20 17:39 commons-compress-1.4.1.jar
-rw-r--r-- 1 root root 298829 Feb 20 17:39 commons-configuration-1.6.jar
-rw-r--r-- 1 1000 1000 134595 May 1 2019 commons-crypto-1.0.0.jar
-rw-r--r-- 1 root root 143602 Feb 20 17:39 commons-digester-1.8.jar
-rw-r--r-- 1 root root 185140 Feb 20 17:39 commons-io-2.4.jar
-rw-r--r-- 1 1000 1000 284220 Feb 20 17:39 commons-lang-2.6.jar
-rw-r--r-- 1 1000 1000 479881 May 1 2019 commons-lang3-3.5.jar
-rw-r--r-- 1 root root 62050 Feb 20 17:39 commons-logging-1.1.3.jar
-rw-r--r-- 1 root root 1599627 Feb 20 17:39 commons-math3-3.1.1.jar
-rw-r--r-- 1 1000 1000 2035066 May 1 2019 commons-math3-3.4.1.jar
-rw-r--r-- 1 1000 1000 273370 Feb 20 17:39 commons-net-3.1.jar
-rw-r--r-- 1 1000 1000 79845 May 1 2019 compress-lzf-1.0.3.jar
-rw-r--r-- 1 1000 1000 164422 May 1 2019 core-1.1.2.jar
-rw-r--r-- 1 root root 69500 Feb 20 17:39 curator-client-2.7.1.jar
-rw-r--r-- 1 root root 186273 Feb 20 17:39 curator-framework-2.7.1.jar
-rw-r--r-- 1 root root 270342 Feb 20 17:39 curator-recipes-2.7.1.jar
-rw-r--r-- 1 1000 1000 10166 May 1 2019 flatbuffers-1.2.0-3f79e055.jar
-rw-r--r-- 1 1000 1000 13911 May 1 2019 generex-1.0.1.jar
-rw-r--r-- 1 root root 190432 Feb 20 17:39 gson-2.2.4.jar
-rw-r--r-- 1 root root 1648200 Feb 20 17:39 guava-11.0.2.jar
-rw-r--r-- 1 root root 45930 Feb 20 17:39 hadoop-annotations-2.8.5.jar
-rw-r--r-- 1 root root 123295 Feb 20 17:39 hadoop-auth-2.8.5.jar
-rw-r--r-- 1 root root 243779 Feb 20 17:39 hadoop-aws-2.8.5.jar
-rw-r--r-- 1 root root 29917 Feb 20 17:39 hadoop-client-2.8.5.jar
-rw-r--r-- 1 root root 3990042 Feb 20 17:39 hadoop-common-2.8.5.jar
-rw-r--r-- 1 root root 4093994 Feb 20 17:39 hadoop-hdfs-client-2.8.5.jar
-rw-r--r-- 1 root root 565322 Feb 20 17:39 hadoop-mapreduce-client-app-2.8.5.jar
-rw-r--r-- 1 root root 785846 Feb 20 17:39 hadoop-mapreduce-client-common-2.8.5.jar
-rw-r--r-- 1 root root 1572117 Feb 20 17:39 hadoop-mapreduce-client-core-2.8.5.jar
-rw-r--r-- 1 root root 67002 Feb 20 17:39 hadoop-mapreduce-client-jobclient-2.8.5.jar
-rw-r--r-- 1 root root 76092 Feb 20 17:39 hadoop-mapreduce-client-shuffle-2.8.5.jar
-rw-r--r-- 1 root root 2454120 Feb 20 17:39 hadoop-yarn-api-2.8.5.jar
-rw-r--r-- 1 root root 230260 Feb 20 17:39 hadoop-yarn-client-2.8.5.jar
-rw-r--r-- 1 root root 1806509 Feb 20 17:39 hadoop-yarn-common-2.8.5.jar
-rw-r--r-- 1 root root 491884 Feb 20 17:39 hadoop-yarn-server-common-2.8.5.jar
-rw-r--r-- 1 1000 1000 178947 May 1 2019 hk2-api-2.4.0-b34.jar
-rw-r--r-- 1 1000 1000 181271 May 1 2019 hk2-locator-2.4.0-b34.jar
-rw-r--r-- 1 1000 1000 118973 May 1 2019 hk2-utils-2.4.0-b34.jar
-rw-r--r-- 1 1000 1000 1671083 May 1 2019 hppc-0.7.2.jar
-rw-r--r-- 1 root root 1485102 Feb 20 17:39 htrace-core4-4.0.1-incubating.jar
-rw-r--r-- 1 root root 774384 Feb 20 17:39 httpclient-4.5.9.jar
-rw-r--r-- 1 root root 326874 Feb 20 17:39 httpcore-4.4.11.jar
-rw-r--r-- 1 root root 565410 Feb 20 17:39 ion-java-1.0.2.jar
-rw-r--r-- 1 1000 1000 1282424 May 1 2019 ivy-2.4.0.jar
-rw-r--r-- 1 root root 33483 Feb 20 17:39 jackson-annotations-2.2.3.jar
-rw-r--r-- 1 1000 1000 46986 May 1 2019 jackson-annotations-2.6.7.jar
-rw-r--r-- 1 root root 349074 Feb 20 17:39 jackson-core-2.10.2.jar
-rw-r--r-- 1 1000 1000 258919 May 1 2019 jackson-core-2.6.7.jar
-rw-r--r-- 1 root root 232248 Feb 20 17:39 jackson-core-asl-1.9.13.jar
-rw-r--r-- 1 root root 865838 Feb 20 17:39 jackson-databind-2.2.3.jar
-rw-r--r-- 1 1000 1000 1165323 May 1 2019 jackson-databind-2.6.7.1.jar
-rw-r--r-- 1 root root 48468 Feb 20 17:39 jackson-dataformat-cbor-2.6.7.jar
-rw-r--r-- 1 1000 1000 320444 May 1 2019 jackson-dataformat-yaml-2.6.7.jar
-rw-r--r-- 1 root root 17883 Feb 20 17:39 jackson-jaxrs-1.8.3.jar
-rw-r--r-- 1 root root 780664 Feb 20 17:39 jackson-mapper-asl-1.9.13.jar
-rw-r--r-- 1 1000 1000 32612 May 1 2019 jackson-module-jaxb-annotations-2.6.7.jar
-rw-r--r-- 1 1000 1000 42858 May 1 2019 jackson-module-paranamer-2.7.9.jar
-rw-r--r-- 1 1000 1000 515645 May 1 2019 jackson-module-scala_2.11-2.6.7.1.jar
-rw-r--r-- 1 root root 32319 Feb 20 17:39 jackson-xc-1.8.3.jar
-rw-r--r-- 1 1000 1000 801369 May 1 2019 janino-3.0.9.jar
-rw-r--r-- 1 root root 18490 Feb 20 17:39 java-xmlbuilder-0.4.jar
-rw-r--r-- 1 1000 1000 714194 May 1 2019 javassist-3.18.1-GA.jar
-rw-r--r-- 1 1000 1000 26366 May 1 2019 javax.annotation-api-1.2.jar
-rw-r--r-- 1 1000 1000 5950 May 1 2019 javax.inject-2.4.0-b34.jar
-rw-r--r-- 1 1000 1000 95806 May 1 2019 javax.servlet-api-3.1.0.jar
-rw-r--r-- 1 1000 1000 115534 May 1 2019 javax.ws.rs-api-2.0.1.jar
-rw-r--r-- 1 root root 105134 Feb 20 17:39 jaxb-api-2.2.2.jar
-rw-r--r-- 1 root root 890168 Feb 20 17:39 jaxb-impl-2.2.3-1.jar
-rw-r--r-- 1 root root 4722 Feb 20 17:39 jcip-annotations-1.0-1.jar
-rw-r--r-- 1 1000 1000 16430 May 1 2019 jcl-over-slf4j-1.7.16.jar
-rw-r--r-- 1 root root 18335950 Feb 20 17:39 jdk.tools-1.8.jar
-rw-r--r-- 1 root root 130458 Feb 20 17:39 jersey-client-1.9.jar
-rw-r--r-- 1 1000 1000 167421 May 1 2019 jersey-client-2.22.2.jar
-rw-r--r-- 1 1000 1000 698375 May 1 2019 jersey-common-2.22.2.jar
-rw-r--r-- 1 1000 1000 18098 May 1 2019 jersey-container-servlet-2.22.2.jar
-rw-r--r-- 1 1000 1000 66270 May 1 2019 jersey-container-servlet-core-2.22.2.jar
-rw-r--r-- 1 root root 458739 Feb 20 17:39 jersey-core-1.9.jar
-rw-r--r-- 1 1000 1000 971310 May 1 2019 jersey-guava-2.22.2.jar
-rw-r--r-- 1 root root 147952 Feb 20 17:39 jersey-json-1.9.jar
-rw-r--r-- 1 1000 1000 72733 May 1 2019 jersey-media-jaxb-2.22.2.jar
-rw-r--r-- 1 root root 713089 Feb 20 17:39 jersey-server-1.9.jar
-rw-r--r-- 1 1000 1000 951701 May 1 2019 jersey-server-2.22.2.jar
-rw-r--r-- 1 root root 539735 Feb 20 17:39 jets3t-0.9.0.jar
-rw-r--r-- 1 root root 67758 Feb 20 17:39 jettison-1.1.jar
-rw-r--r-- 1 root root 539912 Feb 20 17:39 jetty-6.1.26.jar
-rw-r--r-- 1 root root 18891 Feb 20 17:39 jetty-sslengine-6.1.26.jar
-rw-r--r-- 1 root root 177131 Feb 20 17:39 jetty-util-6.1.26.jar
-rw-r--r-- 1 root root 27584 Feb 20 17:39 jmespath-java-1.11.696.jar
-rw-r--r-- 1 1000 1000 627814 May 1 2019 joda-time-2.9.3.jar
-rw-r--r-- 1 root root 629506 Feb 20 17:39 joda-time-2.9.4.jar
-rw-r--r-- 1 root root 280515 Feb 20 17:39 jsch-0.1.54.jar
-rw-r--r-- 1 root root 120316 Feb 20 17:39 json-smart-2.3.jar
-rw-r--r-- 1 1000 1000 90660 May 1 2019 json4s-ast_2.11-3.5.3.jar
-rw-r--r-- 1 1000 1000 689977 May 1 2019 json4s-core_2.11-3.5.3.jar
-rw-r--r-- 1 1000 1000 48193 May 1 2019 json4s-jackson_2.11-3.5.3.jar
-rw-r--r-- 1 1000 1000 614765 May 1 2019 json4s-scalap_2.11-3.5.3.jar
-rw-r--r-- 1 root root 100636 Feb 20 17:39 jsp-api-2.1.jar
-rw-r--r-- 1 1000 1000 33015 May 1 2019 jsr305-1.3.9.jar
-rw-r--r-- 1 root root 33031 Feb 20 17:39 jsr305-3.0.0.jar
-rw-r--r-- 1 1000 1000 764569 May 1 2019 jtransforms-2.4.0.jar
-rw-r--r-- 1 1000 1000 4596 May 1 2019 jul-to-slf4j-1.7.16.jar
-rw-r--r-- 1 1000 1000 410874 May 1 2019 kryo-shaded-4.0.2.jar
-rw-r--r-- 1 1000 1000 543699 May 1 2019 kubernetes-client-4.1.2.jar
-rw-r--r-- 1 1000 1000 9386214 May 1 2019 kubernetes-model-4.1.2.jar
-rw-r--r-- 1 1000 1000 3817 May 1 2019 kubernetes-model-common-4.1.2.jar
-rw-r--r-- 1 1000 1000 1045744 Feb 20 17:39 leveldbjni-all-1.8.jar
-rw-r--r-- 1 root root 489884 Feb 20 17:39 log4j-1.2.17.jar
-rw-r--r-- 1 1000 1000 12486 May 1 2019 logging-interceptor-3.12.0.jar
-rw-r--r-- 1 1000 1000 370119 May 1 2019 lz4-java-1.4.0.jar
-rw-r--r-- 1 1000 1000 34603 May 1 2019 machinist_2.11-0.6.1.jar
-rw-r--r-- 1 1000 1000 3142 May 1 2019 macro-compat_2.11-1.1.1.jar
-rw-r--r-- 1 1000 1000 7343426 May 1 2019 mesos-1.4.0-shaded-protobuf.jar
-rw-r--r-- 1 1000 1000 120465 May 1 2019 metrics-core-3.1.5.jar
-rw-r--r-- 1 1000 1000 21247 May 1 2019 metrics-graphite-3.1.5.jar
-rw-r--r-- 1 1000 1000 15824 May 1 2019 metrics-json-3.1.5.jar
-rw-r--r-- 1 1000 1000 39283 May 1 2019 metrics-jvm-3.1.5.jar
-rw-r--r-- 1 1000 1000 5711 May 1 2019 minlog-1.3.0.jar
-rw-r--r-- 1 root root 1208356 Feb 20 17:39 netty-3.7.0.Final.jar
-rw-r--r-- 1 1000 1000 1330219 May 1 2019 netty-3.9.9.Final.jar
-rw-r--r-- 1 1000 1000 3780056 May 1 2019 netty-all-4.1.17.Final.jar
-rw-r--r-- 1 root root 299508 Feb 20 17:39 nimbus-jose-jwt-4.41.1.jar
-rw-r--r-- 1 1000 1000 54391 May 1 2019 objenesis-2.5.1.jar
-rw-r--r-- 1 root root 319099 Feb 20 17:39 okhttp-2.4.0.jar
-rw-r--r-- 1 1000 1000 398122 May 1 2019 okhttp-3.8.1.jar
-rw-r--r-- 1 1000 1000 81811 May 1 2019 okio-1.13.0.jar
-rw-r--r-- 1 root root 64661 Feb 20 17:39 okio-1.4.0.jar
-rw-r--r-- 1 1000 1000 19827 May 1 2019 opencsv-2.3.jar
-rw-r--r-- 1 1000 1000 1565700 May 1 2019 orc-core-1.5.5-nohive.jar
-rw-r--r-- 1 1000 1000 812313 May 1 2019 orc-mapreduce-1.5.5-nohive.jar
-rw-r--r-- 1 1000 1000 27745 May 1 2019 orc-shims-1.5.5.jar
-rw-r--r-- 1 1000 1000 65261 May 1 2019 oro-2.0.8.jar
-rw-r--r-- 1 1000 1000 20235 May 1 2019 osgi-resource-locator-1.0.1.jar
-rw-r--r-- 1 root root 29555 Feb 20 17:39 paranamer-2.3.jar
-rw-r--r-- 1 1000 1000 34654 May 1 2019 paranamer-2.8.jar
-rw-r--r-- 1 1000 1000 1097799 May 1 2019 parquet-column-1.10.1.jar
-rw-r--r-- 1 1000 1000 94995 May 1 2019 parquet-common-1.10.1.jar
-rw-r--r-- 1 1000 1000 848750 May 1 2019 parquet-encoding-1.10.1.jar
-rw-r--r-- 1 1000 1000 723203 May 1 2019 parquet-format-2.4.0.jar
-rw-r--r-- 1 1000 1000 285732 May 1 2019 parquet-hadoop-1.10.1.jar
-rw-r--r-- 1 1000 1000 1048171 May 1 2019 parquet-jackson-1.10.1.jar
-rw-r--r-- 1 root root 533455 Feb 20 17:39 protobuf-java-2.5.0.jar
-rw-r--r-- 1 1000 1000 122774 May 1 2019 py4j-0.10.7.jar
-rw-r--r-- 1 1000 1000 94796 May 1 2019 pyrolite-4.13.jar
-rw-r--r-- 1 1000 1000 15612191 May 1 2019 scala-compiler-2.11.12.jar
-rw-r--r-- 1 1000 1000 5749423 May 1 2019 scala-library-2.11.12.jar
-rw-r--r-- 1 1000 1000 471925 May 1 2019 scala-parser-combinators_2.11-1.1.0.jar
-rw-r--r-- 1 1000 1000 4623075 May 1 2019 scala-reflect-2.11.12.jar
-rw-r--r-- 1 1000 1000 671138 May 1 2019 scala-xml_2.11-1.0.5.jar
-rw-r--r-- 1 root root 105112 Feb 20 17:39 servlet-api-2.5.jar
-rw-r--r-- 1 1000 1000 3522616 May 1 2019 shapeless_2.11-2.3.2.jar
-rw-r--r-- 1 1000 1000 4028 May 1 2019 shims-0.7.45.jar
-rw-r--r-- 1 root root 32119 Feb 20 17:39 slf4j-api-1.7.10.jar
-rw-r--r-- 1 root root 8866 Feb 20 17:39 slf4j-log4j12-1.7.10.jar
-rw-r--r-- 1 1000 1000 269295 May 1 2019 snakeyaml-1.15.jar
-rw-r--r-- 1 root root 995968 Feb 20 17:39 snappy-java-1.0.4.1.jar
-rw-r--r-- 1 1000 1000 2021167 May 1 2019 snappy-java-1.1.7.3.jar
-rw-r--r-- 1 1000 1000 10215969 May 1 2019 spark-catalyst_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 13513957 May 1 2019 spark-core_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 708181 May 1 2019 spark-graphx_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 537610 May 1 2019 spark-kubernetes_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 53049 May 1 2019 spark-kvstore_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 75939 May 1 2019 spark-launcher_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 683952 May 1 2019 spark-mesos_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 183838 May 1 2019 spark-mllib-local_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 8025397 May 1 2019 spark-mllib_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 2392842 May 1 2019 spark-network-common_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 70899 May 1 2019 spark-network-shuffle_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 137626 May 1 2019 spark-repl_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 30063 May 1 2019 spark-sketch_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 9882940 May 1 2019 spark-sql_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 2171609 May 1 2019 spark-streaming_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 8843 May 1 2019 spark-tags_2.11-2.4.3-tests.jar
-rw-r--r-- 1 1000 1000 15461 May 1 2019 spark-tags_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 49195 May 1 2019 spark-unsafe_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 672974 May 1 2019 spark-yarn_2.11-2.4.3.jar
-rw-r--r-- 1 1000 1000 87192 May 1 2019 spire-macros_2.11-0.13.0.jar
-rw-r--r-- 1 1000 1000 10121868 May 1 2019 spire_2.11-0.13.0.jar
-rw-r--r-- 1 root root 23346 Feb 20 17:39 stax-api-1.0-2.jar
-rw-r--r-- 1 1000 1000 174351 May 1 2019 stream-2.7.0.jar
-rw-r--r-- 1 1000 1000 404970 May 1 2019 univocity-parsers-2.7.3.jar
-rw-r--r-- 1 1000 1000 63777 May 1 2019 validation-api-1.1.0.Final.jar
-rw-r--r-- 1 1000 1000 282930 May 1 2019 xbean-asm6-shaded-4.8.jar
-rw-r--r-- 1 root root 15010 Feb 20 17:39 xmlenc-0.52.jar
-rw-r--r-- 1 root root 94672 Feb 20 17:39 xz-1.0.jar
-rw-r--r-- 1 1000 1000 35518 May 1 2019 zjsonpatch-0.3.0.jar
-rw-r--r-- 1 root root 792964 Feb 20 17:39 zookeeper-3.4.6.jar
-rw-r--r-- 1 1000 1000 2333186 May 1 2019 zstd-jni-1.3.2-2.jar
from aws-glue-samples.
moomindani
commented on July 3, 2024
I have done further investigation.
Can you try this new pom.xml?
<project
xmlns="http://maven.apache.org/POM/4.0.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>com.amazonaws</groupId>
<artifactId>HadoopForGlueSparkHistoryServer</artifactId>
<packaging>jar</packaging>
<version>1.0-SNAPSHOT</version>
<name>HadoopForGlueSparkHistoryServer</name>
<url>http://maven.apache.org</url>
<properties>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<jdk.version>1.8</jdk.version>
<hadoop.version>2.8.5</hadoop.version>
<awssdk.version>1.11.696</awssdk.version>
<httpclient.version>4.5.9</httpclient.version>
<jackson.version>2.6.7</jackson.version>
</properties>
<dependencyManagement>
<dependencies>
<dependency>
<groupId>com.amazonaws</groupId>
<artifactId>aws-java-sdk-bom</artifactId>
<version>${awssdk.version}</version>
<type>pom</type>
<scope>import</scope>
</dependency>
</dependencies>
</dependencyManagement>
<dependencies>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
<version>${hadoop.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-client</artifactId>
<version>${hadoop.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-aws</artifactId>
<version>${hadoop.version}</version>
<scope>provided</scope>
<exclusions>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
</exclusion>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-databind</artifactId>
</exclusion>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-annotations</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>com.amazonaws</groupId>
<artifactId>aws-java-sdk-core</artifactId>
<exclusions>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
</exclusion>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-databind</artifactId>
</exclusion>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-annotations</artifactId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>com.amazonaws</groupId>
<artifactId>aws-java-sdk-s3</artifactId>
</dependency>
<dependency>
<groupId>org.apache.httpcomponents</groupId>
<artifactId>httpclient</artifactId>
<version>${httpclient.version}</version>
</dependency>
<dependency>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
<version>${jackson.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-databind</artifactId>
<version>${jackson.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-annotations</artifactId>
<version>${jackson.version}</version>
<scope>provided</scope>
</dependency>
</dependencies>
</project>
from aws-glue-samples.
woodchuck
commented on July 3, 2024
Yes, this worked! Thank you!!
Now I get this error, which looks unrelated:
Caused by: java.nio.file.AccessDeniedException: s3a://my-bucket/logs/sb: getFileStatus on s3a://my-bucket/logs/sb: com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: ...
I can access this bucket from the cli in the same place I run docker, with the same creds:
aws s3 ls s3://my-bucket/logs/sb/
2020-02-10 11:26:13 0
2020-02-10 14:22:10 52385 application_1580144484639_0001_1-1
...
from aws-glue-samples.
moomindani
commented on July 3, 2024
I am glad to hear that it worked.
As you said, it seems AccessDeniedException is a separate issue.
It might be related to joda-time version mismatch mentioned here: https://issues.apache.org/jira/browse/HIVE-16983
Can you try to run following commands and see if the same error occurs or not?
$ docker run -itd -e SPARK_HISTORY_OPTS="$SPARK_HISTORY_OPTS -Dspark.history.fs.logDirectory=s3a://path_to_my_eventlog_dir -Dspark.hadoop.fs.s3a.access.key=my_key_id -Dspark.hadoop.fs.s3a.secret.key=my_secret_access_key" -p 18080:18080 glue/sparkui:latest /bin/sh
sh-4.2# curl -o /opt/spark/jars/joda-time-2.9.9.jar https://repo1.maven.org/maven2/joda-time/joda-time/2.9.9/joda-time-2.9.9.jar
sh-4.2# rm /opt/spark/jars/joda-time-2.9.3.jar
sh-4.2# rm /opt/spark/jars/joda-time-2.9.4.jar
sh-4.2# ls -la /opt/spark/jars | grep joda
sh-4.2# /opt/spark/bin/spark-class org.apache.spark.deploy.history.HistoryServer
Unfortunately I was not able to replicate the same issue in my end.
If it solves the issue, then I will modify pom.xml to specify joda-time version.
from aws-glue-samples.
woodchuck
commented on July 3, 2024
The new joda-time did not help. I enabled network tracing:
log4j.logger.org.apache.hadoop.fs.s3a=DEBUG
log4j.logger.com.amazonaws.request=DEBUG
log4j.logger.org.apache.http=DEBUG
log4j.logger.org.apache.http.wire=ERROR
sh-4.2# export SPARK_HISTORY_OPTS="$SPARK_HISTORY_OPTS -Dlog4j.configuration=file:/opt/spark/conf/log4j.properties.template"
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> HEAD /logs/sb HTTP/1.1
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> Host: my-bucket.s3.amazonaws.com
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> amz-sdk-invocation-id: b621d8cf...
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> amz-sdk-retry: 0/0/500
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> Authorization: AWS4-HMAC-SHA256 Credential=ASIA.../20200228/us-east-1/s3/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-retry;content-type;host;user-agent;x-amz-content-sha256;x-amz-date, Signature=b04f2ae21...
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> Content-Type: application/octet-stream
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> User-Agent: Hadoop 2.8.5, aws-sdk-java/1.11.696 Linux/5.3.0-40-generic OpenJDK_64-Bit_Server_VM/25.242-b08 java/1.8.0_242 scala/2.11.12 vendor/Amazon.com_Inc.
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> x-amz-content-sha256: UNSIGNED-PAYLOAD
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> X-Amz-Date: 20200228T172020Z
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> Connection: Keep-Alive
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 << HTTP/1.1 403 Forbidden
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 << x-amz-request-id: 646F...
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 << x-amz-id-2: 6BMg079R...
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 << Content-Type: application/xml
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 << Transfer-Encoding: chunked
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 << Date: Fri, 28 Feb 2020 17:20:19 GMT
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 << Server: AmazonS3
On my first attempt this showed the date 1-2 minutes different in the request and response, which led me to https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1849156. I uninstalled ntp, which allowed the new systemd-timesyncd to start properly and sync my time, but I still get the 403 response.
from aws-glue-samples.
moomindani
commented on July 3, 2024
How was the time difference after doing this? Were there still 1-2 minutes difference?
from aws-glue-samples.
woodchuck
commented on July 3, 2024
After the time sync the difference was just 1 second:
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 >> X-Amz-Date: 20200228T172020Z
20/02/28 17:20:20 DEBUG headers: http-outgoing-0 << Date: Fri, 28 Feb 2020 17:20:19 GMT
I'm using temporary STS credentials via aws login and realized this requires me to also provide the session token. Adding these settings gets it working for me:
-Dspark.hadoop.fs.s3a.session.token=******** -Dspark.hadoop.fs.s3a.aws.credentials.provider=org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
It downloaded and parsed the log files. The next layer of the onion is that I can't see anything in the UI in Firefox or Chrome:
from aws-glue-samples.
woodchuck
commented on July 3, 2024
With log4j.logger.org.apache.spark.deploy.history=INFO set I made this request:
$ curl -v http://localhost:18080/static/sorttable.js
* Trying 127.0.0.1:18080...
* TCP_NODELAY set
* Connected to localhost (127.0.0.1) port 18080 (#0)
> GET /static/sorttable.js HTTP/1.1
> Host: localhost:18080
> User-Agent: curl/7.65.3
> Accept: */*
>
* Empty reply from server
* Connection #0 to host localhost left intact
curl: (52) Empty reply from server
and got this error:
20/03/05 00:57:25 WARN ServletHandler: Error for /static/sorttable.js
java.lang.NoSuchMethodError: javax.servlet.http.HttpServletRequest.isAsyncSupported()Z
at org.spark_project.jetty.servlet.DefaultServlet.sendData(DefaultServlet.java:943)
at org.spark_project.jetty.servlet.DefaultServlet.doGet(DefaultServlet.java:532)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at org.spark_project.jetty.servlet.ServletHolder.handle(ServletHolder.java:848)
at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:584)
at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.spark_project.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.spark_project.jetty.server.Server.handle(Server.java:539)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:333)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.spark_project.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.spark_project.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.spark_project.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.spark_project.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
20/03/05 00:57:25 WARN HttpChannel: //localhost:18080/static/sorttable.js
java.lang.NoSuchMethodError: javax.servlet.http.HttpServletRequest.isAsyncStarted()Z
at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:688)
at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.spark_project.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.spark_project.jetty.server.Server.handle(Server.java:539)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:333)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.spark_project.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.spark_project.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.spark_project.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.spark_project.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
which took me too https://stackoverflow.com/a/23759954/418819, which suggests that the wrong version of the servlet API is to blame.
sh-4.2# ls -1 /opt/spark/jars/*servlet*
/opt/spark/jars/javax.servlet-api-3.1.0.jar
/opt/spark/jars/jersey-container-servlet-2.22.2.jar
/opt/spark/jars/jersey-container-servlet-core-2.22.2.jar
/opt/spark/jars/servlet-api-2.5.jar
sh-4.2# mv /opt/spark/jars/servlet-api-2.5.jar /tmp
That gets me tantalizingly close:
20/03/05 01:03:53 WARN ServletHandler: /api/v1/applications
java.lang.NullPointerException
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:388)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:341)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:228)
at org.spark_project.jetty.servlet.ServletHolder.handle(ServletHolder.java:848)
at org.spark_project.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:584)
at org.spark_project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.spark_project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.spark_project.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.spark_project.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.spark_project.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
at org.spark_project.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at org.spark_project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.spark_project.jetty.server.Server.handle(Server.java:539)
at org.spark_project.jetty.server.HttpChannel.handle(HttpChannel.java:333)
at org.spark_project.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.spark_project.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.spark_project.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.spark_project.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.spark_project.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.spark_project.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.spark_project.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
from aws-glue-samples.
woodchuck
commented on July 3, 2024
In addition to mv /opt/spark/jars/servlet-api-2.5.jar /tmp, the following got me the rest of the way: 🎊
sh-4.2# cd /opt/spark/jars
sh-4.2# ls -1 *jsr*
jsr305-1.3.9.jar
jsr305-3.0.0.jar
sh-4.2# mv jsr305-1.3.9.jar /tmp
sh-4.2# ls -1 *jersey*
jersey-client-1.9.jar
jersey-client-2.22.2.jar
jersey-common-2.22.2.jar
jersey-container-servlet-2.22.2.jar
jersey-container-servlet-core-2.22.2.jar
jersey-core-1.9.jar
jersey-guava-2.22.2.jar
jersey-json-1.9.jar
jersey-media-jaxb-2.22.2.jar
jersey-server-1.9.jar
jersey-server-2.22.2.jar
sh-4.2# mv jersey-*-1.9.jar /tmp
from aws-glue-samples.
moomindani
commented on July 3, 2024
Sounds great! Thank you for reporting the result.
Please let me confirm what you did.
- You made changes from this pom.xml #56 (comment)
- The changes are...
- remove /opt/spark/jars/joda-time-2.9.3.jar
- remove /opt/spark/jars/joda-time-2.9.4.jar
- add /opt/spark/jars/joda-time-2.9.9.jar
- remove /opt/spark/jars/jsr305-1.3.9.jar
Is it correct? Or did you just remove jsr305-1.3.9.jar and it worked without any change for joda-time?
from aws-glue-samples.
woodchuck
commented on July 3, 2024
It worked without any change to joda-time. I did:
- changes from this pom.xml #56 (comment)
- run /bin/sh in the docker container with additional settings for my temporary STS credentials:
-Dspark.hadoop.fs.s3a.session.token=******** -Dspark.hadoop.fs.s3a.aws.credentials.provider=org.apache.hadoop.fs.s3a.TemporaryAWSCredentialsProvider
- remove /opt/spark/jars/servlet-api-2.5.jar
- remove /opt/spark/jars/jsr305-1.3.9.jar
- remove /opt/spark/jars/jersey-*-1.9.jar
from aws-glue-samples.
moomindani
commented on July 3, 2024
Okay makes sense. Thank you for explanation.
from aws-glue-samples.
moomindani
commented on July 3, 2024
Fixed in this commit: afb08e9
Resolving.
from aws-glue-samples.
Related Issues (20)
- 'glue/sparkui:latest' missing in Docker hub HOT 3
- Issue with migrating directly from AWS Glue to Hive HOT 2
- Creating AWS- Glue Pipeline using Cloud Formation HOT 3
- Issue migrating directly from Hive Metastore to Glue Data Catalog
- Spark-UI docker container startup issue HOT 4
- hive_metastore_migration.py fails with AttributeError: 'str' object has no attribute '_jdf' HOT 1
- Unable to start Spark-UI docker container from EC2 in China Region HOT 6
- tinyint(1) issue from mysql database
- Issues using Spark_UI/glue-3_0 and Spark_UI/glue-4_0 HOT 2
- Spark UI Glue 4.0 Logging Not Working? HOT 2
- Request to Host Glue Spark UI Images on DockerHub
- Spark UI container is not getting started HOT 3
- Launch AWS Glue Spark UI Filtered to Specific Applications
- EMR Hive Metastore to Glue Migration
- Setup AWS glue
- Wrong escape character in avro.schema.url
- Couldn't resolve host name for Spark UI HOT 4
- writing data to s3 using spark and updating catalog
- Unable to run history server in docker HOT 1
- Spark history server: README.md to show using AWS_PROFILE HOT 23
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aws-glue-samples.