apache / incubator-streampark-quickstart Goto Github PK

View Code? Open in Web Editor NEW

61.0 13.0 61.0 206 KB

Apache StreamPark quickstart

License: Apache License 2.0

Shell 63.24% Java 16.04% Scala 20.71%

incubator-streampark-quickstart's Introduction

A magical framework that makes stream processing easier!

Website | Document | FAQ

🚀 What is StreamPark?

StreamPark is a stream processing development framework and professional management platform.

StreamPark is a streaming application development framework. Aimed at ease building and managing streaming applications, StreamPark provides development framework for writing stream processing application with Apache Flink and Apache Spark, More other engines will be supported in the future. Also, StreamPark is a professional management platform for streaming application , including application development, debugging, interactive query, deployment, operation, maintenance, etc. It was initially known as StreamX and renamed to StreamPark in August 2022.

🚀 What is streampark-quickstart ?

Apache StreamPark quickstart program for developing Flink

🎉 Modules

quickstart-apacheflink
quickstart-datastream
quickstart-flinksql
quickstart-connector

| quickstart-apacheflink

quickstart-apacheflink is an official SocketWindowWordCount program provided by Flink. The project structure, packaging rules, development methods, etc. are fully consistent with the specifications required by the Flink official website. The reason for having this module is to support the deployment of standard Flink programs (Flink programs developed according to the official development specifications) in streampark-console for subsequent demonstrations and ease of use.

| quickstart-datastream

This module demonstrates how to quickly develop a DataStream program using Apache StreamPark. It provides development examples in both Java and Scala to help developers get started quickly.

| quickstart-flinksql

This module demonstrates how to quickly develop a Flink & SQL program using Apache StreamPark. It provides development examples in both Java and Scala to help developers get started quickly.

| quickstart-connector

This module demonstrates how to use various Datastream connectors provided by Apache StreamPark. It includes configuration and usage examples of various Datastream connectors, allowing developers to get started quickly.

🔨 How to Build

git clone [email protected]:apache/incubator-streampark-quickstart.git
cd incubator-streampark-quickstart
mvn clean install -DskipTests

💬 Social Media

Twitter
Zhihu (in Chinese)
bilibili (in Chinese)
WeChat Official Account (in Chinese, scan the QR code to follow)

incubator-streampark-quickstart's People

Contributors

Stargazers

Watchers

incubator-streampark-quickstart's Issues

编译报 QuickStartJavaApp.java:48: cannot find symbol 。。。location: class com.streamxhub.streamx.common.util.JsonUtils

[ERROR] [Error] /home/hudi/streamx-console-service-1.2.2/streamx_workspace/project/streamx-quickstart/streamx-quickstart-main/quickstart-datastream/datastream_1.12/src/main/java/com/streamxhub/streamx/flink/quickstart/datastream/QuickStartJavaApp.java:48: cannot find symbol
symbol: method read(java.lang.String,java.lang.Class<com.streamxhub.streamx.flink.quickstart.datastream.JavaUser>)
location: class com.streamxhub.streamx.common.util.JsonUtils
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for StreamX Quickstart 1.2.2:
[INFO]
[INFO] StreamX Quickstart ................................. SUCCESS [ 2.773 s]
[INFO] Quickstart Flink Job ............................... SUCCESS [ 12.451 s]
[INFO] Quickstart StreamX DataStream Job .................. SUCCESS [ 0.062 s]
[INFO] Quickstart StreamX DataStream Job For Flink 1.12 ... FAILURE [ 11.347 s]
[INFO] Quickstart StreamX DataStream Job For Flink 1.13 ... SKIPPED
[INFO] Quickstart StreamX DataStream Job For Flink 1.14 ... SKIPPED
[INFO] Quickstart StreamX FlinkSQL Job .................... SKIPPED
[INFO] Quickstart StreamX FlinkSQL Job For Flink 1.12 ..... SKIPPED
[INFO] Quickstart StreamX FlinkSQL Job For Flink 1.13 ..... SKIPPED
[INFO] Quickstart StreamX FlinkSQL Job For Flink 1.14 ..... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 27.099 s
[INFO] Finished at: 2022-04-04T10:10:10+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:4.3.0:compile (default-cli) on project datastream_1.12: Execution default-cli of goal net.alchim31.maven:scala-maven-plugin:4.3.0:compile failed.: CompileFailed -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.

streampark依赖的下不到呢？

Could not resolve dependencies for project org.apache.streampark:datastream_1.13:jar:2.0.0: The following artifacts could not be resolved: org.apache.streampark:streampark-flink-shims_flink-1.13_2.12:jar:2.0.0, org.apache.streampark:streampark-flink-connector-kafka_2.12:jar:2.0.0, org.apache.streampark:streampark-flink-connector-jdbc_2.12:jar:2.0.0, org.apache.streampark:streampark-flink-core_2.12:jar:2.0.0: org.apache.streampark:streampark-flink-shims_flink-1.13_2.12:jar:2.0.0 was not found in https://maven.aliyun.com/nexus/content/groups/public during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of nexus-aliyun has elapsed or updates are forced -> [Help 1]