spring-attic / spring-xd-samples Goto Github PK

Sample starter applications and code for use with the Spring XD project

License: Apache License 2.0

Groovy 0.96% HTML 3.35% JavaScript 9.25% Shell 0.39% Java 78.77% PigLatin 0.07% Ruby 0.22% CSS 5.38% R 0.40% Scala 1.22%

spring-xd-samples's Introduction

spring-xd-samples is no longer actively maintained by VMware, Inc.

Spring XD Samples

This repository provides sample starter applications and code for use with the Spring XD project. The following samples are available:

analytics-dashboard

Standalone project which shows how you can use the D3 Javascript library to create visualizations for Spring XD counters.

analytics-pmml

Demonstrates the use of the analytics-pmml module by sending JSON data describing a Iris flower to an http source and using a PMML model to predict the species of Iris.

batch-basic

Shows how to deploy a simple Spring Batch process in Spring XD, without having to compile any code or install any jars.

batch-notifications

This sample will take an input file containing payment data, and import the data into a database using Spring XD's batch job support. During import, various notification events are triggered and printed to the console.

batch-hashtag-count

This sample will take an input file with Twitter JSON data and count the occurrences of hashtags.

batch-simple

This is the quintessential Hello World example for Spring XD. It consists of only one Spring Batch Tasklet which prints out Hello Spring XD!.

batch-wordcount

This is the Spring Batch word-count sample for Hadoop adapted for Spring XD. This sample will take an input file and count the occurrences of each word within that document.

groovy-script-sink

A custom module that illustrates how to bind variables defined as module options to a groovy script.

hdfs-partitioning

Demonstrates the hdfs sink and its partitioning features.

kafka-message-bus

This sample walks you through setting up Kafka as a message bus for Spring XD, also demonstrating partitining and failover.

kafka-source

This sample walks you through setting up a Kafka source in Spring XD, also demonstrating the use of multiple modules for ingestion efficiency.

payload-conversion

This sample project implements a custom processor and demonstrates the use of the Tuple data type.

pivotal-hd-demo

Demo using Spring XD with Pivotal HD.

reactor-moving-average

A custom module that uses Reactor's Stream API to perform stream analysis.

reactor-tcp

Demonstrates the use of Reactor's TCP input source

redis-store-sink

A simple custom sink module project implementing a Redis store, including integration tests.

rss-feed-source

A simple custom source module project implementing an RSS feed, including integration tests.

rxjava-moving-average

A custom module that uses RxJava's Observable API to perform stream analysis.

si-dsl-module

This sample demonstrates how to create a custom module project, including integration tests, and packaging the module as an uber-jar using maven (requires Spring XD 1.1.x). The project also demonstrates the use of the Spring Integration Java DSL

smartgrid-prediction

This sample showcases a fictional use of Spring XD in the context of smart electricity metering and production. It was inspired by the http://www.cse.iitb.ac.in/debs2014/?page_id=42[ACM Distributed Event Based Systems Grand Challenge 2014].

syslog

This sample demonstrates how to setup syslog ingestion from multiple hosts into HDFS.

tweet-transformer-processor

A simple custom processor module project, including integration tests. This one has no external dependencies other than the processor implementation and Spring configuration which is provided either as XML or @Configuration.

spring-xd-samples's People

Contributors

Stargazers

Watchers

Forkers

ghillert cppwfs trisberg landytest alexkit kuguobing wanbai jeffxor felipeg48 garyrussell thomasdarimont jpeffer rkampani jugsaar flobe890 loicfinco przodownikr1 jvalkeal ericbottard joshuad2 mbogoevici caosg nathankurtyka willschipp shefansxyh dtarrant arnabmitra rmenesespiv lemonhall zgshu dilipmuthuraj subkartik berenjb deeptib shooton-pivotal sxhao flamilton jravichetan lobedan gustavotavone mr1azl sdalli erfinfeluzy faustvault hrajesh4u vdthatte spcambell karannagi sadineni aelsherbeeny asherbeeny gabhi tspannatpivotal krisgopal hansuky ilayaperumalg sachingh74 jmonterog h0shekhar robododge vgadwal elicer nxbdi antifanta21 kuner mylovetop kongxianghe1234 d0lphin punchmk jpetersson guskovartem zach14c ilovejs pshivam kenye ishara msaboor abhilash-m sleyzerzon easetech jigsheth57 neeraj markfisher mohdaliiqbal muammara eshannanda sathishk ruixiang babbam-pivotal frederik79 veitr mminella jzlhit hiimkyle maxsitu gastongonzalez deyabhishek79 pdinavahi hxgong ywang-pivotal

spring-xd-samples's Issues

[batch-simple] Spring Batch using Spring Boot Java Configuration

Spring Batch services can use Java Configurations to configure batch Job using Spring Boot. (https://spring.io/guides/gs/batch-processing/)

The sample we have in Spring XD uses xml instead of java config (https://github.com/spring-projects/spring-xd-samples/tree/master/batch-simple)

It will be better, if the example shows how to use Spring Boot style job configuration.

[batch-wordcount] Readme.md is unclear

First of all thanks for these great examples. Very helpful.

The documentation of the batch-wordcount sample should be updated to

mention if the module can also be loaded via module upload --file ... --type job --name wordcount, instead of copying via script.
mention how to build against other versions of hadoop (e.g. 2.6). I suspect it would simply be sufficient to change the hadoop.version property in the pom.xml.

I tried to execute the wordcount sample as described above, but I get an exception when running the job: java.lang.ClassNotFoundException: org.apache.hadoop.examples.WordCount$TokenizerMapper

The kafka source is sending bytes

Since the kafka source is sending just the bytes, the examples is not working, the stream should be something like:

stream create kafka-source-test --definition "kafka --zkconnect=localhost:2181 --topic=kafka-source-test | transform --expression='new java.lang.String(payload)' | log" --deploy

Thanks.

Exception on building tweet-transformer-processor

When building tweet-transformer-processor with gradle build I get the following Exception:

org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jobsController': Injection of autowired dependencies failed; nested exception is org.springframework.beans.factory.BeanCreationException: Could not autowire field: private org.springframework.xd.dirt.server.admin.deployment.DeploymentMessagePublisher org.springframework.xd.dirt.rest.XDController.deploymentMessagePublisher; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'deploymentMessageProducer' defined in class org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.xd.dirt.server.admin.deployment.zk.ZKDeploymentMessagePublisher]: Factory method 'deploymentMessageProducer' threw exception; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'deploymentQueue' defined in class org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration: Invocation of init method failed; nested exception is java.lang.IllegalArgumentException: Path must start with / character at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:334) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1214) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:543) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:772) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:839) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:538) at org.springframework.boot.context.embedded.EmbeddedWebApplicationContext.refresh(EmbeddedWebApplicationContext.java:118) at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:686) at org.springframework.boot.SpringApplication.run(SpringApplication.java:320) at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:139) at org.springframework.xd.dirt.server.singlenode.SingleNodeApplication.run(SingleNodeApplication.java:83) at my.custom.transformer.TweetTransformerIntegrationTest.setUp(TweetTransformerIntegrationTest.java:53) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:112) at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:56) at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66) at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35) at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) at org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32) at org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93) at com.sun.proxy.$Proxy2.processTestClass(Unknown Source) at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:109) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35) at org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) at org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:364) at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:54) at org.gradle.internal.concurrent.StoppableExecutorImpl$1.run(StoppableExecutorImpl.java:40) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: org.springframework.beans.factory.BeanCreationException: Could not autowire field: private org.springframework.xd.dirt.server.admin.deployment.DeploymentMessagePublisher org.springframework.xd.dirt.rest.XDController.deploymentMessagePublisher; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'deploymentMessageProducer' defined in class org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.xd.dirt.server.admin.deployment.zk.ZKDeploymentMessagePublisher]: Factory method 'deploymentMessageProducer' threw exception; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'deploymentQueue' defined in class org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration: Invocation of init method failed; nested exception is java.lang.IllegalArgumentException: Path must start with / character at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:573) at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88) at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:331) ... 51 more Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'deploymentMessageProducer' defined in class org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.xd.dirt.server.admin.deployment.zk.ZKDeploymentMessagePublisher]: Factory method 'deploymentMessageProducer' threw exception; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'deploymentQueue' defined in class org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration: Invocation of init method failed; nested exception is java.lang.IllegalArgumentException: Path must start with / character at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:599) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1123) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1018) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014) at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:545) ... 53 more Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.xd.dirt.server.admin.deployment.zk.ZKDeploymentMessagePublisher]: Factory method 'deploymentMessageProducer' threw exception; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'deploymentQueue' defined in class org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration: Invocation of init method failed; nested exception is java.lang.IllegalArgumentException: Path must start with / character at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:189) at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:588) ... 65 more Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'deploymentQueue' defined in class org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration: Invocation of init method failed; nested exception is java.lang.IllegalArgumentException: Path must start with / character at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1578) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:545) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197) at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:368) at org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration$$EnhancerBySpringCGLIB$$9376625f.deploymentQueue(<generated>) at org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration.deploymentMessageProducer(DeploymentConfiguration.java:155) at org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration$$EnhancerBySpringCGLIB$$9376625f.CGLIB$deploymentMessageProducer$12(<generated>) at org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration$$EnhancerBySpringCGLIB$$9376625f$$FastClassBySpringCGLIB$$5b636e80.invoke(<generated>) at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228) at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:355) at org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentConfiguration$$EnhancerBySpringCGLIB$$9376625f.deploymentMessageProducer(<generated>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162) ... 66 more Caused by: java.lang.IllegalArgumentException: Path must start with / character at org.apache.curator.utils.PathUtils.validatePath(PathUtils.java:54) at org.apache.curator.framework.recipes.queue.QueueBuilder.<init>(QueueBuilder.java:269) at org.apache.curator.framework.recipes.queue.QueueBuilder.builder(QueueBuilder.java:64) at org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentQueue.start(DeploymentQueue.java:122) at org.springframework.xd.dirt.server.admin.deployment.zk.DeploymentQueue.afterPropertiesSet(DeploymentQueue.java:153) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1637) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1574) ... 85 more

http post --message is not available in Spring-XD

Hi I am running spark-streaming-logger-java-sink example,

I configured Spark cluster and the SpringXD srevers.yml file exactly how you mentioned, i am able upload the module as well as created and deployed new stream 'spark-streaming-java-logger' successfully.

While posting the messages to the stream i got an error that
xd:>http post --message "foo foo foo"
Option 'message' is not available for this command. Use tab assist or the "help" command to see the legal options

Please Help me to solve this issue.

Thanks

Is the pivotal-hd-demo compatible with Pivotal HD for Pivotal CF?

Hi there,

I've got a Cloud Foundry instance with the Pivotal HD for Pivotal CF product deployed.
I'm trying to test this deployment by using the pivotal-hd-demo included in this repo, however I'm running into some problems.

Do you know if the sample app is compatible with PHD for PCF?

I'm testing with spring xd 1.0.0.M7 and Pivotal HD for Pivotal CF 1.2.0.0.

Thanks

Conflict in pom.xml of sample-module-parent

There is a non resolved conflict in pom.xml file of sample-module-parent on master branch.

Very small correction - remove "-" from hadoop config

Correct syntax
hadoop config fs --namenode hdfs://localhost:8020

Spring XD spark streaming processor example Java not running.

Hi,

I am trying to run the Spring XD spark streaming processor example and am getting the following error.

2015-10-22T08:15:30-0700 1.2.1.RELEASE ERROR DeploymentsPathChildrenCache-0 container.DeploymentListener - Exception deploying module
java.lang.IllegalStateException: Spark cluster mode must be 'local' for 'local' XD transport.
    at org.springframework.xd.dirt.plugins.spark.streaming.SparkStreamingPlugin.postProcessModule(SparkStreamingPlugin.java:154) ~[spring-xd-dirt-1.2.1.RELEASE.jar:1.2.1.RELEASE]
    at org.springframework.xd.dirt.module.ModuleDeployer.postProcessModule(ModuleDeployer.java:238) ~[spring-xd-dirt-1.2.1.RELEASE.jar:1.2.1.RELEASE]
    at org.springframework.xd.dirt.module.ModuleDeployer.doDeploy(ModuleDeployer.java:218) ~[spring-xd-dirt-1.2.1.RELEASE.jar:1.2.1.RELEASE]
    at org.springframework.xd.dirt.module.ModuleDeployer.deploy(ModuleDeployer.java:200) ~[spring-xd-dirt-1.2.1.RELEASE.jar:1.2.1.RELEASE]
    at org.springframework.xd.dirt.server.container.DeploymentListener.deployModule(DeploymentListener.java:365) [spring-xd-dirt-1.2.1.RELEASE.jar:1.2.1.RELEASE]
    at org.springframework.xd.dirt.server.container.DeploymentListener.deployStreamModule(DeploymentListener.java:334) [spring-xd-dirt-1.2.1.RELEASE.jar:1.2.1.RELEASE]
    at org.springframework.xd.dirt.server.container.DeploymentListener.onChildAdded(DeploymentListener.java:181) [spring-xd-dirt-1.2.1.RELEASE.jar:1.2.1.RELEASE]
    at org.springframework.xd.dirt.server.container.DeploymentListener.childEvent(DeploymentListener.java:149) [spring-xd-dirt-1.2.1.RELEASE.jar:1.2.1.RELEASE]
    at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:509) [curator-recipes-2.6.0.jar:na]
    at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:503) [curator-recipes-2.6.0.jar:na]
    at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92) [curator-framework-2.6.0.jar:na]
    at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:na]
    at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:83) [curator-framework-2.6.0.jar:na]
    at org.apache.curator.framework.recipes.cache.PathChildrenCache.callListeners(PathChildrenCache.java:500) [curator-recipes-2.6.0.jar:na]
    at org.apache.curator.framework.recipes.cache.EventOperation.invoke(EventOperation.java:35) [curator-recipes-2.6.0.jar:na]
    at org.apache.curator.framework.recipes.cache.PathChildrenCache$10.run(PathChildrenCache.java:762) [curator-recipes-2.6.0.jar:na]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_51]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_51]
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_51]
    at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_51]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_51]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_51]
    at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
2015-10-22T08:15:30-0700 1.2.1.RELEASE INFO DeploymentsPathChildrenCache-0 container.DeploymentListener - Path cache event: path=/deployments/modules/allocated/7ef02c96-56f3-4791-8b12-9a61f06c16d3/spark-streaming-word-count.processor.java-word-count.1, type=CHILD_REMOVED
2015-10-22T08:15:30-0700 1.2.1.RELEASE INFO DeploymentsPathChildrenCache-0 container.DeploymentListener - Undeploying module [ModuleDescriptor@69180307 moduleName = 'java-word-count', moduleLabel = 'java-word-count', group = 'spark-streaming-word-count', sourceChannelName = [null], sinkChannelName = [null], index = 1, type = processor, parameters = map['enableTap' -> 'true'], children = list[[empty]]]
2015-10-22T08:15:30-0700 1.2.1.RELEASE INFO DeploymentsPathChildrenCache-0 container.DeploymentListener - Path cache event: path=/deployments/modules/allocated/7ef02c96-56f3-4791-8b12-9a61f06c16d3/spark-streaming-word-count.source.http.1, type=CHILD_ADDED
2015-10-22T08:15:30-0700 1.2.1.RELEASE INFO DeploymentsPathChildrenCache-0 container.DeploymentListener - Deploying module 'http' for stream 'spark-streaming-word-count'
2015-10-22T08:15:30-0700 1.2.1.RELEASE INFO DeploymentsPathChildrenCache-0 container.DeploymentListener - Deploying module [ModuleDescriptor@49a6efe7 moduleName = 'http', moduleLabel = 'http', group = 'spark-streaming-word-count', sourceChannelName = [null], sinkChannelName = [null], index = 0, type = source, parameters = map[[empty]], children = list[[empty]]]
2015-10-22T08:15:30-0700 1.2.1.RELEASE INFO DeploymentSupervisor-0 zk.ZKStreamDeploymentHandler - Deployment status for stream 'spark-streaming-word-count': DeploymentStatus{state=failed,error(s)=java.lang.IllegalStateException: Spark cluster mode must be 'local' for 'local' XD transport.
    at org.springframework.xd.dirt.plugins.spark.streaming.SparkStreamingPlugin.postProcessModule(SparkStreamingPlugin.java:154)
    at org.springframework.xd.dirt.module.ModuleDeployer.postProcessModule(ModuleDeployer.java:238)
    at org.springframework.xd.dirt.module.ModuleDeployer.doDeploy(ModuleDeployer.java:218)
    at org.springframework.xd.dirt.module.ModuleDeployer.deploy(ModuleDeployer.java:200)
    at org.springframework.xd.dirt.server.container.DeploymentListener.deployModule(DeploymentListener.java:365)
    at org.springframework.xd.dirt.server.container.DeploymentListener.deployStreamModule(DeploymentListener.java:334)
    at org.springframework.xd.dirt.server.container.DeploymentListener.onChildAdded(DeploymentListener.java:181)
    at org.springframework.xd.dirt.server.container.DeploymentListener.childEvent(DeploymentListener.java:149)
    at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:509)
    at org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:503)
    at org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:92)
    at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297)
    at org.apache.curator.framework.listen.ListenerContainer.forEach(ListenerContainer.java:83)
    at org.apache.curator.framework.recipes.cache.PathChildrenCache.callListeners(PathChildrenCache.java:500)
    at org.apache.curator.framework.recipes.cache.EventOperation.invoke(EventOperation.java:35)
    at org.apache.curator.framework.recipes.cache.PathChildrenCache$10.run(PathChildrenCache.java:762)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)

As per the instructions, i started spark and then set the url of the cluster manager to the master under spark in servers.yml. Can someone tell me what I am doing wrong???

Errors building smartgrid-prediction project

Hi,

I am running into a couple of issues while setting up the smartgrid-prediction repo and would appreciate your assistance. I am using springxd release 1.1.1

Issue 1: I have installed analytic-pmml module in springxd processor via module upload command but the 'predict' stream is not starting and my xd instance throws "Constructor threw exception; nested exception is java.lang.RuntimeException: java.io.FileNotFoundException: class path resource [prediction.pmml] cannot be resolved to URL because it does not exist". I have also noticed that prediction.pmml does not exist in the resource folder of spring-xd-modules/analytics-ml-pmml -- how do I add classpath to prediction.pmml in the prediction folder?

Issue 2: Cannot start Spring boot app via mvn spring-boot:run --- Error in maven compilation step "Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:compile (default-compile) on project smartgrid-frontend: Fatal error compiling: invalid target release: 1.8"

Thanks in advance for your guidance.

Setup for simple_example

I'm trying to run a variation of simple_example that uses the module upload and can't get it to work. The straight forward example works when I setup the module under XD_INSTALL.

I have:

Custom module registry location

Any custom modules built can be placed into this configured location

The location must be set to a valid resource URL (file://, classpath:/ etc.,)

xd:
customModule:
home: file:///Users/wlund/xd-custom-modules

Its not clear whether just setting up the directory should work but on files with jars when I use module upload it does work.

xd:>module upload --file /Users/wlund/xd-custom-modules/rsasession-stream-ingest/lib/rsasession-stream-1.0.0-SNAPSHOT.jar --name rsasession-stream-ingest --type job
Successfully uploaded module 'job:rsasession-stream-ingest'

However, I get the following on setting up the same example in xd-custom-modules:

module upload --file /Users/wlund/xd-custom-modules/simple-example --name simple_example --type job
Command failed org.springframework.web.client.ResourceAccessException: I/O error on POST request for "http://localhost:9393/modules/job/simple_example":/Users/wlund/xd-custom-modules/simple-example (Is a directory); nested exception is java.io.FileNotFoundException: /Users/wlund/xd-custom-modules/simple-example (Is a directory).

Can't seem to get it to work without being under the XD_INSTALL directory. Am I doing something wrong?

Is the Gauge tweet/minute shape still present?

Looking at the screenshot in the description seems that aggregate-counter analytics data was visualized with 2 widgets: bar-chart and gauge. However, when I cloned the example from Git and ran it myself I didn't see the gauge... The code suggests the gauge SVG widget has been removed, is that correct? If yes, does anyone know where that shape came from? Do you happen to have the source SVG for it? Or is it coming from D3? Or generated with D3 somehow?
Thanks in advance!