jcustenborder / connect-utils Goto Github PK

View Code? Open in Web Editor NEW

33.0 33.0 23.0 986 KB

Utility project for working with Kafka Connect.

Home Page: http://confluent.io

License: Apache License 2.0

Java 97.76% FreeMarker 2.24%

conversion kafka kafka-connect parsing schema

connect-utils's People

Contributors

Stargazers

connect-utils's Issues

SourceRecordDeque.drain() should replace other versions.

Return null after wait with no records.

RST and Markdown documentation should be generated by the templates.

Transformations with Inner Classes are only using the Inner Class for the test name and output file.

remove example from Property Based Example and Rest Based Example

example files are still being added

Documentation enhancements.

Add generic helpers for converting structs and maps.

Markdown support should include tested examples.

Add support for example data

Add support for docs.confluent.io

Add support for headers in connect record storage.

Avoid size() or isEmpty() for drain

Exception thrown when pom does not have issueManagement.

[INFO] Writing /Users/jeremy/source/opensource/kafka-connect/kafka-connect-jms/target/docs/info/support.rst
Nov 03, 2017 3:13:48 PM freemarker.log._JULLoggerFactory$JULLogger error
SEVERE: Error executing FreeMarker template
FreeMarker template error:
The following has evaluated to null or missing:
==> model.issueManagement  [in template "support.rst.ftl" at line 11, column 53]

----
Tip: It's the step after the last dot that caused this error, not those before it.
----
Tip: If the failing expression is known to be legally refer to something that's sometimes null or missing, either specify a default value like myOptionalVar!myDefault, or use <#if myOptionalVar??>when-present<#else>when-missing</#if>. (These only cover the last step of the expression; to cover the whole expression, use parenthesis: (myOptionalVar.foo)!myDefault, (myOptionalVar.foo)??
----

----
FTL stack trace ("~" means nesting-related):
	- Failed at: ${model.issueManagement.system}  [in template "support.rst.ftl" at line 11, column 51]
----

Java stack trace (for programmers):
----
freemarker.core.InvalidReferenceException: [... Exception message was already printed; see it above ...]
	at freemarker.core.InvalidReferenceException.getInstance(InvalidReferenceException.java:134)
	at freemarker.core.UnexpectedTypeException.newDesciptionBuilder(UnexpectedTypeException.java:80)
	at freemarker.core.UnexpectedTypeException.<init>(UnexpectedTypeException.java:43)
	at freemarker.core.NonHashException.<init>(NonHashException.java:49)
	at freemarker.core.Dot._eval(Dot.java:48)
	at freemarker.core.Expression.eval(Expression.java:81)
	at freemarker.core.DollarVariable.calculateInterpolatedStringOrMarkup(DollarVariable.java:96)
	at freemarker.core.DollarVariable.accept(DollarVariable.java:59)
	at freemarker.core.Environment.visit(Environment.java:327)
	at freemarker.core.Environment.visit(Environment.java:333)
	at freemarker.core.Environment.process(Environment.java:306)
	at freemarker.template.Template.process(Template.java:386)
	at com.github.jcustenborder.kafka.connect.documentation.DocumentationMojo.processTemplate(DocumentationMojo.java:124)
	at com.github.jcustenborder.kafka.connect.documentation.DocumentationMojo.process(DocumentationMojo.java:136)
	at com.github.jcustenborder.kafka.connect.documentation.DocumentationMojo.execute(DocumentationMojo.java:104)
	at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154)
	at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
	at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81)
	at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
	at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309)
	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194)
	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107)
	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:993)
	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:345)
	at org.apache.maven.cli.MavenCli.main(MavenCli.java:191)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
	at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
	at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
	at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)

BlankOrValidator should have a proper toString()

Fix exception with testing if package-info.java is missing.

Rst Example properties and json should have the fully qualified class name.

Add validators for filesystems

Docs should use relative links when possible.

Support Deque that blocks based on capacity.

Validators should throw ConfigException when an issue is detected.

assertStruct ignores logical types

Add convertToLong transformation

StructSerializationModule throws an exception with nested maps.

This will affect nested arrays as well.

org.apache.kafka.connect.errors.DataException: Invalid Java object for schema type STRUCT: class java.util.LinkedHashMap
	at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:233)
	at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:251)
	at org.apache.kafka.connect.data.Struct.put(Struct.java:215)
	at org.apache.kafka.connect.data.Struct.put(Struct.java:204)
	at com.github.jcustenborder.kafka.connect.utils.jackson.StructSerializationModule$Storage.build(StructSerializationModule.java:54)
	at com.github.jcustenborder.kafka.connect.utils.jackson.StructSerializationModule$Deserializer.deserialize(StructSerializationModule.java:122)
	at com.github.jcustenborder.kafka.connect.utils.jackson.StructSerializationModule$Deserializer.deserialize(StructSerializationModule.java:117)
	at com.fasterxml.jackson.databind.ObjectMapper._convert(ObjectMapper.java:3454)
	at com.fasterxml.jackson.databind.ObjectMapper.convertValue(ObjectMapper.java:3378)
	at com.github.jcustenborder.kafka.connect.utils.jackson.ValueHelper.value(ValueHelper.java:189)
	at com.github.jcustenborder.kafka.connect.utils.jackson.SourceRecordSerializationModule$Storage.value(SourceRecordSerializationModule.java:53)
	at com.github.jcustenborder.kafka.connect.utils.jackson.SourceRecordSerializationModule$Storage.build(SourceRecordSerializationModule.java:77)
	at com.github.jcustenborder.kafka.connect.utils.jackson.SourceRecordSerializationModule$Deserializer.deserialize(SourceRecordSerializationModule.java:108)
	at com.github.jcustenborder.kafka.connect.utils.jackson.SourceRecordSerializationModule$Deserializer.deserialize(SourceRecordSerializationModule.java:103)
	at com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:520)
	at com.fasterxml.jackson.databind.deser.impl.FieldProperty.deserializeAndSet(FieldProperty.java:101)
	at com.fasterxml.jackson.databind.deser.BeanDeserializer.vanillaDeserialize(BeanDeserializer.java:258)