Comments (4)
You can add your package under name. e.g:
transforms.SetSchemaName.schema.name=com.mysolution.MyClassName
from kafka-streams-examples.
@JanardhanVarikuti I was able to get the streams app working initially when reading from a single topic by just changing the avro schema file to have those default values: "name": "ConnectDefault"
with "namespace": "io.confluent.connect.avro"
. So my generated class was just called ConnectDefault.java
In order to have multiple streams in the same application, you can use the Kafka SMT (Single Message Transforms) SetSchemaMetadata in each source connector config to set the schema names.
transforms=SetSchemaName
transforms.SetSchemaName.type=org.apache.kafka.connect.transforms.SetSchemaMetadata$Value
transforms.SetSchemaName.schema.name=MyClassName
This way you can use "name": "MyClassName"
in the avro schema file. But since you cannot specify the namespace with SMT, you will need to put your streams app in the default package and omit the namespace in the avro schema files for your generated sources.
from kafka-streams-examples.
Guys, thank you. I love it when I found someone struggling for exactly the same thing.
I combined your examples @dekelmos and @jessicashin:
transforms=SetSchemaName
transforms.SetSchemaName.type=org.apache.kafka.connect.transforms.SetSchemaMetadata$Value
transforms.SetSchemaName.schema.name=com.mysolution.MyClassName
Thank you.
from kafka-streams-examples.
Hi @jessicashin , Is the above issue is resolved? If yes, could you please provide the solution?
from kafka-streams-examples.
Related Issues (20)
- how to Packaging and running the Application Examples HOT 1
- GlobalKTablesAndStoresExampleDriver hangs with GlobalKTablesExample HOT 5
- How to create Kafka Server with org.apache.kafka:kafka_2.13:test:2.7.1 HOT 1
- Naming when adding global store HOT 4
- Do we have example on Kafka Stream Processor API to handle Smart routing case HOT 1
- ditch awaits in docker compose file
- Gitpodify so people can easily run the examples with 0 setup
- Do we have example to handle processor exception.
- Join operation is not working after update to 1.2.0 HOT 1
- Is The class of DeserializationExceptionHandler support construct with parameters HOT 1
- Consistency between inventory KTable/Topic and state store "reservedStock" for "shipped" event HOT 1
- Regarding Sum example HOT 1
- Can't find the package io.confluent.examples.streams.avro in src folder HOT 1
- How to suppress window using wall clock time instead of event time in Kafka streams? HOT 1
- Can't load library when running AnomalyDetectionLambdaExample HOT 2
- Case: 100+ KafkaStreams threads on 3.5k+ topics/partitions with exactly_once_v2 guarantee HOT 8
- Event driven order
- Kafka Streams ERROR Could not parse Avro schema
- Got warnings on running WordCount Application command from Kafka Docs
- Got Warnings in running WordCount application command
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafka-streams-examples.