pranab / hoidla Goto Github PK

Although we ask git to ignore the /target directory through .gitignore, but we still have target/*.jar file checked-in. It results into two issues-

1. It always results in a conflict when you pull latest changes and only way to resolve is to discard your file.
2. When you add your changes, you always have to force git to add the file because .gitignore says not to add that. This can be avoided by not checking-in the changes to the JAR file but then you always end up with old JAR file in the repository.

Its better to remove *.jar file from source because it can anyways be built using maven. If you want to package JAR as release, better to use GitHub releases for the same.

We are using the sketches implementation. If we start it from scratch, it works well and gets the first 'k' configured trending keywords. After, that it is always stuck with those and the trends do not change. Here is my configuration file-

# Common Properties
debug.on=false

# Topology Properties
spout.threads=1
sketches.bolt.threads=2
aggr.bolt.threads=1
num.workers=1
max.spout.pending=1000
max.task.parallelism=100

# RabbitMQ Spout
epoch.event=100

# Trending Sketches Bolt
id.fld=_FCID
tick.freq.sec=10
sketches.error.lim=0.05
sketches.error.prob.limit=0.02
sketches.most.freq.count=10
sketches.freq.count.lim.percent=10
sketches.expiry.policy=epoch
sketches.max.epoch=2
sketches.epoch.size=60