Comments (5)
@surajnayak, In order to search or view anything, you first need to go through the process of setting it up (described in the readme). Once you have data from your hadoop cluster indexed, you should be able to search and profile jobs.
You can read more about it here: http://techblog.netflix.com/2014/09/inviso-visualizing-hadoop-performance.html
from inviso.
@danielcweeks, I tried following the documentation, but got below error :
$ python jes.py
INFO:inviso-monitor:Publishing event: (cluster_1_dev) job_1458228381455_0111 2016-03-17T18:24:31+00:00
INFO:inviso-handler:Processing 1 events
ERROR:snakebite.client:RpcBufferedReader only managed to read 0 out of 4 bytes
ERROR:snakebite.client:RpcBufferedReader only managed to read 0 out of 4 bytes
ERROR:snakebite.client:RpcBufferedReader only managed to read 0 out of 4 bytes
ERROR:inviso-handler:Failure to read block 1131916133
Traceback (most recent call last):
File "/apps/inviso/jes/inviso/handler.py", line 135, in process_event
self._process_config(doc, event)
File "/apps/inviso/jes/inviso/handler.py", line 180, in _process_config
content = self.fetch_content(event['config.uri'])
File "/apps/inviso/jes/inviso/handler.py", line 168, in fetch_content
for line in c.text([p.path]):
File "/apps/venv/base/lib/python2.6/site-packages/snakebite/client.py", line 853, in text
include_children=False, recurse=False):
File "/apps/venv/base/lib/python2.6/site-packages/snakebite/client.py", line 1083, in _find_items
entry = processor(full_path, fileinfo.fs)
File "/apps/venv/base/lib/python2.6/site-packages/snakebite/client.py", line 851, in <lambda>
processor = lambda path, node, check_crc=check_crc: self._handle_text(path, node, check_crc)
File "/apps/venv/base/lib/python2.6/site-packages/snakebite/client.py", line 862, in _handle_text
for load in self._read_file(path, node, False, check_crc):
File "/apps/venv/base/lib/python2.6/site-packages/snakebite/client.py", line 1033, in _read_file
raise Exception("Failure to read block %s" % block.b.blockId)
Exception: Failure to read block 1131916133
INFO:inviso-handler:Indexing 0 documents
INFO:inviso-handler:Events complete.
INFO:inviso-monitor:Publishing event: (cluster_1_dev) job_1458228381455_0124 2016-03-17T18:23:51+00:00
INFO:inviso-handler:Processing 1 events
ERROR:snakebite.client:RpcBufferedReader only managed to read 0 out of 4 bytes
ERROR:snakebite.client:RpcBufferedReader only managed to read 0 out of 4 bytes
ERROR:snakebite.client:RpcBufferedReader only managed to read 0 out of 4 bytes
ERROR:inviso-handler:Failure to read block 1131915997
Traceback (most recent call last):
from inviso.
Genie is not required for this to work. It appears that you're having
trouble getting access to hdfs to read the history files.
What version of hadoop are you using? You might want to take a look at the
closed issues as well because others may have hit this same thing.
On Mar 19, 2016 1:08 AM, "Suraj Nayak" [email protected] wrote:
Is Genie required for elasticsearch to work ?
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
#11 (comment)
from inviso.
Applying this patch should work spotify/snakebite@68db2f2
from inviso.
Thank you so much @othman-essabir. The patch worked!
from inviso.
Related Issues (13)
- Error Walking through the README quick start HOT 3
- Can't run inviso with elastic search 2.3.2 HOT 2
- Document project roadmap and contribution stance HOT 3
- too many data points HOT 1
- How does this work with the docker container? HOT 1
- Error with index_cluster_stats.py HOT 22
- does inviso require genie and aws? HOT 1
- Missing jobs' information HOT 1
- "Open Logs" doesnt work with dfs.nameservices name HOT 5
- Cluster charts doesn't work HOT 4
- cannot compile with 2.6.0 HOT 2
- Cluster not listed at tab #cluster HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from inviso.