Comments (10)
I too have occasionally seen this inconsistency, but I haven't been able to
reproduce it reliably to debug. Can you tell me a little about your setup: Do
you have multiple nodes, are they fairly busy? When you get these results, is
there anything in web.log indicating that a node couldn't be reached?
Original comment by [email protected]
on 15 Jun 2012 at 1:30
- Changed state: Started
from enterprise-log-search-and-archive.
Everything is on one box. It is fairly decent too--a 1U server class system
with 8GB RAM and 2TB 15k RPM drives in a RAID 5. The OS is Oracle Unbreakable
Linux (RHEL, really). The install is minimal. I'll check the web log when I
have a chance at work.
Original comment by [email protected]
on 16 Jun 2012 at 3:14
from enterprise-log-search-and-archive.
Oh, and only maybe 100 eps right now. I have two destinations in
syslog-ng.conf, one for elsa and one for the file system. The file system is
ext4 and the database, etc are on a dedicated lvm volume. I'm using the Chrome
browser.
Original comment by [email protected]
on 16 Jun 2012 at 3:17
from enterprise-log-search-and-archive.
Another thing I have found that may be related: if I perform a search and get
results, then go back to that same tab and hit 'Submit Query' again, I
sometimes get a different number of results. For example, I had submitted a
query that returned four results, then three for a few times, then four again.
Original comment by [email protected]
on 24 Jun 2012 at 3:05
from enterprise-log-search-and-archive.
Thanks for the additional info. I agree that this is related, and I think
there are two issues. The first is a time format problem when using GMT on the
backend for datetime math (which is why report on "day" shows values for 19:00
hours). The second may be inconsistent results due to Sphinx swapping out
indexes during consolidation, or because it does not have enough RAM. To help
continue diagnosing this problem, can you tell me approximately how many logs
per second this instance is processing and how much RAM it has?
Original comment by [email protected]
on 24 Jun 2012 at 6:05
from enterprise-log-search-and-archive.
I have 16GB RAM and average maybe around 40 EPS right now, which has peaked at
times to about 200 EPS.
Original comment by [email protected]
on 24 Jun 2012 at 6:55
from enterprise-log-search-and-archive.
Ok, the relatively low events per second is probably the reason that you're
seeing inconsistencies. ELSA is designed for high-volume processing. The good
news is I'm almost done bug testing the new code which will handle low-volume
log rates much more gracefully, so this should be fixed in the new code when I
release it shortly.
Original comment by [email protected]
on 24 Jun 2012 at 7:03
from enterprise-log-search-and-archive.
I am anticipating 400-500 EPS when ELSA is rolled out to production, with
spikes up to 2000-3000. Is the new version a separate code base or is it simply
one which will scale from low EPS to high EPS gracefully?
Original comment by [email protected]
on 24 Jun 2012 at 7:11
from enterprise-log-search-and-archive.
The new version adds a standard feature to "downshift" into a realtime mode
whenever the events per second are below a certain threshold. I'm testing it
thoroughly because it will be the default mode. I have observed that it will
comfortably handle 1k events per second in realtime mode, so that should cover
your circumstances.
Original comment by [email protected]
on 24 Jun 2012 at 7:26
from enterprise-log-search-and-archive.
Fixed in rev 330. Unfortunately, it was a bug on the backend, so while the
code update is normal, to actually get the fix working, you need to blow away
the /usr/local/etc/sphinx.conf file on the logging nodes and then run "perl
elsa.pl -on" to regenerate the new sphinx.conf file. Then restart searchd.
New indexes will have the correct time values in the reports and charts (all
logs already have correct time values in the standard console listing).
Original comment by [email protected]
on 2 Jul 2012 at 8:52
- Changed state: Fixed
from enterprise-log-search-and-archive.
Related Issues (20)
- Internal Server Error [500] with Dashboard
- line "1node(s) with ... logs..." doesn't update and offline dahsboards HOT 1
- node update failure HOT 5
- Parsing is not successful on the web interface HOT 1
- Installer fails on FreeBSD - can provide a patch unless the project is inactive
- Unable to open elsa dash board from Apache HOT 3
- distribution packaging
- lumberjack support
- Question about UNIQUE KEY for "fields" table
- Log Size Limit Problem HOT 1
- Parser for BIND queries not classifying/parsing data from udp(); or log file (custom class and fields)
- The date of the "From" field is locked in a day and not advance. HOT 1
- Trouble installing ELSA correctly HOT 1
- Email Alerts not working - Send to connector opens about:blank window containing log data
- Unable to view stats HOT 1
- Results options after search not working
- Query Log not working
- has Transform is Broken
- Missing Archive. Index not buffering
- Include_data doesnt include data on email
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from enterprise-log-search-and-archive.