Comments (5)
All the OK Log ingest endpoints care about is receiving newline-delimited records. Correct me if I'm wrong, but syslog already meets this contract. If that's true, anything which emits syslog should already be fully compatible with OK Log.
from oklog.
So also Syslog supports structured logging via Json, your probably aware as your other framework does it https://github.com/go-kit/kit/blob/master/log/json_logger.go . I couldn't find anything about OKLog supporting structured logs?
from oklog.
OK Log treats log records as opaque byte-slices. The query interface is grep. You're free to send structured logs, unstructured logs, or anything you want into it, as long as each record is newline-delimited.
from oklog.
We had a rousing discussion on Twitter, from that I've updated the README with some details about querying structured logs, anything more than that is not on a concrete roadmap, though I'm curious about what log parsing "plugins" might look like at the query or storage layer...
from oklog.
From this code: https://gist.githubusercontent.com/marcelom/4218010/raw/53b643bd056d03ffc21abcfe2e1b9f6a7de005f0/pysyslog.py
#!/usr/bin/env python ## Tiny Syslog Server in Python. ## ## This is a tiny syslog server that is able to receive UDP based syslog ## entries on a specified port and save them to a file. ## That's it... it does nothing else... ## There are a few configuration parameters. HOST, PORT = "0.0.0.0", 514 import SocketServer import sys class SyslogUDPHandler(SocketServer.BaseRequestHandler): def handle(self): data = bytes.decode(self.request[0].strip()) socket = self.request[1] print( "%s : " % self.client_address[0], str(data)) sys.stdout.flush() if __name__ == "__main__": try: server = SocketServer.UDPServer((HOST,PORT), SyslogUDPHandler) server.serve_forever(poll_interval=0.5) except (IOError, SystemExit): raise except KeyboardInterrupt: print ("Crtl+C Pressed. Shutting down.")
Then run : python2 ./pysyslog.py | oklog forward localhost
from oklog.
Related Issues (20)
- Panic: short record HOT 2
- Move to length-delimited records HOT 8
- Add first-class concept of topics HOT 11
- Extend record identifier HOT 9
- Long-term storage
- Docker repo doesn't contain recent releases HOT 4
- network HOT 3
- forwarder mangles bare percent signs HOT 2
- Integration with Fluentd HOT 1
- bufio.Scanner: token too long HOT 1
- Log records can be stored in wrong order HOT 8
- Implement optional text indexing for faster queries
- Implement token based access control
- Compacter writes too much data to disk HOT 1
- Proposal: Create ULID from timestamp contained in record HOT 1
- Local node unable to connect to self after netowrk change
- Unable to "make install" using the tar.gz package and no oklog command found HOT 2
- What's the best way to test the cluster in large installation is working
- How oklog stores data?
- Web UI Improvements
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from oklog.