mrcsparker / ruby_tika_app Goto Github PK

View Code? Open in Web Editor NEW

26.0 2.0 20.0 424.51 MB

A ruby wrapper for the Tika jar (tika-app.jar) that extracts text in a lot of formats from PDF, xls, doc, etc files

Home Page: https://github.com/mrcsparker/ruby_tika_app

License: MIT License

Ruby 5.07% DIGITAL Command Language 94.93%

ruby-tika ruby tika

ruby_tika_app's Introduction

Ruby Tika Parser

Introduction

This is a simple frontend to the Java Tika parser command line jar / app.

It is the same as running:

java -server -Djava.awt.headless=true -Dfile.encoding=UTF-8 -jar tika-app-1.24.1.jar FileToParse.pdf

with options like --xml, --text, etc.

Installation

To install, add ruby_tika_app to your Gemfile and run bundle install:

gem 'ruby_tika_app'

Note about installation

RubyTikaApp is a pretty big gem since it includes the ruby-tika-app jarfile. It might take a while to install.

Usage

First, you need Java installed. And it needs to be in your $PATH.

Then:

require 'ruby_tika_app'

rta = RubyTikaApp.new("sample_file.pdf")

puts rta.to_xml # <xml output>

# You also get to_json, to_text, to_text_main, and to_metadata

Testing

Run:

bundle exec rspec spec/

NOTE: Since we are using an underlying java library to connect to external URLs we can't use a standard mocking library. The test suite starts a rack-based web server.

Contributing

Fork on GitHub and after you've committed tested patches, send a pull request.

ruby_tika_app's People

Contributors

Stargazers

Watchers

Forkers

kieranhayes andrusha acuppy databasify ibazylchuk viglesias sandeep1299 pmanickavelu eperezks 23tux wingice pulibrary bluengreen mr-dxdy janklimo ferblape psu-libraries eliotjordan

ruby_tika_app's Issues

Allow custom config file paths

In our application we customize the Tika configuration, so it would be helpful be able to pass in a config file path.

Undefined method =~

NoMethodError: undefined method =~' for #<Pathname:0x0000000984b288> from /home/jasonp/.rvm/gems/ruby-2.1.1/gems/ruby_tika_app-1.5.0/lib/ruby_tika_app.rb:19:ininitialize'
from (irb):3:in new' from (irb):3 from /home/jasonp/.rvm/gems/ruby-2.1.1/gems/railties-3.2.22/lib/rails/commands/console.rb:47:instart'
from /home/jasonp/.rvm/gems/ruby-2.1.1/gems/railties-3.2.22/lib/rails/commands/console.rb:8:in start' from /home/jasonp/.rvm/gems/ruby-2.1.1/gems/railties-3.2.22/lib/rails/commands.rb:41:in<top (required)>'
from script/rails:6:in require' from script/rails:6:in

Option #encoding

Hi, @mrcsparker!

How add encoding=utf-8 to tika app?

I need to run tika-app-1.19.1.jar as:

final_cmd = "#{@tika_cmd} #{option} --encoding=UTF-8 '#{@document}'"

RubyTikaApp::CommandFailedError: execution failed with status INFO OpenType Layout tables used in font ArialMT are not implemented in PDFBox and will be ignored:

error rta.to_metadata
error rta.to_text

error with some pdf files
ruby_tika_app (1.8.0):
require 'ruby_tika_app'
rta=RubyTikaApp.new("pdffile.pdf")
puts rta.to_metadata
RubyTikaApp::CommandFailedError: execution failed with status INFO OpenType Layout tables used in font ArialMT are not implemented in PDFBox and will be ignored: java -server -Djava.awt.headless=true -jar '/home/tika/.rbenv/versions/2.2.1/lib/ruby/gems/2.2.0/gems/ruby_tika_app-1.8.0/lib/../ext/tika-app-1.19.1.jar' --config='/home/tika/.rbenv/versions/2.2.1/lib/ruby/gems/2.2.0/gems/ruby_tika_app-1.8.0/lib/../ext/tika-config.xml' --text 'file:///home/tika/pdffile.pdf'

puts rta.to_text
RubyTikaApp::CommandFailedError: execution failed with status INFO OpenType Layout tables used in font ArialMT are not implemented in PDFBox and will be ignored: java -server -Djava.awt.headless=true -jar '/home/tika/.rbenv/versions/2.2.1/lib/ruby/gems/2.2.0/gems/ruby_tika_app-1.8.0/lib/../ext/tika-app-1.19.1.jar' --config='/home/tika/.rbenv/versions/2.2.1/lib/ruby/gems/2.2.0/gems/ruby_tika_app-1.8.0/lib/../ext/tika-config.xml' --text 'file:///home/tika/pdffile.pdf'