runeo / luke Goto Github PK

What steps will reproduce the problem?
1. open index containing numeric-long fields
2. try to enter a range query for a numeric-long field

What is the expected output? What do you see instead?
I expect that I somehow can enter numeric-long values but all tries fail.
I also tried to use org.apache.lucene.util.NumericUtils with no success.

What version of the product are you using? On what operating system?
Luke v1.0.1 
Windows Vista
Lucene 3.0.1


Please provide any additional information below.

you heard me

What version of the product are you using? On what operating system?
3.1.0

Please provide any additional information below.

Currently a constructor accepting a File is needed for a custom directory.
It would be nice to use a more generic approach, like a provider or factory 
interface.
Inspiration can be found in the hibernate search directory provider.
http://docs.jboss.org/hibernate/search/3.3/api/org/hibernate/search/store/Direct
oryProvider.html

For example something like

public interface DirectoryProvider {
    public void start();
    public void stop();
    public Directory getDirectory();
}

What steps will reproduce the problem?

1. check out the latest Lucene/Solr branch_3x
$ svn co http://svn.apache.org/repos/asf/lucene/dev/branches/branch_3x

2. Launch Luke from Solr Ant
$ cd branch_3x/solr
$ ant luke

3. Clicking [browse...] button generates the error:
     [java] java.lang.OutOfMemoryError: PermGen space
     [java]     at javax.swing.plaf.basic.BasicComboBoxUI.getHandler(BasicComboBoxUI.java:514)
     [java]     at javax.swing.plaf.basic.BasicComboBoxUI.createPropertyChangeListener(BasicComboBoxUI.java:472)
     [java]     at javax.swing.plaf.basic.BasicComboBoxUI.installListeners(BasicComboBoxUI.java:336)
     [java]     at com.apple.laf.AquaComboBoxUI.installListeners(AquaComboBoxUI.java:51)
     [java]     at javax.swing.plaf.basic.BasicComboBoxUI.installUI(BasicComboBoxUI.java:249)
     [java]     at com.apple.laf.AquaComboBoxUI.installUI(AquaComboBoxUI.java:35)
     [java]     at javax.swing.JComponent.setUI(JComponent.java:662)
     [java]     at javax.swing.JComboBox.setUI(JComboBox.java:236)
     [java]     at javax.swing.JComboBox.updateUI(JComboBox.java:245)
     [java]     at javax.swing.JComboBox.init(JComboBox.java:210)
     [java]     at javax.swing.JComboBox.<init>(JComboBox.java:204)
     [java]     at com.apple.laf.AquaFileChooserUI.installComponents(AquaFileChooserUI.java:1455)
     [java]     at com.apple.laf.AquaFileChooserUI.installUI(AquaFileChooserUI.java:121)
     [java]     at javax.swing.JComponent.setUI(JComponent.java:662)
     [java]     at javax.swing.JFileChooser.updateUI(JFileChooser.java:1798)
     [java]     at javax.swing.JFileChooser.setup(JFileChooser.java:360)
     [java]     at javax.swing.JFileChooser.<init>(JFileChooser.java:333)
     [java]     at javax.swing.JFileChooser.<init>(JFileChooser.java:286)
     [java]     at org.getopt.luke.Luke.openBrowse(Unknown Source)
     [java]     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     [java]     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
     [java]     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
     [java]     at java.lang.reflect.Method.invoke(Method.java:597)
     [java]     at thinlet.Thinlet.invokeImpl(Unknown Source)
     [java]     at thinlet.Thinlet.invoke(Unknown Source)
     [java]     at thinlet.Thinlet.handleMouseEvent(Unknown Source)
     [java]     at thinlet.Thinlet.processEvent(Unknown Source)
     [java]     at java.awt.Component.dispatchEventImpl(Component.java:4714)
     [java]     at java.awt.Container.dispatchEventImpl(Container.java:2143)
     [java]     at java.awt.Component.dispatchEvent(Component.java:4544)
     [java]     at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4618)
     [java]     at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)


What is the expected output? What do you see instead?


What version of the product are you using? On what operating system?


Please provide any additional information below.

What steps will reproduce the problem?
1. load an index
2. select in the search tab StopAnalyzer, don't provide  a constructor
argument and put any query in the search expression field
3. press search and you get  an error saying "Analyzer
'org.apache.lucene.analysis.StopAnalyzer' error: Must have a zero-arg or
(String) constructor. Using StandardAnalyzer." When i then click OK the
dialog box appears again and again (and again ...). 

What steps will reproduce the problem?
1. create lucene doc with an apostrophe ( ' ) in the data of a TermVector'd 
field (e.g.  "HTML4 doesn't like this &this too")
2. export to XML
      IndexReader reader    = IndexReader.open(fsDir, false);
      XMLExporter exporter = new XMLExporter(reader, indexPath);
      File xmlout = new File(tmpfile);
      OutputStream os = new FileOutputStream(xmlout);
      Ranges ranges = new Ranges();
      int start = docid;
      int end   = start + 1;
      ranges.set(start, end);
      exporter.export(os, false, true, "index", ranges);
3. open with an HTML4 strict spec XML browser  (try IE)

What is the expected output? What do you see instead?
should open and display as parsed XML.  instead, gives an error of invalid XML

What version of the product are you using? On what operating system?
luke 1.0.1 on windows 7.

Please provide any additional information below.
Andrzej fixed the majority of this problem in Luke 0.9.9 (when inside field 
data), but there is still a small fix remaining in org.getopt.luke.XMLExporter, 
to not escape element attribute values (patch attached). 

This patch also provides a minor correction to Util.xmlEscape()

The ' isn't a valid part of the HTML4 strict spec.  So, the xml escapes 
should generate output which is valid and can be rendered with any XML 
interpreter.  Some of the browser-based XML viewers choke on the ' when it 
is inside of element attributes.  ' will take care of it

It seemed that Luke didnt support pasting, but the problem is that you
paste using Cntl-V , but it should be Cmd-V on a Mac.

1. go to Search tab ->Similairty tab
2. Select Current custom similarity
3. Design... -> Load samples -> DefaulSimilarity.js ->Compile
4. Search Tab -> Search

What is the expected output? What do you see instead?

I see ERROR: searching: java.lang.ClassCastException: java.lang.Double can not 
be cast to 
org.apache.lucene.search.Explanation$IDFExplanation

What version of the product are you using? On what operating system?
running luke-1.0.1.jar compiled from source using svn revision 27.
Running on Mac, snow leopard

Please provide any additional information below.

RHINO USAGE WARNING: Missed Context.javaToJS() conversion:
Rhino runtime detected object org.apache.lucene.search.IndexSearcher@75f0f8ff 
of class 
org.apache.lucene.search.IndexSearcher where it expected String, Number, 
Boolean or Scriptable 
instance. Please check your code for missig Context.javaToJS() call.
RHINO USAGE WARNING: Missed Context.javaToJS() conversion:
Rhino runtime detected object contents:test of class 
org.apache.lucene.index.Term where it 
expected String, Number, Boolean or Scriptable instance. Please check your code 
for missig 
Context.javaToJS() call.
java.lang.ClassCastException: java.lang.Double cannot be cast to 
org.apache.lucene.search.Explanation$IDFExplanation
    at org.getopt.luke.plugins.CustomSimilarity.idfExplain(Unknown Source)
    at org.apache.lucene.search.TermQuery$TermWeight.<init>(TermQuery.java:46)
    at org.apache.lucene.search.TermQuery.createWeight(TermQuery.java:171)
    at org.apache.lucene.search.Query.weight(Query.java:101)
    at org.apache.lucene.search.Searcher.createWeight(Searcher.java:147)
    at org.apache.lucene.search.Searcher.search(Searcher.java:67)
    at org.getopt.luke.Luke$22.execute(Unknown Source)
    at org.getopt.luke.Luke._search(Unknown Source)
    at org.getopt.luke.Luke.search(Unknown Source)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at thinlet.Thinlet.invokeImpl(Unknown Source)
    at thinlet.Thinlet.invoke(Unknown Source)
    at thinlet.Thinlet.handleMouseEvent(Unknown Source)
    at thinlet.Thinlet.processEvent(Unknown Source)
    at java.awt.Component.dispatchEventImpl(Component.java:4714)
    at java.awt.Container.dispatchEventImpl(Container.java:2143)
    at java.awt.Component.dispatchEvent(Component.java:4544)
    at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4618)
    at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)
    at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4212)
    at java.awt.Container.dispatchEventImpl(Container.java:2129)
    at java.awt.Window.dispatchEventImpl(Window.java:2475)
    at java.awt.Component.dispatchEvent(Component.java:4544)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:635)
    at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296)
    at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:201)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:196)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:188)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)

What steps will reproduce the problem?
1. Search within Luke for a word within your index
2. Show the document, where you got a hit (tab 'Documents')
3. Klick 'Show Poritions' button, to show, what ist the term position within 
the document (here Luke shows the right term position)
4. Close the 'Term Positions' window and klick again the 'Show Positions' 
button - the position has increase. If you do it often, the positions values 
still increases  with each request.

What is the expected output? What do you see instead?
Always the same, correct term positions values.

What version of the product are you using? On what operating system?
lukeall-1.0.1.jar on Windows XP

Please provide any additional information below.
When I choose the 'First Doc' and after that show the positions with 'Show 
Positions' button, the position number is correct. But the second try gives an 
incorrect (incremented) prosition number.

There is no decoder for terms in 32 bit NumericField encoding.

There is one problem with the same decoder for term values and stored 
fields: Stored numeric fields are not encoded and are plain text ASCII 
numbers (<T extends Number> T.toString()). Only the term values are in a 
special encoding (NumericUtils). So for stored fields and for terms it 
should be possible to set different decoders.

On Apachecon i promised you to send you an index with example numeric 
values. I will do this after the xmas holidays, if you still need one. 
Generating an own one is simple with the example code form the 
NumericField Javadocs.

What steps will reproduce the problem?
1. java -jar lukeall-1.0.1.jar


What is the expected output? 
luke gui

What do you see instead?
>java -jar lukeall-1.0.1.jar
Exception in thread "main" java.lang.UnsatisfiedLinkError: 
sun.font.FontManager.initIDs()V
        at sun.font.FontManager.initIDs(Native Method)
        at sun.font.FontManager.access$000(Unknown Source)
        at sun.font.FontManager$1.run(Unknown Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.font.FontManager.<clinit>(Unknown Source)
        at java.awt.Component.getFontMetrics(Unknown Source)
        at thinlet.Thinlet.setFont(Unknown Source)
        at thinlet.Thinlet.<init>(Unknown Source)
        at org.getopt.luke.Luke.<init>(Unknown Source)
        at org.getopt.luke.Luke.startLuke(Unknown Source)
        at org.getopt.luke.Luke.main(Unknown Source)

What version of the product are you using? On what operating system?
- lukeall-1.0.1.jar
- Windows XP
- >java -version
java version "1.6.0_11"
Java(TM) SE Runtime Environment (build 1.6.0_11-b03)
Java HotSpot(TM) Client VM (build 14.2-b01, mixed mode)
jdk1.6.0_21

Attached is a patch which allows custom XMLQueryParser configurations to be
loaded.
A new command-line Luke parameter can pass in the class name of a factory
class used for creating XMLQueryParsers.

What steps will reproduce the problem?
1. Open an existing index for write (creating a write.lock)
2. Open lukeall-1.0.1 and try to open index in read-only mode
3. Error message says must open as read/write and force unlock

What is the expected output? What do you see instead?
I should be able to open the index in read only mode without having to open
read/write and force unlock

What version of the product are you using? On what operating system?
lukeall-1.0.1.jar on linux (Centos 5)

Please provide any additional information below.
This would be a nice enhancement which is supported by Lucene 3.0

What steps will reproduce the problem?
==>Open index files which built before with luke-0.9.9.1.jar


What is the expected output? What do you see instead?
==>Exception: String index out of range: -1000746248
==>It should be open normally, and can be opened by luke-0.8.1.jar

What version of the product are you using? On what operating system?
==>Lucene.Net 2.3.2.1

See the following reference:
http://download.oracle.com/javase/tutorial/deployment/jar/appman.html

This would allow the app to be started by simply double-clicking the jar 
(presuming the relevant file association is set up).

I have a background task writing to an index and periodically committing. I 
wanted to use Luke to open the index to examine the index contents and selected 
the "open read only" option.
However I get an error message "Index is locked and Read-Only. Open for 
read-write and 'Force unlock'". Forcing an unlock seems unnecessary (and 
inadvisable!) given that I can open the same index as follows without a problem:
    public static void main(String[] args) throws Exception
    {
        FSDirectory dir = FSDirectory.open(new File("c:/indexes/myIndex"));
        IndexReader r = IndexReader.open(dir, true);
        System.out.println(r.numDocs());
        r.close();
    }

Is this a Luke bug or a (new?) limitation of how the app is put together?


Windows 64bit, Luke v3.4.0(2011-10-03).

Cheers,
Mark

Just waiting for the new release which is compatible with new version of
lucene.
Great tool.

What steps will reproduce the problem?
1. Start Luke, specify index
2. File ->Open Lucene Index, specify another index
3. Error box with no message

What is the expected output? What do you see instead?
Should have message, from command line you get this exception, looks like you 
need to close the old index if one is open...:

java.nio.channels.ClosedChannelException
        at sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:88)
        at sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:603)
        at org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.readInternal(NIOFSDirectory.java:157)
        at org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:160)
        at org.apache.lucene.store.BufferedIndexInput.readBytes(BufferedIndexInput.java:119)
        at org.apache.lucene.store.BufferedIndexInput.readBytes(BufferedIndexInput.java:94)
        at org.apache.lucene.index.TermBuffer.read(TermBuffer.java:82)
        at org.apache.lucene.index.SegmentTermEnum.next(SegmentTermEnum.java:131)
        at org.apache.lucene.index.SegmentMergeInfo.next(SegmentMergeInfo.java:69)
        at org.apache.lucene.index.DirectoryReader$MultiTermEnum.next(DirectoryReader.java:1019)
        at org.getopt.luke.HighFreqTerms.getHighFreqTerms(Unknown Source)
        at org.getopt.luke.Luke$5.execute(Unknown Source)
        at org.getopt.luke.Luke.actionTopTerms(Unknown Source)
        at org.getopt.luke.Luke$4.run(Unknown Source)


What version of the product are you using? On what operating system?
  lukeall-1.0.1.jar, Mac OSX

Please provide any additional information below.

What steps will reproduce the problem?
1.Download lucene and follow directions for running demo
2.Download luke 3.3.0 and run in same directory as lucene
3.Open file and take default

What is the expected output? What do you see instead?
Should open the index, but give error message Unrecognized Format -3

What version of the product are you using? On what operating system?
Luke 3.3.0 on Windows 7 with Lucene 3.4

Please provide any additional information below.
I indexed a bunch of basic source files, not the lucene source

Lucene 3.1 got released a couple of days ago. It would be great to have Luke 
compatible with the same. 

What steps will reproduce the problem?
1. Create an index using Lucene 3.1 . 
2. Open it with Luke. 


What is the expected output? What do you see instead?

TermEnum-s and list are expected to be seen. 
Instead, we get an error - 
"Unknown Format:  -11"


What version of the product are you using? On what operating system?

Luke 1.0.1 on Ubuntu 10.04 64-bit . 


Please provide any additional information below.

Luke 1.0.0
OSX 10.6.2

I started Luke as follows:
 java -classpath
/Users/paul/code/MusicbrainzSearchServer/branches/ngs/index/target/index-2.0-SNA
PSHOT-jar-with-dependencies.jar
-jar lukeall-1.0.0.jar

specifying a jar containing my analyzer in the classpath

I then specified the analyzer on the Analysis Tab and did a search. The
search worked and brought back some results but then it complained it
couldn't find the analyzer (the analyzer does have a zero argument constructor)

and I had the following stacktrace at the command line:
java.lang.ClassNotFoundException:
org.musicbrainz.search.analysis.StandardUnaccentAnalyzer
    at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:315)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:330)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:250)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:398)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:169)
    at org.getopt.luke.Luke.createAnalyzer(Unknown Source)
    at org.getopt.luke.Luke.createQueryParser(Unknown Source)
    at org.getopt.luke.Luke.search(Unknown Source)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at thinlet.Thinlet.invokeImpl(Unknown Source)
    at thinlet.Thinlet.invoke(Unknown Source)
    at thinlet.Thinlet.handleMouseEvent(Unknown Source)
    at thinlet.Thinlet.processEvent(Unknown Source)
    at java.awt.Component.dispatchEventImpl(Component.java:4714)
    at java.awt.Container.dispatchEventImpl(Container.java:2143)
    at java.awt.Component.dispatchEvent(Component.java:4544)
    at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4618)
    at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)
    at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4212)
    at java.awt.Container.dispatchEventImpl(Container.java:2129)
    at java.awt.Window.dispatchEventImpl(Window.java:2475)
    at java.awt.Component.dispatchEvent(Component.java:4544)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:635)
    at
java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296
)
    at
java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211)
    at
java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:201
)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:196)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:188)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)

What steps will reproduce the problem?
1.Use a 70 gig index
2.try to open in luke
3.luke either fails or says the index is invalid

(index created using lucene.net 2.9.2.2 and was openable at about 5 ~ 10 
gigs before filling the index up)

What is the expected output? What do you see instead?
Index to load, Index wouldn't load

What version of the product are you using? On what operating system?
0.9.9.1 & 1.0.1

Please provide any additional information below.

What steps will reproduce the problem?
1. Download luke tar ball
2. Extract - e.g. tar xvfz luke-src-1.0.1.tgz
3.

What is the expected output? What do you see instead?

- Expect: to have the content extracted to a luke-src-1.0.1 dir
- Actual: contents of the tarball are extracted with no sub-dir, this is messy


What version of the product are you using? On what operating system?

1.0.1

Please provide any additional information below.

Thanks.

Request 1: 
Is there a plan to support meaningful display of Trie (binary-based) data 
types?  

In the index, they look like this (--S----O-B). At index time, the fields are 
Indexed and not Analyzed, but Lucene does not set those flags on the fields.  
I'm just getting into binary data fields, so not sure if this is common 
knowledge or not.

I am currently building these using Solr classes, and they do display the hex 
values, but would like to be able to see the decimal values.  If I attempt to 
Show Content As Number, I get the error (Some values could not be properly 
represented in this format. They are marked in grey and presented as a hex 
dump).  [e.g. 00 00 01 14 a3 e8 d9 c0]

Request 2: 
Also, for fields of type TrieDateField, it would be great to have the datetime 
rendered as yyyy-mm-ddThh:ii:ssZ  [e.g. 2007-08-26T20:42:00Z]


Request 3: 
And for Sortable (also from Solr ... null-padded strings) fields, is there a 
way to render (String -> Hex -> Dec)?
[e.g. ���縀  ->  08 00 00 00 e7 b8 80  ->  15186048]

Thanks!

We are troubleshooting performance issues related to wildcard queries 
running against the ComplexPhraseQueryParser (introduced in Lucene 3.0). 
Some wildcard queries like "quality operations providing quality food 
services job requirements: click here to apply for this job*" require a 
maxClauseCount > 40K to match against the DBSight implementation that 
we're using (and run longer than 2 seconds too).

We'd like to understand what the 40K clauses are as we don't think we have 
nearly that many unique words that have job* as a prefix. 

Can Luke support the ComplexPhraseQueryParser or otherwise show the fully 
enumerated query for wildcard searches? 

Actually, there are a ton of left-over references to getFields() and a few 
casts to Field. Need to replace with getFieldables(); e.g. export doesn't work 
with numeric fields.

See added details for issue #40.

*What steps will reproduce the problem?*
Index a document and for a Field set this options
 new Field("myFieldName", "fieldcontent" Store.NO, Index.ANALYZED, Field.TermVector.YES

*What is the expected output? What do you see instead?*
TermVectors are stored into the indes, but Luke can't show them in the "Browse 
By Document" tab, only stored fields seems to be displayed.

*What version of the product are you using? On what operating system?*
LukeAll-1.0.1.jar, Windows7, using latest Java JRE

> What steps will reproduce the problem?
1. Start luke with the following command:
java -cp $CLASSPATH org.getopt.luke.Luke -index /path/to/index -ro -script 
testfile.js
2. testfile.js contains the following line:
print(ir.numDocs());

> What is the expected output? What do you see instead?
More like "desired" rather than "expected" output. If I specify a script file 
on the command line, my expectation is that the output should be shown on the 
command line and luke would exit after it ran my script.

Instead I see that output of the script show up on the Luke scripting plugin 
console, and I have to manually shut Luke down.

> What version of the product are you using? On what operating system?
Luke version: 1.0.1 with Lucene 3.0.1 on Mac OS X (10.6)

> Please provide any additional information below.

I tried hacking the code a bit to replace TAWriter in ScriptingPlugin:48 with 
PrintWriter taw = new PrintWriter(System.out) and some other things - this does 
display the result to console, but Luke does not exit.

If I try to forcibly exit by adding this line to my testfile.js:
app.actionExit();
then I get a stack trace that points to some background threads being forcibly 
killed, and no result. If I enter the above command in the ScriptingPlugin 
console, then Luke exits cleanly without complaints.

Questions:
1) Is my expectation, ie, if I specify -script on the command line, then the 
command should dump out the result of my script and exit, make sense? More 
importantly, would this feature be considered (so I will wait for it instead of 
trying to build my own). Of course, if no -script is provided, then the user 
can still load external scripts using load("/full/path/to/script"); in the 
console and execute them.
2) Is there a way (perhaps a different call) that would execute the script, 
then wait for the background threads to complete before closing all the handles?
3) In case support for this is not planned, would the correct approach be to 
build a separate plugin for this functionality (BatchScriptingPlugin say) which 
would be triggered by a different command line parameter? Or would it be better 
to provide a different main class (LukeCli say) which would call the internal 
methods and also provide a Javascript context like ScriptingPlugin? From my 
initial explorations into the Luke code, the last approach appears to not be 
very feasible, since the code seems to be very tightly coupled with the GUI 
framework.

My motivation is to use Luke's ScriptingPlugin to debug remote production 
indexes.

TIA for your answers, and thanks for a great tool.

Sujit

What steps will reproduce the problem?
1. java -cp lukeall-3.4.0.jar


What is the expected output? What do you see instead?

java.lang.NumberFormatException: For input string: "60  "
    at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
    at java.lang.Integer.parseInt(Integer.java:458)
    at java.lang.Integer.valueOf(Integer.java:554)
    at thinlet.Thinlet.addAttribute(Unknown Source)
    at thinlet.Thinlet.parse(Unknown Source)
    at thinlet.Thinlet.parse(Unknown Source)
    at thinlet.Thinlet.parse(Unknown Source)
    at thinlet.Thinlet.parse(Unknown Source)
    at org.getopt.luke.Luke.addComponent(Unknown Source)
    at org.getopt.luke.Luke.<init>(Unknown Source)
    at org.getopt.luke.Luke.startLuke(Unknown Source)
    at org.getopt.luke.Luke.main(Unknown Source)
Exception in thread "main" java.lang.IllegalArgumentException: unknown text 
string for null
    at thinlet.Thinlet.getDefinition(Unknown Source)
    at thinlet.Thinlet.setString(Unknown Source)
    at org.getopt.luke.Luke.errorMsg(Unknown Source)
    at org.getopt.luke.Luke.addComponent(Unknown Source)
    at org.getopt.luke.Luke.<init>(Unknown Source)
    at org.getopt.luke.Luke.startLuke(Unknown Source)
    at org.getopt.luke.Luke.main(Unknown Source)



What version of the product are you using? On what operating system?


Please provide any additional information below.

Kevin:Downloads majlo$ uname -v
Darwin Kernel Version 11.1.0: Tue Jul 26 16:07:11 PDT 2011; 
root:xnu-1699.22.81~1/RELEASE_X86_64

Kevin:Downloads majlo$ java -version
java version "1.6.0_26"
Java(TM) SE Runtime Environment (build 1.6.0_26-b03-383-11A511)
Java HotSpot(TM) 64-Bit Server VM (build 20.1-b02-383, mixed mode)

Kevin:Downloads majlo$ java -jar lukeall-3.4.0.jar 
java.lang.NumberFormatException: For input string: "60  "
    at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
    at java.lang.Integer.parseInt(Integer.java:458)
    at java.lang.Integer.valueOf(Integer.java:554)
    at thinlet.Thinlet.addAttribute(Unknown Source)
    at thinlet.Thinlet.parse(Unknown Source)
    at thinlet.Thinlet.parse(Unknown Source)
    at thinlet.Thinlet.parse(Unknown Source)
    at thinlet.Thinlet.parse(Unknown Source)
    at org.getopt.luke.Luke.addComponent(Unknown Source)
    at org.getopt.luke.Luke.<init>(Unknown Source)
    at org.getopt.luke.Luke.startLuke(Unknown Source)
    at org.getopt.luke.Luke.main(Unknown Source)
Exception in thread "main" java.lang.IllegalArgumentException: unknown text 
string for null
    at thinlet.Thinlet.getDefinition(Unknown Source)
    at thinlet.Thinlet.setString(Unknown Source)
    at org.getopt.luke.Luke.errorMsg(Unknown Source)
    at org.getopt.luke.Luke.addComponent(Unknown Source)
    at org.getopt.luke.Luke.<init>(Unknown Source)
    at org.getopt.luke.Luke.startLuke(Unknown Source)
    at org.getopt.luke.Luke.main(Unknown Source)

If you're trying to select all documents without a certain field like so

+(+*:* -myfield.id:[* TO *])

all documents will be returned when it should return all without myfield.id

If Luke is unable to open the analyzer you specify it just displays error
message in an endless loop instead of giving you the chance to enter
another analyzer.

In Luke 1.0.0, the anylzer plugin currently only works with 
KeywordAnalyzer and SimpleAnalyzer, because all analyzers in Lucene 
Contrib and Core now require an one-arg ctor, that takes 
o.a.l.util.Version. In the configuration an option to set the argument 
value should be provided. As Version is an enum in Lucene 3.0, it should 
be easy to fill an drop down list with Version.values().

The correct ctor for dynmaically loading analyzers should first check for 
an Version ctor and fall back to empty ctor.

Also the width of the term display on the left side in the analyzer plugin 
in zero.

Also the search tab has the same problem, you can specify an arg but it 
then crashes with "analyzer must have zero-arg or (String) constructor. 
Using StandardAnalyzer". But this loops endless, because StandardAnalyzer 
also has no zero-arg ctor.

Zipf and Vocabulary growth plugins don't give some of important constants. I 
think needs to be improved :(

What steps will reproduce the problem?
1. Create a schema with some very, very long field names (30+ characters)
2. Index some documents
3. Attempt to view the index in Luke

What is the expected output? What do you see instead?
Expected that Luke would be usable. Instead, I see that the length of the
field names confuses the layout completely. I can't see the start of the
field names so I can't select anything useful and the entire layout becomes
impossible to use.


What version of the product are you using? On what operating system?
1.0.1. Ubuntu 9.10

Please provide any additional information below.

What steps will reproduce the problem?
1. Open directory and type custom implementation class name for Directory

What is the expected output? What do you see instead?
Luke should open index with specified directory.
Instead error message is displayed, because directory is opened with FSDirecory

What version of the product are you using? On what operating system?
1.0.1

Please provide any additional information below.
I've provided svn diff to patch the problem. Basicaly replace FSDirectory
type with Directory in openDirectory

I've modified the fieldFlags() method to append a N if the fieldable is a 
numericfield.

  public static String fieldFlags(Fieldable f) {
    if (f == null) {
      return "-----------";
    }
    StringBuffer flags = new StringBuffer();
    if (f != null && f.isIndexed()) flags.append("I");
    else flags.append("-");
    if (f != null && f.isTokenized()) flags.append("T");
    else flags.append("-");
    if (f != null && f.isStored()) flags.append("S");
    else flags.append("-");
    if (f != null && f.isTermVectorStored()) flags.append("V");
    else flags.append("-");
    if (f != null && f.isStoreOffsetWithTermVector()) flags.append("o");
    else flags.append("-");
    if (f != null && f.isStorePositionWithTermVector()) flags.append("p");
    else flags.append("-");
    if (f != null && f.getOmitTermFreqAndPositions()) flags.append("f");
    else flags.append("-");
    if (f != null && f.getOmitNorms()) flags.append("O");
    else flags.append("-");
    if (f != null && f.isLazy()) flags.append("L");
    else flags.append("-");
    if (f != null && f.isBinary()) flags.append("B");
    else flags.append("-");
    if (f instanceof NumericField) flags.append("N");
    else flags.append("-");
    return flags.toString();
  }

What steps will reproduce the problem?
double-click on lukeall-1.0.1.jar (or right-click select 'Open')

What is the expected output?
Luke GUI

What do you see instead?
Nada

What version of the product are you using? On what operating system?
See summary

Please provide any additional information below.
1. lukeall-1.0.0.jar runs ok

I've seen that trunk contains already the Lucene 4 snapshot jars. Can we expect 
a Lucene 3.2 compatible release in the meantime?

In documents view the last column on the field properties is "C" - 
Compressed. This no longer exists in Lucene 3.0 and is false for fields 
that were previously compressed. The FieldsReader autmatically hides this 
flag. So its useless and incorrect. Lucene automatically decompresses 
compressed fields on the next merge.

What steps will reproduce the problem?
1. Download Sol 3.4.0 
(http://lucene.apache.org/solr/#14+September+2011+-+Solr+3.4.0+Released)
1.a Download Luke 3.3.0
2. Run demo to create index.  (Pasting section of the document)

Solr example configuration
--------------------------

To run this example configuration, use 

  java -jar start.jar

in this directory, and when Solr is started connect to 

  http://localhost:8983/solr/admin/

To add documents to the index, use the post.sh script in the exampledocs
subdirectory (while Solr is running), for example:

  cd exampledocs
  sh post.sh *.xml

After index built tried to open with luke and get the following msg: 
unrecognized format - 3 in file "_6.fmn"


------------------------------------------------
Index that I build is attached.  XML output of index having data in it.

Sorry I was unable to provide possible patch/fixes.

What steps will reproduce the problem?
1.Go to the plugins tab
2. Select snowball analyzer
3. Attempt to analyze text with any compatibility and receive error

What is the expected output? What do you see instead?
see tokens on left. an error in the status bar

Couldn't instantiate analyzer - public 0-arg or 1-arg constructor(Version) 
required

What version of the product are you using? On what operating system?
luke v1.0.1

Please provide any additional information below.

Dear developers,
I have problem with several Analyzers.

What steps will reproduce the problem?
1.go to plugins->analyzer tools
2.choose org.apache.lucene.analysis.snowball.SnowballAnalyzer
3.press analyze

Other analyzers that do not work for me:
org.apache.lucene.analysis.miscellaneous.PatternAnalyzer
org.apache.lucene.analysis.query.QueryAutoStopWordAnalyzer
org.apache.lucene.analysis.PerFieldAnalyzerWrapper

What is the expected output? What do you see instead?
Couldn't initialize analyzer...

What version of the product are you using? On what operating system?
lukeall-1.0.1.jar build from source using svn version 27
Mac Os snow leopard

Please provide any additional information below.

java.lang.InstantiationException: 
org.apache.lucene.analysis.snowball.SnowballAnalyzer
    at java.lang.Class.newInstance0(Class.java:340)
    at java.lang.Class.newInstance(Class.java:308)
    at org.getopt.luke.plugins.AnalyzerToolPlugin.analyze(Unknown Source)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
a:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at thinlet.Thinlet.invokeImpl(Unknown Source)
    at thinlet.Thinlet.invoke(Unknown Source)
    at thinlet.Thinlet.handleMouseEvent(Unknown Source)
    at thinlet.Thinlet.processEvent(Unknown Source)
    at java.awt.Component.dispatchEventImpl(Component.java:4714)
    at java.awt.Container.dispatchEventImpl(Container.java:2143)
    at java.awt.Component.dispatchEvent(Component.java:4544)
    at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4618)
    at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)
    at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4212)
    at java.awt.Container.dispatchEventImpl(Container.java:2129)
    at java.awt.Window.dispatchEventImpl(Window.java:2475)
    at java.awt.Component.dispatchEvent(Component.java:4544)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:635)
    at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296)
    at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:201)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:196)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:188)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:122)

What steps will reproduce the problem?
1.Enable Japanese Input Method, for example, by going to System Preferences
> Language and Text > Input Source, then clicking on Kotoeri (and U.S.)
2.Start Luke, open some index, Sarch Tab, move the pointer inside the
search expression box.
3. Click on the Input Menu icon ("A" or US flag) on the menu bar near the
battery indicator, and choose Hiragana.
4. Type "a".  You'll see the letter "a" as though no Input Method is in play.

What is the expected output? What do you see instead?
"あ" should be displayed in this case.


What version of the product are you using? On what operating system?
Luke v 0.9.9 on MacOS X 10.6.2.


Please provide any additional information below.
Input Method Editor works on Windows XP.

What steps will reproduce the problem?
1. Open an generated index from Solr 3.2.0

What is the expected output? What do you see instead?
Expected: Luke can open the index.
See: error message when opening an index: Incompatible format version: 3 
expected 2 or lower


What version of the product are you using? On what operating system?
Version: 3.1.0
OS: OS X 10.6.7

Please provide any additional information below.
It seems that Solr with version 3.2.0 is now generating the index in another 
format and luke can't work with this new index format.

What steps will reproduce the problem?
1.open luke: java -jar lukeall-1.0.1.jar &
2.
3.

What is the expected output? What do you see instead?
a reasonable looking font, instead i get an unreadably small script font, see 
attached picture

What version of the product are you using? On what operating system?
luke :1.0.1 2010-04-01

my setup: connecting to following linux version using xterm (have tried on 
logging in from xterm on both os x and ubuntu)
Linux version 2.6.18-194.3.1.el5PAE ([email protected]) (gcc 
version 4.1.2 20080704 (Red Hat 4.1.2-48)) #1 SMP Thu May 13 13:48:44 EDT 2010

Please provide any additional information below.

I have an index which contains documents with phrase Oceania(field 
'searchField'). When I try to search 'searchField:Oceania' it returns nothing. 
However, when I search  'searchField:oceania' it returns all necessary 
documents (all of them contain 'Oceania').

What steps will reproduce the problem?
1. Open a Lucene index in Luke
2. On the documents tab, click the Reconstruct and Edit button
3. Click the Add button
4. Create a new field
5. Select the StandardAnalyzer
6. Click the Add to Index button

What is the expected output? What do you see instead?

I expected the new document to be added to the index. Instead, I receive the 
following error message: "Could not instantiate Analyzer 
'org.apache.lucene.analysis.standard.StandardAnalyzer'. Please select a valid 
Analyzer."  

This problem also occurs when editing an existing document.

What version of the product are you using? On what operating system?

I use Luke 1.0.1 on Windows XP.

Please provide any additional information below.

The following analyzers work properly: 
KeywordAnalyzer
SimpleAnalyzer
WhitespaceAnalyzer

These analyzers have the same problem as the StandardAnalyzer:
StopAnalyzer
SnowballAnalyzer

I did not check the PerFieldAnalyzerWrapper or any of the specific language 
analyzers.

The DocReconstructor sometimes results in a Null Reference Exception.  The
problematic line is line 142 (svn trunk, 4/8/10):
     if (te == null || !te.term().field().equals(fld)) {

This line should be changes to:
      if (te == null || te.term() == null || !te.term().field().equals(fld)) {

Apparently, it is somehow possible to have a TermEnum here with a null
term.  I have seen this in several indexes, though I don't know the exact
scenario which reproduces an index which would cause this error.  The
indexes I've seen which cause this were created with Solr 1.4 (using Lucene
2.9.2).

What steps will reproduce the problem?
1. Launch Luke 1.0.0, do not open an index.
2. Select the Plugins tab, then the Analyzer Tool
3. Choose org.apache.lucene.analysis.standard.StandardAnalyzer from dropdown
4. Type some text to be analyzed

What is the expected output? What do you see instead?

I expected to see the text entered in (4) to be analyzed, instead I get an
error stating, "Couldn't instantiate analyzer - public zero-argument
constructor required"

What version of the product are you using? On what operating system?
Luke 1.0.0 on Ubuntu Karmic 64-bit, Java 1.6.0_15.