Error during indexing: No space left on device about cdxj-indexer HOT 2 CLOSED

FWIW I think this happens when indexing our old ARC files. /tmp only has 3GB of space, and I'm running 7 parallel cdxj-indexer processes. I guess the easy solution is to get a bigger partition or run fewer processes--but I figured it might be worth reporting the issue.

from cdxj-indexer.

I was able to isolate this error to a single ARC file which contained a response for a ZIP file whose length exceeded the available space in /tmp.

Fortunately you can tell SpooledTemporaryFile to use a temporary directory other than /tmp (which was too small) using the TMPDIR environment variable, for example:

TMPDIR=/data/tmp cdxj-indexer large.arc.gz -o large-arc.cdx

I'm going to close this, because closing the temporary file wouldn't have helped me in this situation, and perhaps other people won't run into this problem if they create a reasonably sized /tmp directory. But maybe this information will be useful for someone else searching through issues in the future.

from cdxj-indexer.