Package org.apache.tika.batch.fs

Class StreamOutRPWFSConsumer

java.lang.Object

org.apache.tika.batch.FileResourceConsumer

org.apache.tika.batch.fs.AbstractFSConsumer

org.apache.tika.batch.fs.StreamOutRPWFSConsumer

All Implemented Interfaces:

Callable<IFileProcessorFutureResult>

public class StreamOutRPWFSConsumer
extends AbstractFSConsumer

This uses the JsonStreamingSerializer to write out a single metadata object at a time.

Field Summary

Fields inherited from class org.apache.tika.batch.FileResourceConsumer

ELAPSED_MILLIS, IO_IS, IO_OS, LOG, OOM, PARSE_ERR, PARSE_EX, TIMED_OUT

Constructor Summary

Constructors

Constructor	Description
StreamOutRPWFSConsumer(ArrayBlockingQueue<FileResource> queue, Parser parser, ContentHandlerFactory contentHandlerFactory, OutputStreamFactory fsOSFactory, MetadataFilter metadataFilter)

Method Summary

Modifier and Type	Method	Description
String	getOutputEncoding()
boolean	processFileResource(FileResource fileResource)	Main piece of code that needs to be implemented.
void	setOutputEncoding(String outputEncoding)

Methods inherited from class org.apache.tika.batch.fs.AbstractFSConsumer

getInputStream, getOutputStream

Methods inherited from class org.apache.tika.batch.FileResourceConsumer

call, checkForTimedOutMillis, close, flushAndClose, getCurrentFile, getNumHandledExceptions, getNumResourcesConsumed, getXMLifiedLogMsg, getXMLifiedLogMsg, incrementHandledExceptions, isStillActive, parse, pleaseShutdown

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

StreamOutRPWFSConsumer

public StreamOutRPWFSConsumer(ArrayBlockingQueue<FileResource> queue,
 Parser parser,
 ContentHandlerFactory contentHandlerFactory,
 OutputStreamFactory fsOSFactory,
 MetadataFilter metadataFilter)

Method Details

processFileResource

public boolean processFileResource(FileResource fileResource)

Description copied from class: FileResourceConsumer

Main piece of code that needs to be implemented. Clients are responsible for closing streams and handling the exceptions that they'd like to handle.

Unchecked throwables can be thrown past this, of course. When an unchecked throwable is thrown, this logs the error, and then rethrows the exception. Clients/subclasses should make sure to catch and handle everything they can.

The design goal is that the whole process should close up and shutdown soon after an unchecked exception or error is thrown.

Make sure to call FileResourceConsumer.incrementHandledExceptions() appropriately in your implementation of this method.

Specified by:

processFileResource in class FileResourceConsumer

Parameters:

fileResource - resource to process

Returns:

whether or not a file was successfully processed

getOutputEncoding

public String getOutputEncoding()

setOutputEncoding

public void setOutputEncoding(String outputEncoding)