Class CSVPipesIterator
java.lang.Object
org.apache.tika.plugins.AbstractTikaExtension
org.apache.tika.pipes.pipesiterator.PipesIteratorBase
org.apache.tika.pipes.iterator.csv.CSVPipesIterator
- All Implemented Interfaces:
Iterable<FetchEmitTuple>, Callable<Integer>, PipesIterator, TikaExtension
Iterates through a UTF-8 CSV file. This adds all columns
(except for the 'fetchKeyColumn' and 'emitKeyColumn', if specified)
to the metadata object.
- If an 'idColumn' is specified, this will use that column's value as the id.
- If no 'idColumn' is specified, but a 'fetchKeyColumn' is specified, the string in the 'fetchKeyColumn' will be used as the 'id'.
- The 'idColumn' value is not added to the metadata.
- If a 'fetchKeyColumn' is specified, this will use that column's value as the fetchKey.
- If no 'fetchKeyColumn' is specified, this will send the metadata from the other columns.
- The 'fetchKeyColumn' value is not added to the metadata.
- If an 'emitKeyColumn' is specified, this will use that column's value as the emit key.
- If an 'emitKeyColumn' is not specified, this will use the value from the 'fetchKeyColumn'.
- The 'emitKeyColumn' value is not added to the metadata.
-
Field Summary
Fields inherited from class PipesIteratorBase
DEFAULT_MAX_WAIT_MS, DEFAULT_QUEUE_SIZEFields inherited from class AbstractTikaExtension
pluginConfigFields inherited from interface PipesIterator
COMPLETED_SEMAPHORE -
Method Summary
Modifier and TypeMethodDescriptionstatic CSVPipesIteratorbuild(ExtensionConfig extensionConfig) protected voidenqueue()Methods inherited from class PipesIteratorBase
call, iterator, tryToAddMethods inherited from class AbstractTikaExtension
getExtensionConfigMethods inherited from class Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitMethods inherited from interface Iterable
forEach, spliteratorMethods inherited from interface TikaExtension
getExtensionConfig
-
Method Details
-
build
public static CSVPipesIterator build(ExtensionConfig extensionConfig) throws IOException, TikaConfigException - Throws:
IOExceptionTikaConfigException
-
enqueue
- Specified by:
enqueuein classPipesIteratorBase- Throws:
InterruptedExceptionIOExceptionTimeoutException
-