Class S3PipesIterator
- java.lang.Object
-
- org.apache.tika.config.ConfigBase
-
- org.apache.tika.pipes.pipesiterator.PipesIterator
-
- org.apache.tika.pipes.pipesiterator.s3.S3PipesIterator
-
- All Implemented Interfaces:
Iterable<FetchEmitTuple>
,Callable<Integer>
,Initializable
public class S3PipesIterator extends PipesIterator implements Initializable
-
-
Field Summary
-
Fields inherited from class org.apache.tika.pipes.pipesiterator.PipesIterator
COMPLETED_SEMAPHORE, DEFAULT_MAX_WAIT_MS, DEFAULT_QUEUE_SIZE
-
-
Constructor Summary
Constructors Constructor Description S3PipesIterator()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
checkInitialization(InitializableProblemHandler problemHandler)
protected void
enqueue()
void
initialize(Map<String,Param> params)
This initializes the s3 client.void
setAccessKey(String accessKey)
void
setBucket(String bucket)
void
setCredentialsProvider(String credentialsProvider)
void
setEndpointConfigurationService(String endpointConfigurationService)
void
setFileNamePattern(String fileNamePattern)
void
setFileNamePattern(Pattern fileNamePattern)
void
setMaxConnections(int maxConnections)
void
setPathStyleAccessEnabled(boolean pathStyleAccessEnabled)
void
setPrefix(String prefix)
void
setProfile(String profile)
void
setRegion(String region)
void
setSecretKey(String secretKey)
-
Methods inherited from class org.apache.tika.pipes.pipesiterator.PipesIterator
build, call, getEmitterName, getFetcherName, getHandlerConfig, getOnParseException, iterator, setEmitterName, setFetcherName, setHandlerType, setMaxEmbeddedResources, setMaxWaitMs, setOnParseException, setOnParseException, setParseMode, setParseMode, setQueueSize, setWriteLimit, tryToAdd
-
Methods inherited from class org.apache.tika.config.ConfigBase
buildComposite, buildComposite, buildSingle, buildSingle, configure, handleSettings
-
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
-
Methods inherited from interface java.lang.Iterable
forEach, spliterator
-
-
-
-
Method Detail
-
setEndpointConfigurationService
@Field public void setEndpointConfigurationService(String endpointConfigurationService)
-
setMaxConnections
@Field public void setMaxConnections(int maxConnections)
-
setPathStyleAccessEnabled
@Field public void setPathStyleAccessEnabled(boolean pathStyleAccessEnabled)
-
initialize
public void initialize(Map<String,Param> params) throws TikaConfigException
This initializes the s3 client. Note, we wrap S3's RuntimeExceptions, e.g. AmazonClientException in a TikaConfigException.- Specified by:
initialize
in interfaceInitializable
- Overrides:
initialize
in classPipesIterator
- Parameters:
params
- params to use for initialization- Throws:
TikaConfigException
-
checkInitialization
public void checkInitialization(InitializableProblemHandler problemHandler) throws TikaConfigException
- Specified by:
checkInitialization
in interfaceInitializable
- Overrides:
checkInitialization
in classPipesIterator
- Parameters:
problemHandler
- if there is a problem and no custom initializableProblemHandler has been configured via Initializable parameters, this is called to respond.- Throws:
TikaConfigException
-
enqueue
protected void enqueue() throws InterruptedException, IOException, TimeoutException
- Specified by:
enqueue
in classPipesIterator
- Throws:
InterruptedException
IOException
TimeoutException
-
-