Class KafkaEmitter

java.lang.Object
org.apache.tika.pipes.emitter.AbstractEmitter
org.apache.tika.pipes.emitter.kafka.KafkaEmitter
All Implemented Interfaces:
Initializable, Emitter

public class KafkaEmitter extends AbstractEmitter implements Initializable
Emits the now-parsed documents into a specified Apache Kafka topic.
  • Constructor Details

    • KafkaEmitter

      public KafkaEmitter()
  • Method Details

    • setBootstrapServers

      @Field public void setBootstrapServers(String bootstrapServers)
    • setAcks

      @Field public void setAcks(String acks)
    • setLingerMs

      @Field public void setLingerMs(int lingerMs)
    • setBatchSize

      public void setBatchSize(int batchSize)
    • setBufferMemory

      @Field public void setBufferMemory(int bufferMemory)
    • setClientId

      @Field public void setClientId(String clientId)
    • setCompressionType

      @Field public void setCompressionType(String compressionType)
    • setConnectionsMaxIdleMs

      @Field public void setConnectionsMaxIdleMs(int connectionsMaxIdleMs)
    • setDeliveryTimeoutMs

      @Field public void setDeliveryTimeoutMs(int deliveryTimeoutMs)
    • setEnableIdempotence

      @Field public void setEnableIdempotence(boolean enableIdempotence)
    • setInterceptorClasses

      @Field public void setInterceptorClasses(String interceptorClasses)
    • setMaxBlockMs

      @Field public void setMaxBlockMs(int maxBlockMs)
    • setMaxInFlightRequestsPerConnection

      @Field public void setMaxInFlightRequestsPerConnection(int maxInFlightRequestsPerConnection)
    • setMaxRequestSize

      @Field public void setMaxRequestSize(int maxRequestSize)
    • setMetadataMaxAgeMs

      @Field public void setMetadataMaxAgeMs(int metadataMaxAgeMs)
    • setRequestTimeoutMs

      @Field public void setRequestTimeoutMs(int requestTimeoutMs)
    • setRetries

      @Field public void setRetries(int retries)
    • setRetryBackoffMs

      @Field public void setRetryBackoffMs(int retryBackoffMs)
    • setTransactionTimeoutMs

      @Field public void setTransactionTimeoutMs(int transactionTimeoutMs)
    • setTransactionalId

      @Field public void setTransactionalId(String transactionalId)
    • setKeySerializer

      @Field public void setKeySerializer(String keySerializer)
    • setValueSerializer

      @Field public void setValueSerializer(String valueSerializer)
    • setTopic

      @Field public void setTopic(String topic)
    • emit

      public void emit(String emitKey, List<Metadata> metadataList, ParseContext parseContext) throws IOException, TikaEmitterException
      Specified by:
      emit in interface Emitter
      Throws:
      IOException
      TikaEmitterException
    • initialize

      public void initialize(Map<String,Param> params) throws TikaConfigException
      Specified by:
      initialize in interface Initializable
      Parameters:
      params - params to use for initialization
      Throws:
      TikaConfigException
    • checkInitialization

      public void checkInitialization(InitializableProblemHandler problemHandler) throws TikaConfigException
      Specified by:
      checkInitialization in interface Initializable
      Parameters:
      problemHandler - if there is a problem and no custom initializableProblemHandler has been configured via Initializable parameters, this is called to respond.
      Throws:
      TikaConfigException