Packages

abstract class KafkaQueue[Data <: Identifiable[Data]] extends DataQueue[Data]

Created by edmundlam on 8/19/17.

Linear Supertypes
DataQueue[Data], DataStore[Data], ConfigBuildsDataStore, ConfigBuilds[DataStoreBuilder], ConfigChecker, Upstream[Data], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. KafkaQueue
  2. DataQueue
  3. DataStore
  4. ConfigBuildsDataStore
  5. ConfigBuilds
  6. ConfigChecker
  7. Upstream
  8. AnyRef
  9. Any
Implicitly
  1. by any2stringadd
  2. by StringFormat
  3. by Ensuring
  4. by ArrowAssoc
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new KafkaQueue()

Abstract Value Members

  1. abstract val serializer: BasicSerializer[Data]

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. def +(other: String): String
    Implicit
    This member is added by an implicit conversion from KafkaQueue[Data] to any2stringadd[KafkaQueue[Data]] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd
  4. def ->[B](y: B): (KafkaQueue[Data], B)
    Implicit
    This member is added by an implicit conversion from KafkaQueue[Data] to ArrowAssoc[KafkaQueue[Data]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()
  5. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  6. def add(data: Data): Unit
    Definition Classes
    DataStore
  7. def all(): Seq[Data]

    This gets everything from the data store.

    This gets everything from the data store.

    returns

    Every document that is stored in the data store.

    Definition Classes
    KafkaQueue → DataStore
  8. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  9. def checkConfig(conf: PipeConfig): Unit

    Check that paths in configuration file relevant to host class are well-formed.

    Check that paths in configuration file relevant to host class are well-formed. Default does nothing.

    conf

    the config file to check

    Definition Classes
    ConfigChecker
  10. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. val configOpt: Option[PipeConfig]
    Definition Classes
    ConfigBuilds
  12. var consPropsOpt: Option[Properties]
  13. def constructBuilder(config: PipeConfig): DataStoreBuilder
    Definition Classes
    ConfigBuildsDataStore → ConfigBuilds
  14. def dequeue(): Option[Data]
    Definition Classes
    KafkaQueue → DataQueue
  15. def displayName(): String
    Definition Classes
    DataStore
  16. val downstreamConnectors: Seq[Connector[Data]]
    Definition Classes
    Upstream
  17. def enqueue(data: Seq[Data]): Unit
    Definition Classes
    DataQueue
  18. def enqueue(data: Data): Unit
    Definition Classes
    DataQueue
  19. def ensuring(cond: (KafkaQueue[Data]) ⇒ Boolean, msg: ⇒ Any): KafkaQueue[Data]
    Implicit
    This member is added by an implicit conversion from KafkaQueue[Data] to Ensuring[KafkaQueue[Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  20. def ensuring(cond: (KafkaQueue[Data]) ⇒ Boolean): KafkaQueue[Data]
    Implicit
    This member is added by an implicit conversion from KafkaQueue[Data] to Ensuring[KafkaQueue[Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  21. def ensuring(cond: Boolean, msg: ⇒ Any): KafkaQueue[Data]
    Implicit
    This member is added by an implicit conversion from KafkaQueue[Data] to Ensuring[KafkaQueue[Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  22. def ensuring(cond: Boolean): KafkaQueue[Data]
    Implicit
    This member is added by an implicit conversion from KafkaQueue[Data] to Ensuring[KafkaQueue[Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  23. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  24. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  25. def extract(): Seq[Data]
    Definition Classes
    KafkaQueue → DataStore
  26. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  27. def formatted(fmtstr: String): String
    Implicit
    This member is added by an implicit conversion from KafkaQueue[Data] to StringFormat[KafkaQueue[Data]] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()
  28. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
  29. def getConfig(config: PipeConfig): PipeConfig
    Definition Classes
    ConfigBuilds
  30. def getConsumerProps: Properties
  31. def getProducer: KafkaProducer[String, String]
  32. def getProducerProps: Properties
  33. def getStream: KafkaStream[String, Data]
  34. def getTopic: String
  35. def hashCode(): Int
    Definition Classes
    AnyRef → Any
  36. def init(conf: PipeConfig): Unit
    Definition Classes
    KafkaQueue → DataStore
  37. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  38. def iterator(): Iterator[Data]

    This returns an iterator that iterates over the data store.

    This returns an iterator that iterates over the data store.

    returns

    An iterator that iterates over the data store until all documents have been processed.

    Definition Classes
    KafkaQueue → DataStore
  39. var name: String
    Definition Classes
    DataStore
  40. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  41. final def notify(): Unit
    Definition Classes
    AnyRef
  42. final def notifyAll(): Unit
    Definition Classes
    AnyRef
  43. def pollForMore(tries: Int = 2, timeout: Int = 100): Boolean
  44. var prodPropsOpt: Option[Properties]
  45. var producerOpt: Option[KafkaProducer[String, String]]
  46. def put(data: Data): Unit
    Definition Classes
    DataStore
  47. def put(data: Seq[Data]): Unit

    This puts the data into the data store using put_, and then sends the data down the pipeline if the data store is connected to the pipeline.

    This puts the data into the data store using put_, and then sends the data down the pipeline if the data store is connected to the pipeline.

    data

    The data that needs to be put into the data store.

    Definition Classes
    DataStore
  48. def put_(data: Seq[Data]): Unit

    This actually puts the data into the data store.

    This actually puts the data into the data store.

    data

    The data to be put into the data store.

    Definition Classes
    KafkaQueue → DataStore
  49. def registerConnector(connector: Connector[Data]): Unit
    Definition Classes
    KafkaQueue → Upstream
  50. def setConfig(pipeConfig: PipeConfig): Unit
    Definition Classes
    ConfigBuilds
  51. def setName(newName: String): Unit
    Definition Classes
    DataStore
  52. def size(): Int
    Definition Classes
    KafkaQueue → DataStore
  53. var streamOpt: Option[KafkaStream[String, Data]]
  54. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  55. def terminate(): Unit
    Definition Classes
    DataStore
  56. def toString(): String
    Definition Classes
    AnyRef → Any
  57. def topic(topicName: String): KafkaQueue[Data]
  58. var topicOpt: Option[String]
  59. def transmitDownstream(data: Data): Unit
    Definition Classes
    Upstream
  60. def transmitDownstream(data: Seq[Data]): Unit
    Definition Classes
    Upstream
  61. def transmitDownstreamModified(data: Data): Unit
    Definition Classes
    Upstream
  62. def transmitDownstreamModified(data: Seq[Data]): Unit
    Definition Classes
    Upstream
  63. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  64. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  65. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  66. def →[B](y: B): (KafkaQueue[Data], B)
    Implicit
    This member is added by an implicit conversion from KafkaQueue[Data] to ArrowAssoc[KafkaQueue[Data]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Inherited from DataQueue[Data]

Inherited from DataStore[Data]

Inherited from ConfigBuildsDataStore

Inherited from ConfigBuilds[DataStoreBuilder]

Inherited from ConfigChecker

Inherited from Upstream[Data]

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from KafkaQueue[Data] to any2stringadd[KafkaQueue[Data]]

Inherited by implicit conversion StringFormat from KafkaQueue[Data] to StringFormat[KafkaQueue[Data]]

Inherited by implicit conversion Ensuring from KafkaQueue[Data] to Ensuring[KafkaQueue[Data]]

Inherited by implicit conversion ArrowAssoc from KafkaQueue[Data] to ArrowAssoc[KafkaQueue[Data]]

Ungrouped