Packages

abstract class KafkaDataMap[Key, Data <: Identifiable[Data]] extends DataMap[Key, Data]

Created by edmundlam on 8/23/17.

Linear Supertypes
DataMap[Key, Data], DataStore[Data], ConfigBuildsDataStore, ConfigBuilds[DataStoreBuilder], ConfigChecker, Upstream[Data], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. KafkaDataMap
  2. DataMap
  3. DataStore
  4. ConfigBuildsDataStore
  5. ConfigBuilds
  6. ConfigChecker
  7. Upstream
  8. AnyRef
  9. Any
Implicitly
  1. by any2stringadd
  2. by StringFormat
  3. by Ensuring
  4. by ArrowAssoc
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new KafkaDataMap()

Abstract Value Members

  1. abstract val serializer: BasicSerializer[Data]

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. def +(other: String): String
    Implicit
    This member is added by an implicit conversion from KafkaDataMap[Key, Data] to any2stringadd[KafkaDataMap[Key, Data]] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd
  4. def ->[B](y: B): (KafkaDataMap[Key, Data], B)
    Implicit
    This member is added by an implicit conversion from KafkaDataMap[Key, Data] to ArrowAssoc[KafkaDataMap[Key, Data]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()
  5. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  6. def add(data: Data): Unit
    Definition Classes
    DataStore
  7. def all(): Seq[Data]

    This gets everything from the data store.

    This gets everything from the data store.

    returns

    Every document that is stored in the data store.

    Definition Classes
    KafkaDataMap → DataStore
  8. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  9. def checkConfig(conf: PipeConfig): Unit

    Check that paths in configuration file relevant to host class are well-formed.

    Check that paths in configuration file relevant to host class are well-formed. Default does nothing.

    conf

    the config file to check

    Definition Classes
    ConfigChecker
  10. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  11. val configOpt: Option[PipeConfig]
    Definition Classes
    ConfigBuilds
  12. var consPropsOpt: Option[Properties]
  13. def constructBuilder(config: PipeConfig): DataStoreBuilder
    Definition Classes
    ConfigBuildsDataStore → ConfigBuilds
  14. def contains(key: Key): Boolean
    Definition Classes
    KafkaDataMap → DataMap
  15. def dequeue(): Option[(Key, Data)]
  16. def displayName(): String
    Definition Classes
    DataStore
  17. val downstreamConnectors: Seq[Connector[Data]]
    Definition Classes
    Upstream
  18. def ensuring(cond: (KafkaDataMap[Key, Data]) ⇒ Boolean, msg: ⇒ Any): KafkaDataMap[Key, Data]
    Implicit
    This member is added by an implicit conversion from KafkaDataMap[Key, Data] to Ensuring[KafkaDataMap[Key, Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  19. def ensuring(cond: (KafkaDataMap[Key, Data]) ⇒ Boolean): KafkaDataMap[Key, Data]
    Implicit
    This member is added by an implicit conversion from KafkaDataMap[Key, Data] to Ensuring[KafkaDataMap[Key, Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  20. def ensuring(cond: Boolean, msg: ⇒ Any): KafkaDataMap[Key, Data]
    Implicit
    This member is added by an implicit conversion from KafkaDataMap[Key, Data] to Ensuring[KafkaDataMap[Key, Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  21. def ensuring(cond: Boolean): KafkaDataMap[Key, Data]
    Implicit
    This member is added by an implicit conversion from KafkaDataMap[Key, Data] to Ensuring[KafkaDataMap[Key, Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  22. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  23. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  24. def extract(): Seq[Data]
    Definition Classes
    KafkaDataMap → DataStore
  25. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  26. def formatted(fmtstr: String): String
    Implicit
    This member is added by an implicit conversion from KafkaDataMap[Key, Data] to StringFormat[KafkaDataMap[Key, Data]] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()
  27. def get(key: Key): Option[Data]
    Definition Classes
    KafkaDataMap → DataMap
  28. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
  29. def getConfig(config: PipeConfig): PipeConfig
    Definition Classes
    ConfigBuilds
  30. def getConsumerProps: Properties
  31. def getMap(): DataMap[Key, Data]
  32. def getOrElse(key: Key, default: Data): Data
    Definition Classes
    DataMap
  33. def getProducer: KafkaProducer[Key, String]
  34. def getProducerProps: Properties
  35. def getStream: KafkaStream[Key, Data]
  36. def getTopic: String
  37. def hashCode(): Int
    Definition Classes
    AnyRef → Any
  38. def init(conf: PipeConfig): Unit
    Definition Classes
    KafkaDataMap → DataStore
  39. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  40. def iterator(): Iterator[Data]

    This returns an iterator that iterates over the data store.

    This returns an iterator that iterates over the data store.

    returns

    An iterator that iterates over the data store until all documents have been processed.

    Definition Classes
    KafkaDataMap → DataStore
  41. var mapOpt: Option[DataMap[Key, Data]]
  42. var name: String
    Definition Classes
    DataStore
  43. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  44. final def notify(): Unit
    Definition Classes
    AnyRef
  45. final def notifyAll(): Unit
    Definition Classes
    AnyRef
  46. def pollForMore(tries: Int = 2, timeout: Int = 100): Boolean
  47. var prodPropsOpt: Option[Properties]
  48. var producerOpt: Option[KafkaProducer[Key, String]]
  49. def put(key: Key, data: Data): Unit
    Definition Classes
    DataMap
  50. def put(data: Data): Unit
    Definition Classes
    DataStore
  51. def put(data: Seq[Data]): Unit

    This puts the data into the data store using put_, and then sends the data down the pipeline if the data store is connected to the pipeline.

    This puts the data into the data store using put_, and then sends the data down the pipeline if the data store is connected to the pipeline.

    data

    The data that needs to be put into the data store.

    Definition Classes
    DataStore
  52. def put_(key: Key, data: Data): Unit
    Definition Classes
    KafkaDataMap → DataMap
  53. def put_(data: Seq[Data]): Unit

    This actually puts the data into the data store.

    This actually puts the data into the data store.

    data

    The data to be put into the data store.

    Definition Classes
    KafkaDataMap → DataStore
  54. def registerConnector(connector: Connector[Data]): Unit
    Definition Classes
    KafkaDataMap → Upstream
  55. def remove(key: Key): Unit
    Definition Classes
    KafkaDataMap → DataMap
  56. def remove(keys: Seq[Key]): Unit
    Definition Classes
    KafkaDataMap → DataMap
  57. def setConfig(pipeConfig: PipeConfig): Unit
    Definition Classes
    ConfigBuilds
  58. def setName(newName: String): Unit
    Definition Classes
    DataStore
  59. def size(): Int
    Definition Classes
    KafkaDataMap → DataStore
  60. var streamOpt: Option[KafkaStream[Key, Data]]
  61. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  62. def terminate(): Unit
    Definition Classes
    DataStore
  63. def toString(): String
    Definition Classes
    AnyRef → Any
  64. def topic(topicName: String): KafkaDataMap[Key, Data]
  65. var topicOpt: Option[String]
  66. def transmitDownstream(data: Data): Unit
    Definition Classes
    Upstream
  67. def transmitDownstream(data: Seq[Data]): Unit
    Definition Classes
    Upstream
  68. def transmitDownstreamModified(data: Data): Unit
    Definition Classes
    Upstream
  69. def transmitDownstreamModified(data: Seq[Data]): Unit
    Definition Classes
    Upstream
  70. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  71. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  72. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  73. def →[B](y: B): (KafkaDataMap[Key, Data], B)
    Implicit
    This member is added by an implicit conversion from KafkaDataMap[Key, Data] to ArrowAssoc[KafkaDataMap[Key, Data]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Inherited from DataMap[Key, Data]

Inherited from DataStore[Data]

Inherited from ConfigBuildsDataStore

Inherited from ConfigBuilds[DataStoreBuilder]

Inherited from ConfigChecker

Inherited from Upstream[Data]

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from KafkaDataMap[Key, Data] to any2stringadd[KafkaDataMap[Key, Data]]

Inherited by implicit conversion StringFormat from KafkaDataMap[Key, Data] to StringFormat[KafkaDataMap[Key, Data]]

Inherited by implicit conversion Ensuring from KafkaDataMap[Key, Data] to Ensuring[KafkaDataMap[Key, Data]]

Inherited by implicit conversion ArrowAssoc from KafkaDataMap[Key, Data] to ArrowAssoc[KafkaDataMap[Key, Data]]

Ungrouped