Packages

implicit class DataNode[Data <: Identifiable[Data]] extends Pipe[Data, Data]

This is a wrapper for data pipelines that make them act like pipes. In the example, gitID, clonedMap, c, and d are converted implicitly to DataNodes when calling gitID:--Clone()-->clonedMap:--CommitExtraction()-->commitInfoMap:-+FindAuthor()+->authorMap.

Data

The Type of the Data Store; In this case, it's bigglue.examples.GitID for gitID, bigglue.examples.GitRepo for clonedMap, bigglue.examples.GitCommitInfo for commitInfoMap, and bigglue.examples.GitCommitGroups for authorMap.

Linear Supertypes
Pipe[Data, Data], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DataNode
  2. Pipe
  3. AnyRef
  4. Any
Implicitly
  1. by any2stringadd
  2. by StringFormat
  3. by Ensuring
  4. by ArrowAssoc
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DataNode(map: DataStore[Data])

    map

    The Data Store that's being converted into a pipe.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. def +(other: String): String
    Implicit
    This member is added by an implicit conversion from DataNode[Data] to any2stringadd[DataNode[Data]] performed by method any2stringadd in scala.Predef.
    Definition Classes
    any2stringadd
  4. def ->[B](y: B): (DataNode[Data], B)
    Implicit
    This member is added by an implicit conversion from DataNode[Data] to ArrowAssoc[DataNode[Data]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()
  5. def :-+[Next <: Identifiable[Next], Mid <: Identifiable[Mid]](headReducer: PartialReducerPipe[Data, Mid, Next]): Pipe[Data, Next]

    This connects the Reducer to the input store, connecting it completely.

    This connects the Reducer to the input store, connecting it completely. This is expected to be called after a bigglue.pipes.Implicits.DataNode, and can be seen after gitID and clonedMap.

    Next

    The type at the end of the new pipeline.

    Mid

    The type that the mapper ends up outputting given the input End.

    headReducer

    The reducer to connect to the input store.

    returns

    A connected ReducerPipe that connects this pipeline to the reducer.

    Definition Classes
    Pipe
  6. def :--[Next <: Identifiable[Next], Mid <: Identifiable[Mid]](headMapper: PartialMapperPipe[Data, Mid, Next]): Pipe[Data, Next]

    This connects the Mapper to the input store, connecting it completely.

    This connects the Mapper to the input store, connecting it completely. This is expected to be called after a bigglue.pipes.Implicits.DataNode, and can be seen after gitID and clonedMap.

    Next

    The type at the end of the new pipeline.

    Mid

    The type that the mapper ends up outputting given the input End.

    headMapper

    The mapper to connect to the input store.

    returns

    A connected MapperPipe that connects this pipeline to the mapper.

    Definition Classes
    Pipe
  7. def :<[Next <: Identifiable[Next]](parPipes: PartialPipe[Data, Next]): Pipe[Data, Next]
    Definition Classes
    Pipe
  8. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  10. def check(conf: PipeConfig): Unit

    This is called within the example with pipe.check(conf).

    This is called within the example with pipe.check(conf). In basic terms, this checks to see whether the pipeline that we have created is valid. See MapperPipe.check() or ReducerPipe.check()

    conf

    The configuration file that we are checking with.

    Definition Classes
    DataNode → Pipe
  11. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  12. def end(): DataStore[Data]

    This returns the data store hidden in the pipeline

    This returns the data store hidden in the pipeline

    returns

    map since this is both the head and end of this pipeline.

    Definition Classes
    DataNode → Pipe
  13. def ensuring(cond: (DataNode[Data]) ⇒ Boolean, msg: ⇒ Any): DataNode[Data]
    Implicit
    This member is added by an implicit conversion from DataNode[Data] to Ensuring[DataNode[Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  14. def ensuring(cond: (DataNode[Data]) ⇒ Boolean): DataNode[Data]
    Implicit
    This member is added by an implicit conversion from DataNode[Data] to Ensuring[DataNode[Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  15. def ensuring(cond: Boolean, msg: ⇒ Any): DataNode[Data]
    Implicit
    This member is added by an implicit conversion from DataNode[Data] to Ensuring[DataNode[Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  16. def ensuring(cond: Boolean): DataNode[Data]
    Implicit
    This member is added by an implicit conversion from DataNode[Data] to Ensuring[DataNode[Data]] performed by method Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  17. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  18. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  19. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  20. def formatted(fmtstr: String): String
    Implicit
    This member is added by an implicit conversion from DataNode[Data] to StringFormat[DataNode[Data]] performed by method StringFormat in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()
  21. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
  22. def hashCode(): Int
    Definition Classes
    AnyRef → Any
  23. def head(): DataStore[Data]

    This returns the data store hidden in the pipeline

    This returns the data store hidden in the pipeline

    returns

    map since this is both the head and end of this pipeline.

    Definition Classes
    DataNode → Pipe
  24. def init(conf: PipeConfig): Unit

    This initializes the DataStore map by calling map.init(conf) In this example, we would call bigglue.store.instances.solr.SolrDataMap.init(conf)

    This initializes the DataStore map by calling map.init(conf) In this example, we would call bigglue.store.instances.solr.SolrDataMap.init(conf)

    conf

    The configuration file to initialize

    Definition Classes
    DataNode → Pipe
  25. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  26. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  27. final def notify(): Unit
    Definition Classes
    AnyRef
  28. final def notifyAll(): Unit
    Definition Classes
    AnyRef
  29. def persist(): Unit

    This starts/restarts the pipeline.

    This starts/restarts the pipeline. See MapperPipe.persist() or ReducerPipe.persist()

    Definition Classes
    Pipe
  30. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  31. def terminate(): Unit
    Definition Classes
    DataNode → Pipe
  32. def toString(): String
    Definition Classes
    DataNode → AnyRef → Any
  33. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  35. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  36. def ||[OHead <: Identifiable[OHead], OEnd <: Identifiable[OEnd]](o: Pipe[OHead, OEnd]): PairPipes[Data, OHead, Data, OEnd]
    Definition Classes
    Pipe
  37. def →[B](y: B): (DataNode[Data], B)
    Implicit
    This member is added by an implicit conversion from DataNode[Data] to ArrowAssoc[DataNode[Data]] performed by method ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Inherited from Pipe[Data, Data]

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion any2stringadd from DataNode[Data] to any2stringadd[DataNode[Data]]

Inherited by implicit conversion StringFormat from DataNode[Data] to StringFormat[DataNode[Data]]

Inherited by implicit conversion Ensuring from DataNode[Data] to Ensuring[DataNode[Data]]

Inherited by implicit conversion ArrowAssoc from DataNode[Data] to ArrowAssoc[DataNode[Data]]

Ungrouped