abstract class PartialPipe[Input <: Identifiable[Input], End <: Identifiable[End]] extends AnyRef
This is a pipe that has no input data store, but has a computation and an ending pipeline. This is generated with the --> or +-> calls in the pipeline. You can run this in the case of ParallelPipes, and created a sequence of pipes, but that's out of scope for this example. Within the example, we just use this as a stepping point before MapperPipe and ReducerPipe
- Input
The data type that the computation puts in. bigglue.examples.GitID In the case of Clone()-->clonedMap and bigglue.examples.GitRepo for CommitExtraction()-->commitInfoMap, and bigglue.examples.GitCommitInfo for FindAuthor()+->authorMap.
- End
The type of the data store that shows up at the end of the pipeline; bigglue.examples.GitCommitGroups in this case.
- Alphabetic
- By Inheritance
- PartialPipe
- AnyRef
- Any
- by any2stringadd
- by StringFormat
- by Ensuring
- by ArrowAssoc
- Hide All
- Show All
- Public
- All
Instance Constructors
- new PartialPipe()
Abstract Value Members
-
abstract
def
check(conf: PipeConfig, input: DataStore[Input]): Unit
This is called within the example with pipe.check(conf).
This is called within the example with pipe.check(conf). In basic terms, this checks to see whether the pipeline that we have created is valid.
- conf
The configuration file that we are checking with.
-
abstract
def
end(): DataStore[End]
This is the data store at the end of the pipeline.
This is the data store at the end of the pipeline.
- returns
The data store at the end of the pipeline.
-
abstract
def
init(conf: PipeConfig, input: DataStore[Input]): Unit
This is called with the example with pipe.init(conf).
This is called with the example with pipe.init(conf). This initializes the pipeline and all of the parts within it.
- conf
The configuration file that we are initializing with. This ideally is the configuration file that is being used to check the pipeline.
- abstract def terminate(): Unit
Concrete Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
def
+(other: String): String
- Implicit
- This member is added by an implicit conversion from PartialPipe[Input, End] to any2stringadd[PartialPipe[Input, End]] performed by method any2stringadd in scala.Predef.
- Definition Classes
- any2stringadd
-
def
->[B](y: B): (PartialPipe[Input, End], B)
- Implicit
- This member is added by an implicit conversion from PartialPipe[Input, End] to ArrowAssoc[PartialPipe[Input, End]] performed by method ArrowAssoc in scala.Predef.
- Definition Classes
- ArrowAssoc
- Annotations
- @inline()
- def :-+[Next <: Identifiable[Next], Mid <: Identifiable[Mid]](other: PartialReducerPipe[End, Mid, Next]): PartialPipe[Input, Next]
- def :--[Next <: Identifiable[Next], Mid <: Identifiable[Mid]](other: PartialMapperPipe[End, Mid, Next]): PartialPipe[Input, Next]
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
def
ensuring(cond: (PartialPipe[Input, End]) ⇒ Boolean, msg: ⇒ Any): PartialPipe[Input, End]
- Implicit
- This member is added by an implicit conversion from PartialPipe[Input, End] to Ensuring[PartialPipe[Input, End]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
def
ensuring(cond: (PartialPipe[Input, End]) ⇒ Boolean): PartialPipe[Input, End]
- Implicit
- This member is added by an implicit conversion from PartialPipe[Input, End] to Ensuring[PartialPipe[Input, End]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
def
ensuring(cond: Boolean, msg: ⇒ Any): PartialPipe[Input, End]
- Implicit
- This member is added by an implicit conversion from PartialPipe[Input, End] to Ensuring[PartialPipe[Input, End]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
def
ensuring(cond: Boolean): PartialPipe[Input, End]
- Implicit
- This member is added by an implicit conversion from PartialPipe[Input, End] to Ensuring[PartialPipe[Input, End]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
def
formatted(fmtstr: String): String
- Implicit
- This member is added by an implicit conversion from PartialPipe[Input, End] to StringFormat[PartialPipe[Input, End]] performed by method StringFormat in scala.Predef.
- Definition Classes
- StringFormat
- Annotations
- @inline()
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
-
def
persist(): Unit
This starts/restarts the pipeline.
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
- def ~[Other <: Identifiable[Other]](other: PartialPipe[Input, Other]): PartialPipe[Input, Either[End, Other]]
-
def
→[B](y: B): (PartialPipe[Input, End], B)
- Implicit
- This member is added by an implicit conversion from PartialPipe[Input, End] to ArrowAssoc[PartialPipe[Input, End]] performed by method ArrowAssoc in scala.Predef.
- Definition Classes
- ArrowAssoc