class ThinActorReducerPlatform[Input <: Identifiable[Input], Output <: Identifiable[Output]] extends ThinActorUnaryPlatform[Input, Output]
- Alphabetic
- By Inheritance
- ThinActorReducerPlatform
- ThinActorUnaryPlatform
- UnaryPlatform
- UnaryChecker
- OutputStoreChecker
- InputStoreChecker
- ConfigChecker
- Platform
- AnyRef
- Any
- by any2stringadd
- by StringFormat
- by Ensuring
- by ArrowAssoc
- Hide All
- Show All
- Public
- All
Instance Constructors
- new ThinActorReducerPlatform(name: String = ...)
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
def
+(other: String): String
- Implicit
- This member is added by an implicit conversion from ThinActorReducerPlatform[Input, Output] to any2stringadd[ThinActorReducerPlatform[Input, Output]] performed by method any2stringadd in scala.Predef.
- Definition Classes
- any2stringadd
-
def
->[B](y: B): (ThinActorReducerPlatform[Input, Output], B)
- Implicit
- This member is added by an implicit conversion from ThinActorReducerPlatform[Input, Output] to ArrowAssoc[ThinActorReducerPlatform[Input, Output]] performed by method ArrowAssoc in scala.Predef.
- Definition Classes
- ArrowAssoc
- Annotations
- @inline()
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
var
actorRefOpt: Option[ActorRef]
- Definition Classes
- ThinActorUnaryPlatform
-
implicit
val
actorSystem: ActorSystem
- Definition Classes
- ThinActorUnaryPlatform
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
check(conf: PipeConfig, inputMap: DataStore[Input], outputMap: DataStore[Output]): Unit
Check routine for unary data processors
Check routine for unary data processors
- conf
the config file to check
- inputMap
the input store to check
- outputMap
the output store to check
- Definition Classes
- UnaryChecker
-
def
checkConfig(conf: PipeConfig): Unit
Check that paths in configuration file relevant to host class are well-formed.
Check that paths in configuration file relevant to host class are well-formed. Default does nothing.
- conf
the config file to check
- Definition Classes
- ConfigChecker
-
def
checkInput(inputMap: DataStore[Input]): Unit
Check that input store is compatible with the host class.
Check that input store is compatible with the host class. Default does nothing.
- inputMap
the input store to check
- Definition Classes
- InputStoreChecker
-
def
checkOutput(outputMap: DataStore[Output]): Unit
Check that output store is compatible with the host class.
Check that output store is compatible with the host class. Default does nothing.
- outputMap
the output store to check
- Definition Classes
- OutputStoreChecker
-
def
clone(): AnyRef
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
var
computationOpt: Option[Computation]
What computation this platform ends up running.
What computation this platform ends up running. (Mapper, Reducer, PairwiseComposer) This ends up being set in init() by both UnaryPlatform and BinaryPlatform.
- Definition Classes
- Platform
-
def
ensuring(cond: (ThinActorReducerPlatform[Input, Output]) ⇒ Boolean, msg: ⇒ Any): ThinActorReducerPlatform[Input, Output]
- Implicit
- This member is added by an implicit conversion from ThinActorReducerPlatform[Input, Output] to Ensuring[ThinActorReducerPlatform[Input, Output]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
def
ensuring(cond: (ThinActorReducerPlatform[Input, Output]) ⇒ Boolean): ThinActorReducerPlatform[Input, Output]
- Implicit
- This member is added by an implicit conversion from ThinActorReducerPlatform[Input, Output] to Ensuring[ThinActorReducerPlatform[Input, Output]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
def
ensuring(cond: Boolean, msg: ⇒ Any): ThinActorReducerPlatform[Input, Output]
- Implicit
- This member is added by an implicit conversion from ThinActorReducerPlatform[Input, Output] to Ensuring[ThinActorReducerPlatform[Input, Output]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
def
ensuring(cond: Boolean): ThinActorReducerPlatform[Input, Output]
- Implicit
- This member is added by an implicit conversion from ThinActorReducerPlatform[Input, Output] to Ensuring[ThinActorReducerPlatform[Input, Output]] performed by method Ensuring in scala.Predef.
- Definition Classes
- Ensuring
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
var
errorCuratorOpt: Option[ErrorCurator[Input]]
- Definition Classes
- UnaryPlatform
-
def
finalize(): Unit
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
def
formatted(fmtstr: String): String
- Implicit
- This member is added by an implicit conversion from ThinActorReducerPlatform[Input, Output] to StringFormat[ThinActorReducerPlatform[Input, Output]] performed by method StringFormat in scala.Predef.
- Definition Classes
- StringFormat
- Annotations
- @inline()
-
def
getActor(): ActorRef
- Definition Classes
- ThinActorUnaryPlatform
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
-
def
getErrorCurator(): ErrorCurator[Input]
- Definition Classes
- UnaryPlatform
-
def
getInputMap(): DataStore[Input]
- Definition Classes
- UnaryPlatform
-
def
getInputs(): Seq[Input]
- Definition Classes
- UnaryPlatform
-
def
getOutputMap(): DataStore[Output]
- Definition Classes
- UnaryPlatform
-
def
getProvenanceCurator(): ProvenanceCurator[Input, Output]
- Definition Classes
- UnaryPlatform
-
def
getUpstreamConnector(): Connector[Input]
- Definition Classes
- UnaryPlatform
-
def
getVersionCurator(): VersionCurator[Output]
- Definition Classes
- UnaryPlatform
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
-
def
init(conf: PipeConfig, inputMap: DataStore[Input], outputMap: DataStore[Output], builder: PlatformBuilder): Unit
This sets up the platform by connecting the Input Map and Output Map to the platform, as well as any other initialization that needs to be done.
This sets up the platform by connecting the Input Map and Output Map to the platform, as well as any other initialization that needs to be done. In the case of the example, we use bigglue.platforms.instances.bigactors.BigActorUnaryPlatform.init This calls initConnector as well.
- conf
The configuration file needed to initialize.
- inputMap
The Map that data gets sent in from.
- outputMap
The Map that data gets sent out to.
- builder
The builder that created the platform. This was called with bigglue.computations.Mapper.init or bigglue.computations.Reducer.init
- Definition Classes
- ThinActorUnaryPlatform → UnaryPlatform
-
def
initConnector(conf: PipeConfig, builder: PlatformBuilder): Unit
This sets up the connector that sends data down the pipeline.
This sets up the connector that sends data down the pipeline. This initializes the connector with Connector.init, and then adds the platform to the connector with Connector.registerPlatform. As a default, we use bigglue.connectors.instances.IncrTrackerJobQueue.
- conf
The configuration file needed to initialize.
- builder
The builder that created the platform. This was called with bigglue.computations.Mapper.init or bigglue.computations.Reducer.init
- Definition Classes
- ThinActorUnaryPlatform → UnaryPlatform
-
var
inputMapOpt: Option[DataStore[Input]]
- Definition Classes
- UnaryPlatform
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
-
var
outputMapOpt: Option[DataStore[Output]]
- Definition Classes
- UnaryPlatform
-
def
persist(): Unit
This is called by the computation's persist step.
This is called by the computation's persist step. In particular, this tends to see how much of the data set actually needs to be re-sent. As of right now, it sends the entirety of the input map to the upstream connector, which handles which things to send/re-send down the pipeline, unless there is a reducer with nothing in the input file, or if there is nothing in the output file. If there is nothing in the output file, the program assumes that a new data store has been created and sends down all data.
- Definition Classes
- UnaryPlatform → Platform
-
var
provenanceCuratorOpt: Option[ProvenanceCurator[Input, Output]]
- Definition Classes
- UnaryPlatform
-
def
run(): Unit
- Definition Classes
- Platform
-
def
setComputation(computation: Computation): Platform
This ends up being called in the init step of the Mapper, Reducer, or PairwiseComposer This links the actual computation and platform together.
This ends up being called in the init step of the Mapper, Reducer, or PairwiseComposer This links the actual computation and platform together.
- computation
The computation that is linked with the platform. (This is usually called through platform.setComputation(this))
- Definition Classes
- Platform
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
terminate(): Unit
- Definition Classes
- ThinActorUnaryPlatform → Platform
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
def
updatedVersion(ver: Option[String]): Boolean
- Definition Classes
- UnaryPlatform
-
var
upstreamConnectorOpt: Option[Connector[Input]]
- Definition Classes
- UnaryPlatform
-
var
versionCuratorOpt: Option[VersionCurator[Output]]
- Definition Classes
- UnaryPlatform
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
def
wake(): Unit
This function is called when the upstream connector lets the platform know that there's data to be computed.
This function is called when the upstream connector lets the platform know that there's data to be computed.
- Definition Classes
- ThinActorUnaryPlatform → Platform
-
def
→[B](y: B): (ThinActorReducerPlatform[Input, Output], B)
- Implicit
- This member is added by an implicit conversion from ThinActorReducerPlatform[Input, Output] to ArrowAssoc[ThinActorReducerPlatform[Input, Output]] performed by method ArrowAssoc in scala.Predef.
- Definition Classes
- ArrowAssoc