abstract class DataStore[Data] extends Upstream[Data] with ConfigChecker with ConfigBuildsDataStore
The Data Store is an abstraction for how you store your data in BigGlue. Within Data Stores, you have DataMap, DataMultiMap, and DataQueue from a list of most useful to least useful within BigGlue. Within the example, all of the data stores are bigglue.store.instances.solr.SolrDataMaps.
- Data
The type of the data that is intended to be put into the data store. In this case, it's bigglue.examples.GitID for gitID, bigglue.examples.GitRepo for clonedMap, bigglue.examples.GitCommitInfo for commitInfoMap, and bigglue.examples.GitCommitGroups for authorMap.
- Alphabetic
- By Inheritance
- DataStore
- ConfigBuildsDataStore
- ConfigBuilds
- ConfigChecker
- Upstream
- AnyRef
- Any
- by any2stringadd
- by StringFormat
- by Ensuring
- by ArrowAssoc
- Hide All
- Show All
- Public
- All
Instance Constructors
- new DataStore()
Abstract Value Members
-
abstract
def
all(): Seq[Data]
This gets everything from the data store.
This gets everything from the data store.
- returns
Every document that is stored in the data store.
- abstract def extract(): Seq[Data]
-
abstract
def
iterator(): Iterator[Data]
This returns an iterator that iterates over the data store.
This returns an iterator that iterates over the data store.
- returns
An iterator that iterates over the data store until all documents have been processed.
-
abstract
def
put_(data: Seq[Data]): Unit
This actually puts the data into the data store.
This actually puts the data into the data store.
- data
The data to be put into the data store.
- abstract def size(): Int
Concrete Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
- def +(other: String): String
- def ->[B](y: B): (DataStore[Data], B)
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- def add(data: Data): Unit
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
checkConfig(conf: PipeConfig): Unit
Check that paths in configuration file relevant to host class are well-formed.
Check that paths in configuration file relevant to host class are well-formed. Default does nothing.
- conf
the config file to check
- Definition Classes
- ConfigChecker
-
def
clone(): AnyRef
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
val
configOpt: Option[PipeConfig]
- Definition Classes
- ConfigBuilds
-
def
constructBuilder(config: PipeConfig): DataStoreBuilder
- Definition Classes
- ConfigBuildsDataStore → ConfigBuilds
- def displayName(): String
-
val
downstreamConnectors: Seq[Connector[Data]]
- Definition Classes
- Upstream
- def ensuring(cond: (DataStore[Data]) ⇒ Boolean, msg: ⇒ Any): DataStore[Data]
- def ensuring(cond: (DataStore[Data]) ⇒ Boolean): DataStore[Data]
- def ensuring(cond: Boolean, msg: ⇒ Any): DataStore[Data]
- def ensuring(cond: Boolean): DataStore[Data]
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
- def formatted(fmtstr: String): String
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
-
def
getConfig(config: PipeConfig): PipeConfig
- Definition Classes
- ConfigBuilds
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- def init(conf: PipeConfig): Unit
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- var name: String
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- def put(data: Data): Unit
-
def
put(data: Seq[Data]): Unit
This puts the data into the data store using put_, and then sends the data down the pipeline if the data store is connected to the pipeline.
This puts the data into the data store using put_, and then sends the data down the pipeline if the data store is connected to the pipeline.
- data
The data that needs to be put into the data store.
-
def
registerConnector(connector: Connector[Data]): Unit
- Definition Classes
- Upstream
-
def
setConfig(pipeConfig: PipeConfig): Unit
- Definition Classes
- ConfigBuilds
- def setName(newName: String): Unit
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
- def terminate(): Unit
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
def
transmitDownstream(data: Data): Unit
- Definition Classes
- Upstream
-
def
transmitDownstream(data: Seq[Data]): Unit
- Definition Classes
- Upstream
-
def
transmitDownstreamModified(data: Data): Unit
- Definition Classes
- Upstream
-
def
transmitDownstreamModified(data: Seq[Data]): Unit
- Definition Classes
- Upstream
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
- def →[B](y: B): (DataStore[Data], B)