o

bigglue.examples

mockfixrexample

object mockfixrexample

This is the actual code for the simple example. It first gets the configuration file with PipeConfig.newConfig Then, it creates a few SolrDataMaps to put the data in within each step. To start, it also puts in a Git ID into gitID for the sake of having a starting point for the example. Then, with gitID:--Clone()-->clonedMap:--CommitExtraction()-->commitInfoMap:-+FindAuthor()+->authorMap, it creates this: bigglue.pipes.ReducerPipe(bigglue.pipes.MapperPipe(bigglue.pipes.MapperPipe(bigglue.pipes.Implicits.DataNode(gitID), Clone(), bigglue.pipes.Implicits.DataNode(clonedMap)), CommitExtraction(), bigglue.pipes.Implicits.DataNode(commitInfoMap)), FindAuthor(), bigglue.pipes.Implicits.DataNode(authorMap)) Then, with a pipe, we run bigglue.pipes.Pipe.check and bigglue.pipes.Pipe.init to initialize the pipeline. Finally, we run bigglue.pipes.Pipe.persist to start/resume the pipeline.

Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. mockfixrexample
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def IStringToGitID(i: I[String]): GitID

    This is literally just a serialization thing done here just so we have some sort of data to work with.

    This is literally just a serialization thing done here just so we have some sort of data to work with.

    i

    The string of the User and Github Repo

    returns

    A GitID from i.

  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. def main(args: Array[String]): Unit

    Configuration File in resources/application.conf

  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
  17. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  18. def toString(): String
    Definition Classes
    AnyRef → Any
  19. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped