Class

org.tresamigos.smv.dqm

DQMState

Related Doc: package dqm

Permalink

class DQMState extends Serializable

DQMState keeps tracking of org.tresamigos.smv.dqm.DQMTask behavior on a DF

Since the logs are implemented with Aggregators, it need a SparkContext to construct. A list of DQMRule names and a list of DQMFix names are needed also.

Linear Supertypes
Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DQMState
  2. Serializable
  3. Serializable
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DQMState(sc: SparkContext, ruleNames: Seq[String], fixNames: Seq[String])

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  9. def getAllLog(): Seq[String]

    Permalink

    return all the example failed records from all the rules

  10. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  11. def getFixCount(name: String): Int

    Permalink

    for the fix with the given name, return the time it is triggered

  12. def getParserCount(): Int

    Permalink

    get the total parser fail count

  13. def getParserLog(): Seq[String]

    Permalink

    get the example parser fails

  14. def getRecCount(): Long

    Permalink

    get the overall record count

  15. def getRuleCount(name: String): Int

    Permalink

    for the rule with the given name, return the time it is triggered

  16. def getRuleLog(name: String): Seq[String]

    Permalink

    for the rule with the given name, return the example failed records

  17. def getTaskCount(name: String): Int

    Permalink

    for the rule or fix with the given name, return the time it is triggered

  18. def getTotalFixCount(): Int

    Permalink

    return the total number of times fixes get triggered

  19. def getTotalRuleCount(): Int

    Permalink

    return the total number of times rules get triggered

  20. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  21. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  22. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  23. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  24. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  25. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  26. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  27. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  28. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  29. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped