Packages

class IDFModel extends Serializable

Represents an IDF model that can transform term frequency vectors.

Annotations
@Since("1.1.0")
Linear Supertypes
Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. IDFModel
  2. Serializable
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  6. val docFreq: Array[Long]
    Annotations
    @Since("3.0.0")
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  10. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. val idf: Vector
    Annotations
    @Since("1.1.0")
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. val numDocs: Long
    Annotations
    @Since("3.0.0")
  18. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. def transform(dataset: JavaRDD[Vector]): JavaRDD[Vector]

    Transforms term frequency (TF) vectors to TF-IDF vectors (Java version).

    Transforms term frequency (TF) vectors to TF-IDF vectors (Java version).

    dataset

    a JavaRDD of term frequency vectors

    returns

    a JavaRDD of TF-IDF vectors

    Annotations
    @Since("1.1.0")
  21. def transform(v: Vector): Vector

    Transforms a term frequency (TF) vector to a TF-IDF vector

    Transforms a term frequency (TF) vector to a TF-IDF vector

    v

    a term frequency vector

    returns

    a TF-IDF vector

    Annotations
    @Since("1.3.0")
  22. def transform(dataset: RDD[Vector]): RDD[Vector]

    Transforms term frequency (TF) vectors to TF-IDF vectors.

    Transforms term frequency (TF) vectors to TF-IDF vectors.

    If minDocFreq was set for the IDF calculation, the terms which occur in fewer than minDocFreq documents will have an entry of 0.

    dataset

    an RDD of term frequency vectors

    returns

    an RDD of TF-IDF vectors

    Annotations
    @Since("1.1.0")
  23. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  24. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  25. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped