de.linguatools.disco

Class Subword

java.lang.Object

de.linguatools.disco.Subword

public class Subword
extends java.lang.Object

This deals with ngrams stored in a DenseMatrix. ============================================================================= Use fastText fork by GitHub user englhardt, as long as pull request https://github.com/facebookresearch/fastText/pull/289 not merged! =============================================================================

Constructor Summary

Constructors

Constructor and Description
Subword()

Method Summary

Modifier and Type	Method and Description
static float[]	getEmbeddingForOov(java.lang.String oov, DenseMatrix denseMatrix) Compute word embedding for out of vocabulary word.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Subword

public Subword()

Method Detail

getEmbeddingForOov

public static float[] getEmbeddingForOov(java.lang.String oov,
                                         DenseMatrix denseMatrix)

Compute word embedding for out of vocabulary word.

Parameters:

oov - out of vocabulary word

denseMatrix - has to contain subword n-grams.

Returns:

word embedding for out of vocabulary word oov computed as the sum of all n-gram embeddings. In case no n-gram from the oov word can be found in the denseMatrix the return array is all zeroes.