edu.berkeley.nlp.lm.io
Class FirstPassCallback<V extends LongRepresentable<V>>

java.lang.Object
  extended by edu.berkeley.nlp.lm.io.FirstPassCallback<V>
Type Parameters:
V - Value type
All Implemented Interfaces:
ArpaLmReaderCallback<V>, LmReaderCallback<V>, NgramOrderedLmReaderCallback<V>

public final class FirstPassCallback<V extends LongRepresentable<V>>
extends Object
implements ArpaLmReaderCallback<V>

Reader callback which adds n-grams to an NgramMap

Author:
adampauls

Constructor Summary
FirstPassCallback(boolean reverse)
           
 
Method Summary
 void call(int[] ngram, int startPos, int endPos, V v, String words)
          Called for each n-gram
 void cleanup()
          Called once all reading is done.
 long[] getNumNgramsForEachOrder()
           
 LongArray[] getNumNgramsForEachWord()
           
 LongToIntHashMap getValueCounter()
           
 void handleNgramOrderFinished(int order)
          Called when all n-grams of a given order are finished
 void handleNgramOrderStarted(int order)
          Called when n-grams of a given order are started
 void initWithLengths(List<Long> numNGrams)
          Called initially with a list of how many n-grams will appear for each order.
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

FirstPassCallback

public FirstPassCallback(boolean reverse)
Method Detail

call

public void call(int[] ngram,
                 int startPos,
                 int endPos,
                 V v,
                 String words)
Description copied from interface: LmReaderCallback
Called for each n-gram

Specified by:
call in interface LmReaderCallback<V extends LongRepresentable<V>>
Parameters:
ngram - The integer representation of the words as given by the provided WordIndexer
v - The value of the n-gram
words - The string representation of the n-gram (space separated)

handleNgramOrderFinished

public void handleNgramOrderFinished(int order)
Description copied from interface: NgramOrderedLmReaderCallback
Called when all n-grams of a given order are finished

Specified by:
handleNgramOrderFinished in interface NgramOrderedLmReaderCallback<V extends LongRepresentable<V>>

cleanup

public void cleanup()
Description copied from interface: LmReaderCallback
Called once all reading is done.

Specified by:
cleanup in interface LmReaderCallback<V extends LongRepresentable<V>>

getValueCounter

public LongToIntHashMap getValueCounter()

initWithLengths

public void initWithLengths(List<Long> numNGrams)
Description copied from interface: ArpaLmReaderCallback
Called initially with a list of how many n-grams will appear for each order.

Specified by:
initWithLengths in interface ArpaLmReaderCallback<V extends LongRepresentable<V>>
Parameters:
numNGrams - maps n-gram orders to number of n-grams (i.e. numNGrams.get(0) is the number of unigrams)

getNumNgramsForEachWord

public LongArray[] getNumNgramsForEachWord()

getNumNgramsForEachOrder

public long[] getNumNgramsForEachOrder()

handleNgramOrderStarted

public void handleNgramOrderStarted(int order)
Description copied from interface: NgramOrderedLmReaderCallback
Called when n-grams of a given order are started

Specified by:
handleNgramOrderStarted in interface NgramOrderedLmReaderCallback<V extends LongRepresentable<V>>