pysummarization.vectorizabletoken.thotvectorizer package

Submodules

pysummarization.vectorizabletoken.thotvectorizer.dbm_t_hot_vectorizer module

class pysummarization.vectorizabletoken.thotvectorizer.dbm_t_hot_vectorizer.DBMTHotVectorizer(token_list)

Bases: pysummarization.vectorizabletoken.t_hot_vectorizer.THotVectorizer

Vectorize token by t-hot Vectorizer.

This class outputs the dimension reduced vectors with Deep Boltzmann Machines as a Stacked Auto Encoder.

computable_distance

getter

dbm

getter

get_computable_distance()

getter

get_dbm()

getter

pre_learn(hidden_n=100, training_count=1000, batch_size=10, learning_rate=1e-05, dbm=None)

set_computable_distance(value)

setter

set_dbm(value)

setter

tokenize(vector_list)

Tokenize vector.

Parameters:vector_list – The list of vector of one token. Returns:token

vectorize(token_list)

Tokenize token list.

Parameters:token_list – The list of tokens. Returns:[vector of token, vector of token, vector of token, …]

Module contents