gnes.indexer.doc.leveldb module

class gnes.indexer.doc.leveldb.AsyncLVDBIndexer(data_path, keep_na_doc=True, drop_raw_bytes=False, drop_chunk_blob=False, *args, **kwargs)

Bases: gnes.indexer.doc.leveldb.LVDBIndexer

add(keys, docs, *args, **kwargs)

adding new docs and their protobuf representation

Parameters:

• keys (List[int]) – list of doc_id
• docs (List[Document]) – list of protobuf Document objects

close()

Release the resources as model is destroyed

post_init()

Declare class attributes/members that can not be serialized in standard way

query(*args, **kwargs)

Return type:List[Any]

train(*args, **kwargs)

Train the model, need to be overrided

class gnes.indexer.doc.leveldb.LVDBIndexer(data_path, keep_na_doc=True, drop_raw_bytes=False, drop_chunk_blob=False, *args, **kwargs)

Bases: gnes.indexer.base.BaseDocIndexer

add(keys, docs, *args, **kwargs)

adding new docs and their protobuf representation

Parameters:

• keys (List[int]) – list of doc_id
• docs (List[Document]) – list of protobuf Document objects

close()

Release the resources as model is destroyed

post_init()

Declare class attributes/members that can not be serialized in standard way

query(keys, *args, **kwargs)

Return type:List[Document]

train(*args, **kwargs)

Train the model, need to be overrided