How to use the ginza.__init__.Japanese function in ginza
To help you get started, we’ve selected a few ginza examples, based on popular ways it is used in public projects.
Secure your code as it's written. Use Snyk Code to scan source code in minutes - no build needed - and fix issues immediately.
megagonlabs / ginza / ginza / __init__.py View on Github 
class Japanese(Language):
lang = "ja"
Defaults = JapaneseDefaults
Tokenizer = SudachiTokenizer
def make_doc(self, text):
return self.tokenizer(text)
def pickle_japanese(instance):
return Japanese, tuple()
copy_reg.pickle(Japanese, pickle_japanese)
__all__ = [
'Japanese',
]def pickle_japanese(instance):
return Japanese, tuple()ginza
GiNZA, An Open Source Japanese NLP Library, based on Universal Dependencies
