Secure your code as it's written. Use Snyk Code to scan source code in minutes - no build needed - and fix issues immediately.
def test_tokenize(self):
tokens = fasttext.FastText.tokenize("Hello World")
self.assertEqual(["Hello", "World"], tokens)