modbot.preprocessing.my_tokenizer

modbot.preprocessing.my_tokenizer(s)[source]

Tokenize string

Parameters: s (str) – String containing message
Returns: List containing tokens
Return type: list