Sentences is a multilingual command line sentence tokenizer. This golang package converts a blob of text into a list of sentences. The ultimate goal is to become one of the fastest and accurate sentence tokenizers with an emphasis on extending it to fit developers' needs.
This project started out as a straight port from NLTK's punkt sentence tokenizer but since the original migration I have made substantial updates to how the tokenizer functions and its performance. I'd be happy to discuss with anyone interested in the struggles with porting a python package to golang.
Any feedback is greatly appreciated.
