Ability to (easily) disable sentence splitter

[graus]

Given the max n-gram param, we should be able to disable sentence splitting (which is in place to avoid extracting infinitely long n-grams), which could be useful for parsing Chinese Wikipedia's and whatnot.

[larsmans]

Actually the sentence splitter is there to not generate cross-sentence n-grams. But I don't know how much of a problem those are. N-gram length is bounded anyway.