tokenization (Q2438971)
breaking a stream of text up into chunks for analysis or further processing
Language:
other details
aliases tokenisation
description breaking a stream of text up into chunks for analysis or further processing

External Links