tokens_serialize.RdCreates a serialized object of tokens, called by tokens.
tokens_serialize(x, types_reserved = NULL, ...)
| x | a list of character vectors |
|---|---|
| types_reserved | optional pre-existing types for mapping of tokens |
| ... | additional arguments |
a list the serialized tokens found in each text