split_text_to_chunks

split_text_to_chunks(
    text: str,
    max_tokens: int = 4000,
    chunk_mode: str = 'multi_lines',
    must_break_at_empty_line: bool = True,
    overlap: int = 0
) -> 

Split a long text into chunks of max_tokens.

Parameters:
NameDescription
textType: str
max_tokensType: int

Default: 4000
chunk_modeType: str

Default: ‘multi_lines’
must_break_at_empty_lineType: bool

Default: True
overlapType: int

Default: 0