retrieve_utils
autogen.retrieve_utils.get_files_from_dir
get_files_from_dir
Return a list of all the files in a given directory, a url, a file path or a list of them.
Parameters:Name | Description |
---|---|
dir_path | Type: str | list[str] |
types | Type: list Default: [‘txt’, ‘json’, ‘csv’, ‘tsv’, ‘md’, ‘html’, ‘htm’, ‘rtf’, ‘rst’, ‘jsonl’, ‘log’, ‘xml’, ‘yaml’, ‘yml’, ‘pdf’, ‘mdx’] |
recursive | Type: bool Default: True |