To try everything Brilliant has to offer—free—for a full 30 days, visit You’ll also get 20% off an annual premium subscription! Resources: Chunking Notebook: ChromaDB Technical Report: ChromaDB Report Repo: OpenAI Token Visualizer: Greg Kamradt 5 Levels of Text Splitting: Jaccard Index: Chapters: 00:00 - Background on Text Chunking 02:28 - Brilliant! 03:47 - Character Text Splitting 06:28 - Token Text Splitting 10:26 - Recursive Character/Token Splitting 16:07 - Kamradt & Modified Semantic Chunking 20:43 - Cluster Semantic Chunking 24:46 - LLM Semantic Chunking 27:56 - Chunking Metrics & Comparison 30:00 - Overall Findings #ai #programming #datascience This video is sponsored by Brilliant