Chunking Text for Vector Embeddings
Features
- Interactive demo of text chunking
- Examples using LangChain, and Compromise.js
- Perform Character Splitting, Recursive and Document Specific Splitting, or Semantic Splitting
Interactive chunking examples, showing how to use CharacterTextSplitter and RecursiveCharacterTextSplitter from LangChain, as well as how to perform semantic splitting using Compromise.js natural language processing.
See the tutorial here