AirbyteJSONLoader#
- class langchain_community.document_loaders.airbyte_json.AirbyteJSONLoader(file_path: str | Path)[source]#
Load local Airbyte json files.
Initialize with a file path. This should start with ‘/tmp/airbyte_local/’.
Attributes
Methods
__init__(file_path)Initialize with a file path.
A lazy loader for Documents.
aload()Load data into Document objects.
A lazy loader for Documents.
load()Load data into Document objects.
load_and_split([text_splitter])Load Documents and split into chunks.
- Parameters:
file_path (str | Path)
- __init__(file_path: str | Path)[source]#
Initialize with a file path. This should start with ‘/tmp/airbyte_local/’.
- Parameters:
file_path (str | Path)
- async alazy_load() AsyncIterator[Document]#
A lazy loader for Documents.
- Yields:
the documents.
- Return type:
AsyncIterator[Document]
- async aload() list[Document]#
Load data into Document objects.
- Returns:
the documents.
- Return type:
list[Document]
- lazy_load() Iterator[Document]#
A lazy loader for Documents.
- Yields:
the documents.
- Return type:
Iterator[Document]
- load() List[Document][source]#
Load data into Document objects.
- Returns:
the documents.
- Return type:
List[Document]
- load_and_split(
- text_splitter: TextSplitter | None = None,
Load Documents and split into chunks. Chunks are returned as Documents.
Do not override this method. It should be considered to be deprecated!
- Parameters:
text_splitter (Optional[TextSplitter]) – TextSplitter instance to use for splitting documents. Defaults to RecursiveCharacterTextSplitter.
- Raises:
ImportError – If langchain-text-splitters is not installed and no text_splitter is provided.
- Returns:
List of Documents.
- Return type:
list[Document]
Examples using AirbyteJSONLoader