Configure the dataset backend
Arguments
- crawler
A Crawler.
- backend
One of
"memory"(default),"jsonl","duckdb".- path
File (jsonl) or database (duckdb) path; required for the persistent backends.
- table
Table name for the
"duckdb"backend.
Configure the dataset backend
A Crawler.
One of "memory" (default), "jsonl", "duckdb".
File (jsonl) or database (duckdb) path; required for the persistent backends.
Table name for the "duckdb" backend.