User Guide

Welcome to the DataChain User Guide! This section provides comprehensive documentation on how to effectively use DataChain's advanced features and capabilities.

• Interacting with Remote Storage - Learn how to connect to and work with various remote storage systems.
• Data Processing Overview - Discover DataChain's specialized data processing features.
  • Delta Processing - Incremental data processing to efficiently handle large datasets that change over time.
  • Error Handling and Retries - Learn how to handle processing errors and selectively reprocess problematic records.
• Environment Variables - Configure DataChain's behavior using environment variables.
• Namespaces - Learn more about namespaces and projects.
• Local DB Migrations - Learn how to handle local DB migrations after upgrading datachain.