Skip to main content

Sources JSON file

Current schema: v3

(Applies to dbt v2.0 and later)

Produced by: dbt freshness (when sources are included in the run)

This file contains information about sources with freshness checks. dbt uses this file to power its Source Freshness visualization.

(Applies to dbt v2.0 and later)

sources.json is a legacy artifact that contains freshness results for sources only. For results that includes both sources and models in one file, use freshness.json. If a dbt freshness run checks only models and no sources are included, dbt does not overwrite sources.json.

Top-level keys​

  • metadata
  • elapsed_time: Total invocation time in seconds.
  • results: Array of freshness-check execution details.

Each entry in results is a dictionary with the following keys:

  • unique_id: Unique source node identifier, which map results to sources in the manifest
  • max_loaded_at: Max value of loaded_at_field timestamp in the source table when queried.
  • snapshotted_at: Current timestamp when querying.
  • max_loaded_at_time_ago_in_s: Interval between max_loaded_at and snapshotted_at, calculated in python to handle timezone complexity.
  • criteria: The freshness threshold(s) for this source, defined in the project.
  • status: The freshness status of this source, based on max_loaded_at_time_ago_in_s + criteria, reported on the CLI. One of pass, warn, or error if the query succeeds, runtime error if the query fails.
  • execution_time: Total time spent checking freshness for this source
  • timing: Array that breaks down execution time into steps (compile + execute)
  • adapter_response: Dictionary of metadata returned from the database, which varies by adapter. For example, success code, number of rows_affected, total bytes_processed, and so on. Not applicable for data tests.
    • rows_affected returns the number of rows modified by the last statement executed. In cases where the query's row count can't be determined or isn't applicable (such as when creating a view), a standard value of -1 is returned for rowcount.

Was this page helpful?

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

0
Loading