Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Materialize the dependencies both-ways
    Tdependent@ds=1 depends on T@ds=1/hr=1 to T@ds=1/hr=24
    T@ds=1/hr=1 is depended upon by T@ds=1
    Advantages: if T@ds=1/hr=1 is dropped, T@ds=1 can be notified or it can choose to dis-allow this
    Any property on Tdependent can be propagated to T
    • Is the dependency used for querying ? What happens if T@ds=1/hr=25 gets added ? The query 'select .. from Tdependent where ds = 1' includes T@ds=1/hr=25, but this is not shown in the inputs.
  • Store partial dependencies
    Tdependent@ds=1 depends on T@ds=1 (spec).
    At describe time, the spec is evaluated and all the dependent partitions are computed dynamically. At add partition time, verify that the location captures all dependent partitions.
    The partial spec is not used for querying - location is used for that. At query time, verify that the location captures all dependent partitions.