This Dataform project processes various marketing data sources and creates a Marketing Data Store (MDS) to be used in several use cases: a)retain historical marketing data; b)create high performance dashboards; c)perform Data Analytics explorations.
Reviewing the examples in the repository, I noticed there's no instance of managing schema changes for incremental data loading.
To elaborate, if columns are added or removed in the source table and these changes need to be mirrored in the target tables, it's straightforward when dealing with full data loads and recreating the target table each time. However, how would one address this in the context of incremental data loads, where historical data preservation is crucial?