elementary.schema_changes_from_baseline Test Fails for Certain Source Tables about elementary HOT 5 CLOSED

Hi @ahmedhamidibr !
Thanks for posting this issue and sorry for the late response.

Is this issue still relevant to you?
If so - one question - any chance your project overrides the source macro?

from elementary.

Hi @haritamar,

Yes, indeed, my project overrides the source macro. It turns out that was the cause. After resetting back to the default source macro, it worked as expected. However, I remain interested in any workaround you might suggest to ensure the tests continue to work even when the source macro is overridden.

from elementary.

Hi @ahmedhamidibr ,
So the main issue is that for the schema_changes_from_baseline test to work, Elementary needs to ontain a dbt Relation object which allows us to get the current columns of the table.
When you override the source macro (or ref for that matter), you have the ability to return a query string instead of a relation object - which works for many dbt use-cases but is problematic for Elementary's tests due to the reason above.

So there are two workarounds that can be done until we support this use case, depending on what exactly your overriding source macro does:

• If it's possible to change your macro to return a dbt Relation object instead of a string (here's a dbt example for the ref macro, but a similar thing can be done for sources) then it should help solve the issue. This may be doable if your macro returns a database table (and not a select query).
• If on the other hand you actually return a query (e.g. if you're doing some filtering), then a possible (hacky) workaround would be to make the macro only return a Relation object when it's run from the context of the schema_changes_from_baseline test, e.g.:

{% set model_node = context.get("model") %}
{% if model_node and model_node.get("resource_type") == "test" and model_node["test_metadata"]["name"] == "schema_changes_from_baseline" %}
    {% do return(builtins.source(source_name, table_name)) %}
{% endif %}

... do more complex logic that returns a query ...

from elementary.

@haritamar Thank you so much, this did the trick!

from elementary.

Glad to hear @ahmedhamidibr !

from elementary.