Release DataFusion 37.0.0 about arrow-datafusion HOT 19 CLOSED

I think we are now ready to go: the RC has been approved and 72 hours has elapsed.

https://lists.apache.org/thread/mzjt0l4tzkm3y7hxsv8lk35x0xxq1q5b

If @andygrove doesn't get a chance to publish to crates.io I can do it later today

from arrow-datafusion.

Something else we may want to wait for is backwards compatible write configuration options

• #9575 (I think @tinfoil-knight is working on this)
• whatever fallout is needed to avoid format. prefix after #9604 (I am not sure there is a ticket tracking this yet)

cc @metesynnada and @ozankabak and @devinjdangelo

from arrow-datafusion.

The release is available here:
https://dist.apache.org/repos/dist/release/arrow/arrow-datafusion-37.0.0

The release has also been published to crates.io:
https://crates.io/crates/datafusion/37.0.0

Thank you all for your help!

Andrew

from arrow-datafusion.

I think we should hold this release for two regression bugs:

1. #9586
2. #9678

I expect solutions to both by the end of day today

from arrow-datafusion.

Any chance of including #9613? Seems desirable for DataFusion to tightly follow the latest arrow-rs dependencies.

It makes sense to me. I'll go and get that PR ready for merge now

Update: merged

from arrow-datafusion.

I have added the list of things I think we should wait on to the description of this ticket

from arrow-datafusion.

EPIC!

from arrow-datafusion.

Any chance of including #9613? Seems desirable for DataFusion to tightly follow the latest arrow-rs dependencies.

from arrow-datafusion.

@wiedld has a PR up to fix #9678 ( #9685)

from arrow-datafusion.

I believe all outstanding items from my perspective are complete

from arrow-datafusion.

@andygrove unless you or someone else does it first, I plan to make a release candidate tomorrow, Friday March 29. 2024

from arrow-datafusion.

Vote thread is up: https://lists.apache.org/thread/lwdflob72q7t7mqqxnqcobjzqjbc218o

from arrow-datafusion.

@wiedld has found another regression in 37.0.0: #9870 (see details in #9870 (comment))

Update: I reviewed the PR to fix it #9871 and it looks good to go to me

from arrow-datafusion.

Update: I reviewed the PR to fix it #9871 and it looks good to go to me

Has been merged

from arrow-datafusion.

RC2 voting thread: https://lists.apache.org/thread/mzjt0l4tzkm3y7hxsv8lk35x0xxq1q5b

from arrow-datafusion.

Are we still planning to release 37.0.0?

from arrow-datafusion.

I made some small improvements based on my experience this time, but otherwise I think this is now done

1. #9955
2. #9956

from arrow-datafusion.

BTW we are making a 37.1.0 release -- see #9904

from arrow-datafusion.

Note the failing CI test (security_audit) is explained here #10128 (comment).

from arrow-datafusion.