Comments (9)
Thanks @gruuya 🥳
from arrow-datafusion.
FYI @gruuya
from arrow-datafusion.
Thanks @Dandandan; I've encountered that problem originally and (I thought I) resolved it by removing -ti from the tpch_dbgen docker command, after which the thing worked on our fork.
Will investigate more.
from arrow-datafusion.
It's weird that the exact same workflow works on our fork, but not here; seems to suggest a difference in some settings?
Fwiw, I inspected the setup and it seems to be using the identical os/runner/image etc versions.
Either way I opened #9626 as a potential workaround, except I can't really guarantee it works now (the command fails becuase it's still using the version from the main in the action).
from arrow-datafusion.
Thanks @gruuya that worked 🎉
The next failure is a missing file
#9593 (comment)
from arrow-datafusion.
Hmm, that's another weird one, where GHA obviously has the adequate env var but somehow the script invocation doesn't.
My best guess is that this is because the immediately preceding step (where the env vars were generated) was run in a different shell now, and so GHA somehow hasn't propagated the env vars yet to the first step (but it does to the subsequent ones).
Anyway, I've opened another potential mitigation here: #9632
Thanks for the patience!
from arrow-datafusion.
That didn't resolve it yet :)
#9593 (comment)
from arrow-datafusion.
Ok, third time's the charm: #9636 🤞🏻
from arrow-datafusion.
I'm glad to see it working now, though I'm not that happy with the finicky nature of the development process, courtesy of GHA idiosyncrasies.
I've noted down a potential improvement to the trial-and-error dev approach here: #9638
from arrow-datafusion.
Related Issues (20)
- Convert `Min` and `Max` to UDAF HOT 3
- Convert `Hyperloglog` to UDAF HOT 3
- Support extracting Float{16, 32, 64} statistics from Parquet Data Pages
- Support extracting UInt{8, 16, 32, 64} statistics from Parquet Data Pages HOT 1
- DataFusion weekly project plan (Andrew Lamb) - June 17, 2024 HOT 2
- Timezone `UTC` is not considered equal to `+00:00` HOT 6
- Create a branch for StringView / BinaryView development HOT 1
- Change `StatisticsConverter::row_group_counts` to return `None` for non existent columns in parquet files HOT 1
- Complete Possible Join Type Handling for EmptyRelation Propagation Rule HOT 12
- Presentation about DataFusion at Microsoft GSL (Gray Systems Lab) HOT 2
- Conditionally allow to keep partition_by columns when using PARTITIONED BY HOT 3
- Inconsistent behavior in HashJoin Projections HOT 2
- regen.sh is failing in Ubuntu when working with recommended version of protoc HOT 2
- Implement `DynamicTableProvider` in DataFusion Core HOT 4
- Open Variant Type for semi-structured data HOT 2
- push down unnest filter only on non-unnest column HOT 4
- 'common_sub_expression_eliminate' failed on unnested structs field HOT 2
- Implement equality = and inequality <> support for `BinaryView` HOT 3
- Improve filter predicates with `Utf8View` literals
- Convert `ArrayAgg` to UDAF HOT 13
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arrow-datafusion.