Comments (5)
I got 28GB after cargo clean
and cargo t
on macbook
![Screenshot 2024-06-25 at 5 23 02 PM](https://private-user-images.githubusercontent.com/15869383/342665544-3e7df559-af17-4e4a-acae-ca5872ceb56f.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk2NDkzNTMsIm5iZiI6MTcxOTY0OTA1MywicGF0aCI6Ii8xNTg2OTM4My8zNDI2NjU1NDQtM2U3ZGY1NTktYWYxNy00ZTRhLWFjYWUtY2E1ODcyY2ViNTZmLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI5VDA4MTczM1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWEwMTljMTg1ZjZhMjQzNmZlNTI4MTI1NGNiNmUwNGM4NmMwODQzMjFjODc0ZmM2NmYyNDY1OGZkY2JmYzRkYTUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.E8vEwHu_z4dD7YaasJVdFH6N5_qssUlJI2UGYjkLZ24)
from datafusion.
On Ubuntu,
$ lsb_release -rc
Release: 22.04
Codename: jammy
After cargo clean
and running cargo t
:
$ du -h -d2 target
4.0K target/tmp
6.1G target/debug/incremental
12M target/debug/.fingerprint
337M target/debug/build
16G target/debug/deps
28G target/debug/examples
50G target/debug
50G target
from datafusion.
Yeah, I think this obscene use of temp space is an artifact of rust (rather than an artifact of datafusion specifically)
from datafusion.
Not sure what I've done (except run tests more times):
Update, not using 103GB.
Seeing this nice error:
...
Compiling datafusion v39.0.0 (/home/samuel/code/datafusion/datafusion/core)
error: failed to write to `/home/samuel/code/datafusion/target/debug/deps/rmetalvEs2G/lib.rmeta`: No space left on device (os error 28)
error: could not compile `datafusion` (lib) due to 1 previous error
from datafusion.
The more you run, the more artifacts in /target is. cargo clean
is all you need.
from datafusion.
Related Issues (20)
- Make Eq with negative float zero compat with other engines HOT 1
- Support `Decimal` and `Decimal256` Parquet Data Page Statistics HOT 1
- Support `Timestamp` Parquet Data Page Statistics HOT 4
- Support `Date` Parquet Data Page Statistics HOT 1
- Support `Time` Parquet Data Page Statistics HOT 3
- regression: query error with case when as the group field HOT 6
- ScalarValue::new_ten error cites one not ten
- Support Map as a ScalarValue HOT 4
- Consider using `Arc::clone` to clone Arcs to make it clear they aren't deep copies HOT 1
- Support unparsing the Value Plan of Array (List) to SQL String HOT 2
- Support `Dictionary` in Parquet Metadata Statistics HOT 4
- Is pre-compile pattern string in regexp_match operation HOT 3
- Implement physical plan serialization for COPY plans `CsvLogicalExtensionCodec` HOT 1
- Remove special casting of `Min` / `Max` built in `AggregateFunctions` HOT 1
- Remove `Min`/`Max` references from `AggregateExec::get_minmax_descr` HOT 1
- Remove `Min`/`Max` references from `AggregateStatistics` HOT 1
- Union columns can never be `NULL` (I think?)
- Allow sorting to improve `FixedSizeBinary` filtering
- Consolidate examples to make them easier to navigate
- Inconsistent behavior of '+-' arithmetic operator on Boolean type
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datafusion.