constellation-rs / amadeus Goto Github PK

View Code? Open in Web Editor NEW

470.0 470.0 26.0 2.51 MB

Harmonious distributed data analysis in Rust.

Home Page: https://constellation.rs/amadeus

License: Apache License 2.0

Rust 99.96% Shell 0.04%

data-analysis data-processing distributed-computing parallel-computing rust stream-processing

amadeus's People

Contributors

Stargazers

Watchers

amadeus's Issues

Examples under amadeus-parquet have some problems

Hi!

I was gazing to the parquet parser example. Examples under README.md https://github.com/constellation-rs/amadeus/blob/master/amadeus-parquet/src/README.md has some problems. I couldn't make them run.

I have a couple of suggestions for the parquet crate:

There is no standalone parquet reader at the outside, would be really nice to have this parquet reader as a separate non-dependent package.
some serdes are creating different names for List. For example with my structures Data derivation proc-macro does this:
I got this:

 REQUIRED group events (LIST) {
 REPEATED group list {
 REQUIRED group element {

where I expect this:

 REQUIRED group events (LIST) {
 REPEATED group array {

Where I simply want a structure in an array and java's arrow serializer serialized the structs with the name of array and didn't add yet another nested level. If you add a guide for this nested structure that would be nice.

Switch to pure-Rust dependencies where possible

Makes cross-building (e.g. to linux-musl) substantially easier.

lz4 -> lz-fear: apparently performance parity
zstd -> ruzstd: apparently ~3.5x slower, no encoding

XML Source

quick-xml is a fast, efficient and well-written Rust XML reader & writer. Work is ongoing to support serde (see tafia/quick-xml#172) which would make integration easier.

Alternatively, yaserde.

Avoid buffering CSV/JSON/Parquet file

#51 introduced the buffering of a CSV/JSON/Parquet file due to serde/serde_json/csv not supporting async.

This will be resolved when they support async, but in the meantime running it inside spawn_blocking() and streaming chunks back over a channel might be workable? See smol::reader().

Data Types

amadeus-types has three goals:

have types that are supersets of equivalents in Parquet, Postgres, Rust stdlib, e.g.:
- a DateTime can accept any valid Parquet, Postgres timestamp, while remaining lossless
have a type that is a superset of all the above types:
- Value enables dynamic and gradual data typing by not requiring the complete type at compile time
optimise data layout for performance, e.g,:
- List<Value> is optimised to be backed by Vec<u8> if all the value are Value::U8
- List<Row> is optimised to be backed by a Vec<_> of each column – i.e. columnar, like Apache Arrow

What other data types are relevant?

Should amadeus_core::file::{PathBuf, OsString} be moved to amadeus-types?

Redundant DNS lookups

Hyper's DNS resolver is spawning a bunch of blocking tasks to look up the same host, causing hundreds of blocking threads to be spawned. ~100 threads with the following stack cause cloudfront_logs to take ~20s to exit after returning from async fn main.

    2427 Thread_7871772: tokio-runtime-worker
    + 2427 thread_start  (in libsystem_pthread.dylib) + 13  [0x7fff63c2840d]
    +   2427 _pthread_start  (in libsystem_pthread.dylib) + 66  [0x7fff63c2c249]
    +     2427 _pthread_body  (in libsystem_pthread.dylib) + 126  [0x7fff63c292eb]
    +       2427 std::sys::unix::thread::Thread::new::thread_start::h545d31fdf79b3d9e  (in cloudfront_logs) + 45  [0x10d1eb3dd]  boxed.rs:1081
    +         2427 core::ops::function::FnOnce::call_once$u7b$$u7b$vtable.shim$u7d$$u7d$::h24d0ac9ca2e34eab  (in cloudfront_logs) + 17  [0x10d053ba1]  function.rs:233
    +           2427 std::thread::Builder::spawn_unchecked::_$u7b$$u7b$closure$u7d$$u7d$::h606d44b084314330  (in cloudfront_logs) + 278  [0x10d020416]  mod.rs:474
    +             2427 std::panic::catch_unwind::hf778b52e64c7dd68  (in cloudfront_logs) + 49  [0x10d01f391]  panic.rs:394
    +               2427 std::panicking::try::h0b8958571d7c7f99  (in cloudfront_logs) + 206  [0x10d05fb8e]  panicking.rs:325
    +                 2427 __rust_try  (in cloudfront_logs) + 29  [0x10d06454d]
    +                   2427 std::panicking::try::do_call::h417c11b07e629a5e  (in cloudfront_logs) + 95  [0x10d05fe8f]  panicking.rs:348
    +                     2427 _$LT$std..panic..AssertUnwindSafe$LT$F$GT$$u20$as$u20$core..ops..function..FnOnce$LT$$LP$$RP$$GT$$GT$::call_once::h6187c27ab70b5642  (in cloudfront_logs) + 49  [0x10d01efa1]  panic.rs:318
    +                       2427 std::thread::Builder::spawn_unchecked::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::ha5c6d4cb1a10bf6f  (in cloudfront_logs) + 49  [0x10d0205c1]  mod.rs:475
    +                         2427 std::sys_common::backtrace::__rust_begin_short_backtrace::h3308c5c2d8decb9c  (in cloudfront_logs) + 49  [0x10cff0371]  backtrace.rs:130
    +                           2427 tokio::runtime::blocking::pool::Spawner::spawn_thread::_$u7b$$u7b$closure$u7d$$u7d$::hb8d26712d1e0a87a  (in cloudfront_logs) + 41  [0x10d0865e9]  pool.rs:209
    +                             2427 tokio::runtime::handle::Handle::enter::h925b673bbbf60922  (in cloudfront_logs) + 82  [0x10d069852]  handle.rs:76
    +                               2427 tokio::runtime::context::enter::h594ce19fae3645d3  (in cloudfront_logs) + 86  [0x10d0144f6]  context.rs:72
    +                                 2427 tokio::runtime::blocking::pool::Spawner::spawn_thread::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h15b91bd6f6a228cc  (in cloudfront_logs) + 55  [0x10d086567]  pool.rs:210
    +                                   2427 tokio::runtime::blocking::pool::Inner::run::h2223211aa8f5c30d  (in cloudfront_logs) + 390  [0x10d0867a6]  pool.rs:230
    +                                     2427 tokio::runtime::task::Notified$LT$S$GT$::run::h7ee3dc3c18e82cba  (in cloudfront_logs) + 29  [0x10d062c0d]  mod.rs:169
    +                                       2427 tokio::runtime::task::raw::RawTask::poll::h26d954b18474d348  (in cloudfront_logs) + 46  [0x10d06b61e]  raw.rs:66
    +                                         2427 tokio::runtime::task::raw::poll::h0fa0afc3e981bb4b  (in cloudfront_logs) + 34  [0x10ceae572]  raw.rs:104
    +                                           2427 tokio::runtime::task::harness::Harness$LT$T$C$S$GT$::poll::hf9c36b55740bbfed  (in cloudfront_logs) + 380  [0x10ced9cbc]  harness.rs:89
    +                                             2427 std::panic::catch_unwind::hbca52d9256b52aa9  (in cloudfront_logs) + 28  [0x10cec72fc]  panic.rs:394
    +                                               2427 std::panicking::try::hd71536d6d35fb12e  (in cloudfront_logs) + 135  [0x10cee18d7]  panicking.rs:325
    +                                                 2427 __rust_try  (in cloudfront_logs) + 29  [0x10cee8ebd]
    +                                                   2427 std::panicking::try::do_call::h46c34f15157635e7  (in cloudfront_logs) + 89  [0x10cee1ac9]  panicking.rs:348
    +                                                     2427 _$LT$std..panic..AssertUnwindSafe$LT$F$GT$$u20$as$u20$core..ops..function..FnOnce$LT$$LP$$RP$$GT$$GT$::call_once::h55e08800d1bb0a52  (in cloudfront_logs) + 28  [0x10cec6d0c]  panic.rs:318
    +                                                       2427 core::ops::function::FnOnce::call_once::hf27147462984b278  (in cloudfront_logs) + 32  [0x10cee2290]  function.rs:233
    +                                                         2427 tokio::runtime::task::harness::Harness$LT$T$C$S$GT$::poll::_$u7b$$u7b$closure$u7d$$u7d$::h81c651632a29d4ef  (in cloudfront_logs) + 306  [0x10ceda102]  harness.rs:107
    +                                                           2427 tokio::runtime::task::core::Core$LT$T$C$S$GT$::poll::h7b7d24a1533992f2  (in cloudfront_logs) + 54  [0x10cebac16]  core.rs:158
    +                                                             2427 tokio::loom::std::unsafe_cell::UnsafeCell$LT$T$GT$::with_mut::h377f838352fbf4a0  (in cloudfront_logs) + 82  [0x10cee0452]  unsafe_cell.rs:14
    +                                                               2427 tokio::runtime::task::core::Core$LT$T$C$S$GT$::poll::_$u7b$$u7b$closure$u7d$$u7d$::hc6bb476f4c0dbfdd  (in cloudfront_logs) + 331  [0x10cebadbb]  core.rs:173
    +                                                                 2427 _$LT$tokio..runtime..blocking..task..BlockingTask$LT$T$GT$$u20$as$u20$core..future..future..Future$GT$::poll::hf1bc8661f8dd08ef  (in cloudfront_logs) + 200  [0x10ceac368]  task.rs:38
    +                                                                   2427 _$LT$hyper..client..connect..dns..GaiResolver$u20$as$u20$tower_service..Service$LT$hyper..client..connect..dns..Name$GT$$GT$::call::_$u7b$$u7b$closure$u7d$$u7d$::h97f68211e6cfbc52  (in cloudfront_logs) + 489  [0x10cecac69]  dns.rs:122
    +                                                                     2427 _$LT$$LP$$RF$str$C$u16$RP$$u20$as$u20$std..net..addr..ToSocketAddrs$GT$::to_socket_addrs::hb8b02ee58d460452  (in cloudfront_logs) + 261  [0x10d1dea85]  addr.rs:963
    +                                                                       2427 _$LT$std..sys_common..net..LookupHost$u20$as$u20$core..convert..TryFrom$LT$$LP$$RF$str$C$u16$RP$$GT$$GT$::try_from::hf4c7dff3e0f3ab3c  (in cloudfront_logs) + 301  [0x10d1e5cdd]  net.rs:197
    +                                                                         2427 getaddrinfo  (in libsystem_info.dylib) + 61  [0x7fff63b28e7d]
    +                                                                           2427 _getaddrinfo_internal  (in libsystem_info.dylib) + 231  [0x7fff63b28f77]
    +                                                                             2427 si_addrinfo  (in libsystem_info.dylib) + 1904  [0x7fff63b29810]
    +                                                                               2427 search_addrinfo  (in libsystem_info.dylib) + 309  [0x7fff63b32d15]
    +                                                                                 2427 mdns_addrinfo  (in libsystem_info.dylib) + 1150  [0x7fff63b331ee]
    +                                                                                   2427 _mdns_search  (in libsystem_info.dylib) + 146  [0x7fff63b2d7d2]
    +                                                                                     2427 _mdns_search_ex  (in libsystem_info.dylib) + 2092  [0x7fff63b2e00c]
    +                                                                                       2427 kevent  (in libsystem_kernel.dylib) + 10  [0x7fff63b7078a]

Enable musl on CI

Currently failing due to ~~rust-lang/rust#73451~~ zstd breaking linking?

error: linking with `rust-lld` failed: exit code: 1
  |
  = note: "rust-lld" "-flavor" "gnu" "--eh-frame-hdr" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/self-contained/rcrt1.o" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/self-contained/crti.o" "-L" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib" "-L" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/self-contained" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.105px5unm58qx35e.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.10nh3n8bggluaq7t.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.10sckxbbqw77o9g7.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.10u2r96wogf058nq.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.12h10rwkbhz7a5gk.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.14vtemaxqr53liz.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.155aypx95z2u4ykp.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.15nzwa5dqgk1f1cd.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.160655dqtqfeijew.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.163lrtnpkqbopdlb.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1642o4te2o926m3s.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.16fkndjzdtngxg8o.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.173dnvlw59i0khi9.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.174hchjbv1fpmudb.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.17a9i0sjzg2s18wj.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.17i28gosjunauhfi.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.17ueyswgweynvh4.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.185s2rijo1volvwi.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1864t0id2siqc54m.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.18soe7z61mwc1qrx.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.18zh6p64aysace4n.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.19i6n8r5pfjb5i93.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.19keebhtjckm52gv.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1ae07smqwd53zj6s.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1arfkv14qemjhccr.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1b3kc7m37xgpfmmm.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1b4109g3j18qnd61.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1b7powu2huf6mxho.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1bhdpcwt1qf3purz.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1bhg8n8tly4952dt.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1c6u5i5hvv4u5gem.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1d5p0b2qoojx8b2h.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1e3dqeufzwvsk0u0.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1ewx23j439dlwd77.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1fc205xmjtioy740.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1gnsxglq0xubjdp8.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1h7p71ettr8mszx7.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1hngsgaz2cl6ujjf.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1jplcubyv6eiej71.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1lh4o7f8ald9zqx2.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1lu6r8hag59t2wpo.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1n52eolyaqlxe0sl.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1ndil3domtl3cemt.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1nhbn1ds0nvpo523.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1ni96mhaoez7wkqx.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1p0c2vcpeishcndk.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1pdnx427l637cs8w.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1q3558p9jx6gwpca.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1ql6p5lm80yj9gqe.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1qv3rpkfbowzizp0.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1ssfe52uag6id7jt.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1syty1p5qnjmjsvn.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1t95ibg4xbvglrfi.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1u3fveb350ulxpew.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1uxsv5bieiq9f75m.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1vjinoc39o2biu8q.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1w7vdduzrf6bhkgx.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1wo103p5b9o02l4a.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1wxxc67d3demily0.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1y616aghlw7hdd30.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.1ynascexfhxxgzry.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.200xkrfoti7dlgvn.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.20k1qkkqw2ii8r15.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.20p109awqzsestrj.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.20tx3hbb7bqzac0v.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.215szmicqt2tqsln.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.22fh0b7wg8qiktwd.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2370t0pk3x1narui.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.24c3aife8cwgp6vz.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.250zcutxx2zkh3my.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.25gd3an24uufoart.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.26th11vq04ygt7j8.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2774fxyoj6zz7bi5.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.27cacet7kwhak3wa.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.28t92v54wo6h2qzo.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.293uov096pcu7sit.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.29gtitg66bag8ymj.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2awr7vfhozsjshrv.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2b5l6vpdr7jy56y4.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2c62grsajr5zdwv3.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2dnlycoc45u7p648.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2eyboc83snleyrfy.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2fghom3dmj4mvoif.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2k0e4efk41923cbw.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2k42ohme1ff2fhx.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2ooi0p9zxl595uru.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2p0jn32gylgbw72x.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2q0urhx67bcv8e0.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2setgyg0kgirh3dg.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2tfbaev9o88snlyc.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2u898t4osa6j86bp.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2udvclgzwx2eci43.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2vbge6vu6xbysuak.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2x4smqlatghn8v0l.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2xnae3693ysb5aiv.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2ydpu9opvmvln62t.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2z5syot6dgvbcfuj.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2z9mw9m358lhbc6i.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2zd42epd5zof4asn.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.2zrlngfq8k3i5fyo.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.30oyz432alatdnbe.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.315nxu7d8d3f5fcu.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.31obdo0i81evqpuc.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.325wktrcnmtbvmji.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.32w71oqnpeomgott.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.33sji8wu5hle0xac.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.35z1hxy6q4ocwgv5.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.374xpqchvpvbcy7s.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.39dga286l57pw5b8.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.39tjnjb132kz6tfl.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3a5qa6wtccgud348.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3ajsxeuyc16f7neo.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3bebw19ozg7z8xrd.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3dd8j87ugfontfhz.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3dn4j3m15x66b09p.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3dnam2b6jp2g6qrp.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3gvlycssbpmnikow.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3h5box2oyvs1ikgq.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3hoqyczq8x1ibu7u.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3idyw04c4k5ybibh.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3iol29rqhkcwirrt.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3jzutdimf55g43nr.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3ml88yeam4ejyicd.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3ocy5nlwlqk2vkzx.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3oh6hrjhk64vgei1.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3p813r6plk1i73.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3pcw0kss7xja6baw.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3q75dnyzvwormeic.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3q946l3oogo1ezva.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3qbobt8ljigxn890.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3qp3tp5srii5808v.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3rt46q60k7q7r6as.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3t6m91isgqhj3yma.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3ti91j6a6j9dyqf.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3tneem5yt6f9u2zx.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3tpg1tsa6li9ybem.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3u07c0tiqcrsj2tu.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3usgzribq5agy255.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3whhl7ryrtf6kc1c.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3wvjnp5w1acks5o9.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3wz0wgszwlegas5b.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3xaicklqs7v29s57.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3xe6gzmaq3mob6x2.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3xk66f27d5kslqt4.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3y1bwn3jh3xrgm4d.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3yddsdmj9g6ebtm5.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3yy4fuak5ajipg9a.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3z3ulnrxinoqm9hc.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.3zurmd6dof4tbz8p.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.41aiavzr9ruq2avi.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.41hmq6o0k0l6lurl.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.41y1g30bp9laijv8.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.42l6q1ourawkxogs.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.42r9xg96300u72k2.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.43d4qv9a6mrvkj24.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.44zuyrawy5d8yeav.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.45s5mzw0s33qrpj7.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.45z843wtz4bssfbw.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.46f1mvr479uwucq4.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.46ieq4rn2vrui1n7.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.47izver77071wikn.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.47lbx9k4qfl7rbwk.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.48t1puzzfj4elj34.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.491aosy5e3itsv1n.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.49dufu1zlfas6m17.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4bg5oobg0squ5es6.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4bzt7djs8iluljts.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4c3qijxg29jy43cu.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4cy6ndn96s6li73c.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4dg9aerkq9nd0lg9.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4dkfbcc9kd91qtb6.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4eorj5xzphwl6j4g.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4es7fu8imuzrrxg.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4hf7elktq83y3gsy.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4hi0pv7d0a5y9zgj.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4hykosz0239pjk5m.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4i45q9gqg8gjq7ru.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4j4wdow66avvgnlo.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4jvh8n9rhe9guz5q.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4k7dw0xd0ka4kr0c.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4k8rkmfnhpahjkpi.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4mli20q78es214uy.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4nsoal4wg1a5bab6.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4nypjb7ardadjgww.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4oodra95rjyqra9j.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4p5341g31oemw6b3.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4pmqt8ifuh6418ta.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4po06ae65zi598wv.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4pvcgj70ra8mw24y.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4qq5uipvhmphr36p.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4r72x1vuy7mivgtj.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4rohruivh7bf5r08.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4tinvsnjm2caxip0.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4uf1gz07in6hwvah.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4uh8ripptf3p0ite.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4uyppb0tvdc73zlo.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4x958clfbu9vj2pd.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4xni7x2wygacpid7.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4y007km4pq4xrpvb.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4y9185ucc0rp5eo9.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4ygzfyhkylnfzzoz.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4z5p76laofo22biw.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.4z6r9rriiuzna7tv.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.502pbo0c6l04e6b8.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.505hqv9ietw4zv91.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.50uoaeoq61ogaza9.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.51vq3uhbo0iuu66y.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.52d4fxp5ktw7gd9z.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.53o9uxa39k44fn1u.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.53sc28lbodw5jb7u.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.54be8p1xsv0dunv4.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.54lmg1gjus58qbqe.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.55nor5m1vx56u8ua.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.56b7gnjthjs79hcw.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.56u18qyi7tdz2oe7.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.56yb3pp98obbcggj.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.57jrp8l7dz9djcx0.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5888rbrp9twd7tb7.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5aapfc1jpl4m9e17.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5ampyvk19ntavl5n.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5cfrcqxcuaqgcpg4.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5dg0epdd65ob04p6.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5e2wxhg6dcuzrgn8.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5e31dusrzx1m9k0h.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5gjkx69n9q37en7m.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5hx2p3ywvhd85xr.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.5liew5m6hmpgzs8.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.6wx5ciqsj106tev.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.7bvb5hmjp1v1de5.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.8abm4dijq91gwze.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.95bllee4rogyksc.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.bdd293ws1xoijja.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.bggt97usdyduit.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.c102p1lsxy63g3a.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.em88pqwp00sgbi7.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.heik2xohxa11jbt.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.hl7wur0fiysp542.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.jsaa72bs4m5i47u.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.lb4f9iat3omjnzu.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.lda5ctn6ub4ubat.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.m4ncl0km1ys363i.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.mgm8aciufw8e8nn.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.o3xp8ijk3l0pewo.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.otfe4q3ph9ir8wg.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.pcylsdvx2dbv4d4.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.q9mpxbyu1a40pu4.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.qei2hks0e9mgu83.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.rcs26d8lb84iwqw.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.sm6smwyixhxi8g1.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.ubx16d1q85zmqby.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.w1y2694fu9vqjrs.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.w3b8qs63xm9m2m3.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.waqtljqi2cpa2fv.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.xgqmvo88qlm3dla.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.ylj502muwz8i6kg.rcgu.o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.zfsnzi3w2kzl6wg.rcgu.o" "-o" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/amadeus_parquet-453e85646e3a610a.18wqr5vccn37z5o3.rcgu.o" "--gc-sections" "-static" "-pie" "--no-dynamic-linker" "-z" "text" "-zrelro" "-znow" "-L" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps" "-L" "/home/vsts/work/1/s/target/debug/deps" "-L" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/build/lz4-sys-30f35807f20950ff/out" "-L" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/build/zstd-sys-7189993967116d5f/out" "-L" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib" "-Bstatic" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libamadeus_types-0a299e32217a090b.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libchrono_tz-d6876462b16d81bb.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libchrono-1578efa9f729ef45.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libtime-4b424bbca5222671.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libamadeus_core-9b84a57c53b11902.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libserde_closure-c7c687347a047d63.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libstreaming_algorithms-8d2510d1b693e5fe.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libpacked_simd-5c699d83693b3019.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libtwox_hash-6d7104e011c7a537.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libitertools-de3a13ae9886ebd6.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libsum-a61273e1f9ba00c8.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libreplace_with-30e576485a509a7b.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libeither-05f3f203e1761da8.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libowned_chars-4802c3f84d17c33a.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libwidestring-9d0352e0fc111051.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libwalkdir-237c2068258eefa5.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libsame_file-5ddefd0f84ee6d9b.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libfutures-9d970eff7042359d.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libfutures_executor-37a14987b727f7b6.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libfutures_util-d90c1a9c7ad6834d.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libmemchr-2b800dbfb0484565.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libproc_macro_nested-24f73bdf2ddcf343.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libfutures_io-721555e6518ca63f.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libslab-8cf839fe00f9ed9d.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libfutures_channel-0a0e2cdad4d465ae.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libpin_project-5ad4ff8bc2898852.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libfutures_sink-e553835bfd79ed9a.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libfutures_task-3974e319c3174325.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libonce_cell-35468a74646d6975.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libpin_utils-6f3c1f0153e2332c.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libfutures_core-4a138790cb2001c5.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/liburl-f67d74c9ef20ca43.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libpercent_encoding-df620ebb82ba49d5.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libidna-f5f7b186bc5d72ae.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libunicode_normalization-aaa55503a5136e6a.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libtinyvec-4313a0b9b2771f3b.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libunicode_bidi-9665d8262f5bc39b.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libmatches-d69c931aa963cf6e.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/liblinked_hash_map-8322b691a24cbda9.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libfxhash-93c40088de558541.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libserde-0103e76f4b862d61.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd-3eb19dbeaadf3335.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_safe-c04cf1d46dcd7287.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/liblz4-fe82e4158e231179.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/liblz4_sys-67a446f7d935e229.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libflate2-fd3bc6ce077aef18.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libminiz_oxide-2f3cbbe8c96ecba8.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libadler-141d59c1ee12c1f9.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libcrc32fast-c246c7f548674820.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libbrotli-5fe768a52cf2c9fb.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libbrotli_decompressor-486f9b189dd2af61.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/liballoc_stdlib-3e486981f4a69d41.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/liballoc_no_stdlib-d5cde7abfc380b99.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/librand-be9a2212f616c75d.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/librand_pcg-bdf55188be799867.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/librand_chacha-371390184968449a.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libppv_lite86-a174e4c8b084155d.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/librand_core-48d10a94d8974cd4.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libgetrandom-1fb1059f38f6a250.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libnum_bigint-3b332d48b5ce02ba.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libnum_integer-31de5de02b596f1c.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libthrift-ddd22b9eaa743e88.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/liblog-057ef6570f6f695f.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libcfg_if-de5ee95b96391e1e.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libthreadpool-8ff483b41932db6a.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libnum_cpus-c73a00aee4d6cba3.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/liblibc-2cac61d4d1df6551.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libinteger_encoding-43337482b0bb3a3d.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libordered_float-28d073ab35d24445.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libnum_traits-4ab685fde59979ed.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libsnap-d0421047648c165f.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/liblazy_static-e74191f0d9cba156.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libbyteorder-63b1a3649f9c8bee.rlib" "/home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libquick_error-02b316ffdea4e9ce.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libtest-daf90d69f252b027.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libterm-c2d771caf647398e.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libgetopts-f60b4c96cfa39648.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libunicode_width-e9558558cfda2d66.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/librustc_std_workspace_std-77e653cdc832cb53.rlib" "--start-group" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libstd-c9eab0e5caf73641.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libpanic_unwind-85db3f1e55286ba2.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libhashbrown-3e37c243b71951bd.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/librustc_std_workspace_alloc-5d68eb7eb4dccbbc.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libbacktrace-72223505e1137e2a.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libbacktrace_sys-c2eca863ae88d94b.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/librustc_demangle-f71929704050934e.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libunwind-8cb492884b97a43c.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libcfg_if-c7cfc353a8b4cd91.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/liblibc-484d9d5b8731d696.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/liballoc-1d6ec01cfc66e1e1.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/librustc_std_workspace_core-650e03a7e69a40f7.rlib" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libcore-7b48633d89f678d4.rlib" "--end-group" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/libcompiler_builtins-aeec8e7a57565616.rlib" "-Bdynamic" "/usr/share/rust/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-musl/lib/self-contained/crtn.o"
  = note: rust-lld: error: can't create dynamic relocation R_X86_64_32 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c:16 (zstd/lib/common/error_private.c:16)
          >>>               error_private.o:(ERR_getErrorString) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_32S against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c:16 (zstd/lib/common/error_private.c:16)
          >>>               error_private.o:(ERR_getErrorString) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: can't create dynamic relocation R_X86_64_64 against local symbol in readonly segment; recompile object files with -fPIC or pass '-Wl,-z,notext' to allow text relocations in the output
          >>> defined in /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib(error_private.o)
          >>> referenced by error_private.c
          >>>               error_private.o:(CSWTCH.1) in archive /home/vsts/work/1/s/target/x86_64-unknown-linux-musl/debug/deps/libzstd_sys-11eaf6efd2a37a52.rlib
          
          rust-lld: error: too many errors emitted, stopping now (use -error-limit=0 to see all errors)
          

error: aborting due to previous error

error: could not compile `amadeus-parquet`.

https://dev.azure.com/alecmocatta/amadeus/_build/results?buildId=1186&view=logs&j=ba55b2d0-6d72-5d53-ffc2-ffa3645964c0&t=14b87617-de8e-5756-bb82-38055dc466e5&l=438

Columnar memory optimisations

List<T> stores data in a columnar format for structs
do the same for dynamically typed structs
some functionality (iterating, hashing, serializing) isn't fully implemented.

Postgres connector

Need to explicitly specify extraneous dependencies in Cargo.toml

I'm trying to build a new project using amadeus. I've copy/pasted the first example from README.md and added the following into Cargo.toml:

[dependencies]
amadeus = { version = "0.3.5", features = ["aws", "parquet"] }
tokio = "0.2.22"

The project fails to build, complaining that it cannot find amadeus_core, amadeus_types, amadeus_parquet.

The only way I could compile the project is if I explicitly list the extraneous dependencies:

[dependencies]
amadeus = { version = "0.3.5", features = ["aws", "parquet"] }
tokio = "0.2.22"
# I don't understand why these need to be explicit, rather than features above
amadeus-core = "0.3.5"
amadeus-types = "0.3.5"
amadeus-parquet = "0.3.5"

I'd like to think that amadeus package itself would include at least core and types, as well as when the extra feature like parquet is specified, it would bring in amadeus_parquet. What am I missing? Is this a bug?

Build on Stable

Need to remove the dependence on the following features:

Dependencies:
- streaming_algorithms: specialization – doable and desirable
- vec-utils
- packed_simd
specialization – doable I think and desirable
- need to bound List and Map on T: Data
- type_coerce(): work out how to remove this
type_alias_impl_trait – hard and not desirable :/
- All but parquet

Limit the number of concurrent tasks across multiple invocations

This for example will run 2x the configured limit on concurrent tasks:

let a = a.dist_stream().count();
let b = b.dist_stream().count();
let (a, b) = join!(a, b).await;

Improve compile times

~~Abysmal since #51.~~

~~Avoid gigantic types (which require upping type_length_limit).~~
Avoid closures that I think are monomorphised for parameters that aren't relevant?
- Some uses of poll_fn remain
Try out cargo llvm-lines.

Writing support

S3Page – write to S3
LocalFile – write to local file
Writer wrapper around Pages for serde/parquet support

Kinesis/Kafka/NATS as Sources

Proposed design for consuming from Kafka/Kinesis:

By default 1 consumer is spawned;
This can be overridden by with_consumers(n);
On Kafka, if with_target_records_lag is provided, then records-lag-max is used as a metric to auto scale consumers to reach the specified acceptable lag;
On Kinesis, if with_target_millis_lag is provided, then MillisBehindLatestis used as a metric to auto scale consumers to reach the specified acceptable lag;
auto scaling doesn't scale higher than the number of partitions/shards.

A simple auto scaling Kafka example that starts with 10 consumers, growing and shrinking to reach the specified acceptable lag:

use amadeus::prelude::*;

#[tokio::main]
async fn main() {
    let pool = ThreadPool::new()?;

    let messages = Kafka::new(vec!["localhost:9092".parse().unwrap()])
        .with_topic("my-topic".to_owned())
        .with_group("my-group".to_owned())
        .with_consumers(10)
        .with_target_records_lag(10_000)
        .build().await?;

    messages
        .par_stream()
        .for_each(|messages: Result<KafkaMessageSet, _>| async {
            let messages = messages.expect("kafka error");
            for msg in &messages {
                println!("received message {}: {} {}", msg.offset, msg.key, msg.value);
            }
            messages.consume();
            messages.commit();
        });

    panic!("All Kafka consumers have died");
}

Need clarification:

Semantics of message consuming and committing: how much control should the API expose, or is it acceptable for Amadeus to handle one or both of those? How/why do applications rely on explicit consuming/committing?
How that interacts with streaming transformations like tumbling window/batching where the user wants n messages, not n message sets?
The Kinesis Client Library (KCL) creates a DynamoDB table to "track and maintain state information such as resharding events and sequence number checkpoints". It doesn't have a Rust version :'(
Is there a de facto standard serialization format for messages?
For Kinesis, I'm not sure how valuable a "raw" Kinesis Source, rather than Kinesis + DynamoDB like the KCL does, would be? Unfortunately writing a KCL equivalent for Rust is a bit much for me atm.

Assumptions:

If a Kafka topic/Kinesis data stream has 100 partitions/shards, the maximum parallelism is infinite producers but only 100 consumers. The number of partitions/shards can change dynamically (I'm not sure how commonly done this is?). It's a valid use case to have say 1000 partitions/shards, but only say 50 consumers; this provides "headroom" to scale up the number of consumers dynamically based on data volumes.

Short circuiting reducers

#51 disabled reducers (e.g. .any(...) and .try_fold(...)) being able to say "done" early and return immediately. Now everything else is in place, figure out the best design for this?

request : AV1 frames

any plan for AV1 frames or guidance to do distributed iterting on media files? thank you

Adding an operation

There are two kinds of operation: adapter¹ operations (like map, flat_map, filter, chain) and reducer operations (like sum, max, collect, fold).

Adding a reducer operation

introduce a type that implements ParallelSink, probably in a new file in amadeus-core/src/par_sink (don't forget to add mod new_file; to amadeus-core/src/par_sink.rs).
- amadeus-core/src/par_sink/count.rs and amadeus-core/src/par_sink/histogram.rs are good starting points for how to implement the FolderSync trait.
- The FolderSync trait and the folder_par_sink macro are a convenience to minimise boilerplate implementing ParallelSink for operations which can be implemented as a synchronous fold operation, which is most of them.
add the user-facing methods to create this type in amadeus-core/src/par_pipe.rs and amadeus-core/src/par_stream.rs
(ideally, I know some are missing!) add a test in tests, probably in a new file with the same name as 1.
Make clippy and rustfmt happy cargo clippy --all-targets and cargo fmt --all
Open a PR!

Adding an adapter operation

introduce a type that implements ParallelStream and ParallelPipe, probably in a new file in amadeus-core/src/par_stream (don't forget to add mod new_file; to amadeus-core/src/par_stream.rs).
- amadeus-core/src/par_stream/filter.rs and amadeus-core/src/par_stream/flat_map.rs are good starting points.
add the user-facing methods to create this type in amadeus-core/src/par_pipe.rs and amadeus-core/src/par_stream.rs
(ideally, I know some are missing!) add a test in tests, probably in a new file with the same name as 1.
Make clippy and rustfmt happy cargo clippy --all-targets and cargo fmt --all
Open a PR!

I'm sure there's a better name than "adapter operations", please comment if you have one!

#[derive(Data)] on tuple and unit structs and enums

Integrate ML algos

Goal: choose algorithms that:

ideally have a Rust implementation
ideally the implementation is streaming/online (as this is easier to scale up)
are valuable to (potential) Amadeus users

Rust crates:

https://github.com/axect/peroxide

Resources on streaming algos:

Make &List<T> iterable somehow

As the data might not be stored as T anywhere, fn iter(&self) -> impl Iterator<Item = &T> is impossible.

Probably something like https://github.com/reem/rust-traverse is the way to go.

Support different object storage then S3

There would be nice to have support for other object storage implementations like:

Google Cloud Storage
Azure Object Storage
IBM cloud object storage
Minio

It may be split in two pull requests, one for reading and another for writing.

Improve miri coverage

cargo miri test succeeds but most tests are disabled, blocked on rust-lang/miri#1038.

$ RUST_BACKTRACE=1 cargo +nightly-2020-07-07 miri test --test single_threaded

running 1 test
error: internal compiler error: /rustc/0c03aee8b81185d65b5821518661c30ecdb42de5/src/librustc_middle/macros.rs:7:9: vtable not supported on type std::pin::Pin<&mut dyn futures::Future<Output = (streaming_algorithms::sample::SampleUnstable<std::string::String>, (std::collections::HashMap<std::string::String, usize>, usize, (), usize))>>

thread 'rustc' panicked at 'Box<Any>', src/librustc_errors/lib.rs:916:9
stack backtrace:
   0: <std::sys_common::backtrace::_print::DisplayBacktrace as core::fmt::Display>::fmt
   1: core::fmt::write
   2: std::io::Write::write_fmt
   3: std::panicking::default_hook::{{closure}}
   4: std::panicking::default_hook
   5: rustc_driver::report_ice
   6: std::panicking::rust_panic_with_hook
   7: std::panicking::begin_panic
   8: rustc_errors::HandlerInner::bug
   9: rustc_errors::Handler::bug
  10: rustc_middle::util::bug::opt_span_bug_fmt::{{closure}}
  11: rustc_middle::ty::context::tls::with_opt::{{closure}}
  12: rustc_middle::ty::context::tls::with_opt
  13: rustc_middle::util::bug::opt_span_bug_fmt
  14: rustc_middle::util::bug::bug_fmt
  15: rustc_mir::interpret::terminator::<impl rustc_mir::interpret::eval_context::InterpCx<M>>::eval_fn_call
  16: rustc_mir::interpret::step::<impl rustc_mir::interpret::eval_context::InterpCx<M>>::terminator
  17: miri::eval::eval_main
  18: rustc_middle::ty::context::tls::enter_global
  19: <miri::MiriCompilerCalls as rustc_driver::Callbacks>::after_analysis
  20: rustc_interface::queries::<impl rustc_interface::interface::Compiler>::enter
  21: rustc_span::with_source_map
  22: rustc_interface::interface::run_compiler_in_existing_thread_pool
  23: scoped_tls::ScopedKey<T>::set
  24: rustc_ast::attr::with_globals
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.

note: the compiler unexpectedly panicked. this is a bug.

note: we would appreciate a bug report: https://github.com/rust-lang/rust/blob/master/CONTRIBUTING.md#bug-reports

note: rustc 1.46.0-nightly (0c03aee8b 2020-07-05) running on x86_64-apple-darwin

note: compiler flags: -C embed-bitcode=no -C debuginfo=2 -C incremental -C target-cpu=native

note: some of the compiler flags provided by cargo are hidden

query stack during panic:
end of query stack
error: aborting due to previous error; 3 warnings emitted

test single_threaded ...
error: could not compile `amadeus`.

Also affected by rust-lang/miri#1512 rust-lang/miri#1514 rust-lang/miri#1516.

Add user-focused documentation

It would be great to have a user guide in the style of the Rust book or https://ballistacompute.org/docs/introduction.html, beyond what the API docs and examples provide.

Optimised columnar operations

List<T> stores data as a Struct of Arrays. This allows very fast traversing by only reading the columns that are needed and leveraging vector operations. This needs to be exposed! c.f. Apache Arrow.

cc #72

Doctests aren't being run on CI

Due to rust-lang/cargo#8392

HDFS integration with native_spark

Since HDFS marked as requested in README, you might be interested in the Native Spark project, which also works on the HDFS support:

rajasekarv/vega#20

Documentation fails to build

Hey there!

Just a heads up that amadeus-parquet 0.1.7, and older versions of some other amadeus- crates (like amadeus-postgres 0.1.5) are affected by rust-lang/rust#65863, and their documentation do not build with cargo doc. See for example https://docs.rs/crate/amadeus-parquet/0.1.7. Not much to do about it at the moment (except by trying to fix the compiler), just trying to bring attention to the problem :)

Refactor connectors that use HTTP to use a common HTTP interface

Implement File for Url.
See also durch/rust-s3#103

Add a comparison to other projects

E.g. compare to Spark and Ballista.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.