Comments (7)
DuckDB has a custom LIKE implementation not using regular expressions: https://github.com/duckdb/duckdb/blob/master/src/function/scalar/string/like.cpp
DuckDB folks considered switching to RE2, but found that RE2 is 2-4x slower: duckdb/duckdb#157
Same for OmniSciDB: https://github.com/omnisci/omniscidb/blob/master/Utils/StringLike.cpp#L94
CC: @biswapesh @spershin @amitkdutta
from velox.
Masha and I discussed this last week. We concluded that the current re2 based implementation is sufficient for the purpose of tpch coverage. There will be subsequent work when optimizing tpch queries.
from velox.
More changes are needed in presto_cpp for the e2e TPC-H query.
from velox.
https://github.com/facebookexternal/presto_cpp/pull/537 for presto_cpp changes
from velox.
@aditi-pandit Aditi, have you had a chance to check performance of LIKE to see if we need to special case starts-with, ends-with and contains expressions. E.g. can we check whether RE2 is already optimized for foo%, %bar and %foo% patterns and if not provide non-regexp implementation for such patterns.
CC: @kgpai @spershin @tanjialiang
from velox.
Seems this is already done. Shall we close the issue? @aditi-pandit
from velox.
@yingsu00 : I have not spent much time benchmarking the like operator. But I will open a separate issue for it and close this one.
Opened issue #872
from velox.
Related Issues (20)
- Running scripts /setup-centos8.sh fails due to missing Boost dependency HOT 1
- Deprecate test inject and threshold triggered Spilling in Velox HOT 5
- Remove NoOp memory arbitrator kind HOT 3
- Deprecate useMmapArena feature in MmapAllocator HOT 3
- Exchange::getOutput use `VectorSerde::deserialize` with `resultOffset` parameter, it may throw VELOX_UNSUPPORTED error HOT 7
- ContiguousAllocation & Allocation constructor not compatibility with folly benchmark HOT 1
- AggregationTest.reclaimFromAggregation is flaky HOT 2
- Partial aggregations over distinct inputs are not supported. HOT 7
- finalizeS3FileSystem not call, casu segmentation fault HOT 1
- ParquetReaderBenchmark is broken HOT 3
- Improve Parquet PageReader::readPageHeader
- Create a docker image for linux adapters. HOT 1
- Support dereference pushdown for struct type in parquet HOT 3
- Need to support offline compilation of xsimd/cpr dependencies HOT 4
- Failure (n > 0) in HashAggregation when ignoreNullKeys=true and all input rows have null keys HOT 14
- M1 build failing with C++ compilation errors HOT 7
- Support NestedNullAsIndeterminate compare mode.
- Order_by should not support sorting nested nulls
- Fuzzer failure in multimap_from_entries HOT 2
- Support Velox on fedora HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from velox.