Comments (2)
canhld94
commented on July 21, 2024
I execute the following sql statement, the server hangs up.
set enable_optimizer = 1; explain pipeline select xxx from xxx as A join xxx as B on A.name = B.name where A.name is not null;The same sql statement will not have any errors when executed on the native clickhouse.
Hi @juppylm thanks for the feedback!
When using optimizer, the query execution model of Byconity is different from CH, so explain pipeline cannot run.
You can try to explain select xxx from xxx as A join xxx as B on A.name = B.name where A.name is not null;, but output meaning will also be different from native Clickhouse.
cc @Adora627 have we note this in the doccument?
from byconity.
canhld94
commented on July 21, 2024
For example, explaining an JOIN query will look like this:
EXPLAIN
SELECT
sum(LO_REVENUE),
toYear(LO_ORDERDATE) AS d_year,
P_BRAND
FROM ssb100.lineorder, ssb100.part, ssb100.supplier
WHERE (LO_PARTKEY = P_PARTKEY) AND (LO_SUPPKEY = S_SUPPKEY) AND (P_CATEGORY = 'MFGR#12') AND (S_REGION = 'AMERICA')
GROUP BY
d_year,
P_BRAND
ORDER BY
d_year ASC,
P_BRAND ASC
Query id: 7876f063-a665-40de-9926-6083217455c5
┌─explain───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Projection est. 93873 rows, cost 7.398416e+08 │
│ │ Expressions: [P_BRAND], d_year:=`expr#toYear(LO_ORDERDATE)`, sum(LO_REVENUE):=`expr#sum(LO_REVENUE)` │
│ └─ Sorting est. 93873 rows, cost 7.398347e+08 │
│ │ Order by: {expr#toYear(LO_ORDERDATE) asc, P_BRAND asc} │
│ └─ Gather Exchange est. 93873 rows, cost 7.398347e+08 │
│ └─ Sorting est. 93873 rows, cost 7.398197e+08 │
│ │ Order by: {expr#toYear(LO_ORDERDATE) asc, P_BRAND asc} │
│ └─ MergingAggregated est. 93873 rows, cost 7.398197e+08 │
│ └─ Repartition Exchange est. 93873 rows, cost 7.398197e+08 │
│ │ Partition by: {P_BRAND, expr#toYear(LO_ORDERDATE)} │
│ └─ Aggregating est. 93873 rows, cost 7.398046e+08 │
│ │ Group by: {P_BRAND, expr#toYear(LO_ORDERDATE)} │
│ │ Aggregates: expr#sum(LO_REVENUE):=AggNull(sum)(LO_REVENUE) │
│ └─ Projection est. 6742248 rows, cost 7.398046e+08 │
│ │ Expressions: [LO_REVENUE, P_BRAND], expr#toYear(LO_ORDERDATE):=toYear(LO_ORDERDATE) │
│ └─ Inner Join est. 6742248 rows, cost 7.393057e+08 │
│ │ Condition: LO_SUPPKEY == S_SUPPKEY │
│ ├─ Inner Join est. 33634621 rows, cost 7.241307e+08 │
│ │ │ Condition: LO_PARTKEY == P_PARTKEY │
│ │ ├─ Local Exchange est. 600038145 rows, cost 4.884311e+08 │
│ │ │ └─ Filter est. 600038145 rows, cost 4.884311e+08 │
│ │ │ │ Dynamic Filters: {LO_PARTKEY:bloomfilter,LO_PARTKEY:range,LO_SUPPKEY:bloomfilter,LO_SUPPKEY:range} │
│ │ │ └─ TableScan ssb100.lineorder est. 600038145 rows, cost 4.440282e+08 │
│ │ │ Outputs: [LO_ORDERDATE, LO_PARTKEY, LO_REVENUE, LO_SUPPKEY] │
│ │ └─ Broadcast Exchange est. 55736 rows, cost 1.152642e+06 │
│ │ └─ Projection est. 55736 rows, cost 1.143724e+06 │
│ │ │ Expressions: [P_BRAND, P_CATEGORY, P_PARTKEY] │
│ │ │ Dynamic Filters Builder: {P_PARTKEY} │
│ │ └─ Filter est. 55736 rows, cost 1.139600e+06 │
│ │ │ Condition: P_CATEGORY = 'MFGR#12' │
│ │ └─ TableScan ssb100.part est. 1400000 rows, cost 1.036000e+06 │
│ │ Outputs: [P_BRAND, P_CATEGORY, P_PARTKEY] │
│ └─ Broadcast Exchange est. 40125 rows, cost 1.721894e+05 │
│ └─ Projection est. 40125 rows, cost 1.657693e+05 │
│ │ Expressions: [S_REGION, S_SUPPKEY] │
│ │ Dynamic Filters Builder: {S_SUPPKEY} │
│ └─ Filter est. 40125 rows, cost 1.628000e+05 │
│ │ Condition: S_REGION = 'AMERICA' │
│ └─ TableScan ssb100.supplier est. 200000 rows, cost 1.480000e+05 │
│ Outputs: [S_REGION, S_SUPPKEY] │
│ note: Dynamic Filter is applied for 4 times. │
└───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
from byconity.
Related Issues (20)
- hive外表，进行count超时，多次count后结果不对 HOT 3
- pass wrong para to sendRequest in ReadBufferFromS3::readBigAt HOT 3
- cmake -S /root/ByConity -B build_dev报错 HOT 2
- I hope that the newly added read work node can customize not to participate in the query, and then participate in the query calculation after the core table is manually preloaded HOT 1
- Code: 7100. DB::Exception: Received from localhost:52145. DB::Exception: Failed to get Worker Group data from Resource Manager: DB::Exception: Resource Manager unavailable SQLSTATE: HY000 SQLSTATE: HY000. HOT 4
- how to handle cmake errors of 'circular dependency'
- 启动报错
- 表开启了自动预加载，merge后没有自动预加载 HOT 9
- #官方文档#管理手册#监控集群#VictoriaMetric 指标聚合步骤出错
- Performing 'INSERT OVERWRITE' for more than 30 partitions at the same time has poor performance HOT 11
- ByConity部署问题 HOT 4
- The trash item GC is unable to delete all data.
- trash item清除存在问题 HOT 16
- 列的TTL和表的TTL，数据未能按预期清除 HOT 5
- docker部署安装问题 HOT 1
- 'insert override ' occasionally reports an error HOT 7
- docker启动byconity-server报错 HOT 1
- Byconity 是否支持java udf? HOT 3
- It's too slow to query Bucket CnchMergeTree statistics from system.cnch_parts. HOT 13
- When using the ClickHouse remote function to query the Byconity service, it prompts an error indicating that the account password is incorrect. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from byconity.