Can not handle `'` characters in PARTITIONED BY clause about arrow-datafusion HOT 3 OPEN

I'd like to try this, from the description,

Until the partition by parsing uses ColumnDef

So maybe trying to make partition by use ColumnDef, currently, my plan is:

1. Make table_partition_cols field in

   arrow-datafusion/datafusion/sql/src/parser.rs

   Line 206 in 39f4aaf

   pub table_partition_cols: Vec<String>,

   CreateExternalTable statement to Vec<ColumnRef>
2. make parse_partitions return ColumnRef like parse_columns.

   arrow-datafusion/datafusion/sql/src/parser.rs

   Line 542 in 39f4aaf

   fn parse_partitions(&mut self) -> Result<Vec<String>, ParserError> {

3. In external_table_to_plan, do the same thing to table_partition_cols like column_defaults

   arrow-datafusion/datafusion/sql/src/statement.rs

   Lines 984 to 987 in 39f4aaf

   	let column_defaults = self
   	.build_column_defaults(&columns, &mut planner_context)?
   	.into_iter()
   	.collect();

So this will not convert the Ident value to string too early, but I also doubt whether it would fix this. I encountered similar issue related to ' characters in my past experience and it's a bit tricky.

from arrow-datafusion.

@metesynnada I wonder if you have any thoughts on the suggestion above from @yyy1000 ?

from arrow-datafusion.

I believe this is a good start.

from arrow-datafusion.