Comments (3)
Ok, so pyarrow
won't handle casts from stringy dates to date-types, but DuckDB will.
there's pyarrow.compute.strptime
, but we'd have to think about how many date format strings to try before bailing out
from ibis.
I'd be fine with literally just "yyyy-mm-dd" format. I am only running into this in testing, when constructing literals. If someone else has real data they are working with, I think it wouldn't be too much to expect them to either format it that way, or convert it to a numpy datetime or a python datetime or something less ambiguous.
Related to this, but I think worth thinking about, is ideally I want to be able to create all ibis datatypes without needing to import anything. eg using the same logic as used in ibis.date(str)
, etc:
import ibis
ibis.memtable(
{
"uuid": ["9ff13914-a718-48b3-a746-5114cff95d56"],
# "uuid": [1234], # would be awesome to specify as an int too
# "date": ["1970-01-01"], # currently errors
# "time": ["12:34:56"], # currently errors
# "timestamp": ["2023-01-02T03:04:05"], # currently errors
},
schema={
"uuid": "uuid",
# "date": "date",
# "time": "time",
# "timestamp": "timestamp",
},
).cache().execute()
This would make testing much easier.
from ibis.
Removing the bug label. This isn't broken functionality, it's a feature request for specific new behavior.
from ibis.
Related Issues (20)
- feat: add a table_exists(table_name) api HOT 1
- bug: `to_sql` always shows DuckDB SQL for a memtable even if there's a default backend set HOT 1
- Polars backend can read only 1 csv HOT 1
- docs: add ops docstrings
- ci: more granular cloud run labels
- feat: allow to connect to a duckdb named in-memory database
- feat: better distinguish ibis scalars from evaluated results in interactive repr
- feat: add databricks support HOT 2
- bug: .insert() uses column position, not names, to align HOT 1
- feat(settings): generalize and extend settings passthrough dictionary
- feat: Leverage SQLGlot AST for query parsing HOT 2
- bug: EOFError when running ibis tutorial code with ClickHouse backend HOT 4
- bug: The function `parse_sql` fails when `COUNT(*)` is in the query HOT 4
- feat: Add the ability to pass regex flags HOT 2
- Config Value spark.sql.mapKeyDedupPolicy not Supported by Databricks SQL Warehouse HOT 1
- feat: profiling? HOT 2
- bug: ibis mssql backend can not create table for very simple pandas dataframe HOT 3
- bug: cannot convert mysql `datetime(6)` type to ibis datatype HOT 1
- bug: Failed to load Postgres table containing ENUM HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ibis.