Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

can PostgreSQL and SQLite store LargeUtf8? #12

Open
aljazerzen opened this issue Feb 22, 2024 · 0 comments
Open

can PostgreSQL and SQLite store LargeUtf8? #12

aljazerzen opened this issue Feb 22, 2024 · 0 comments

Comments

@aljazerzen
Copy link
Owner

aljazerzen commented Feb 22, 2024

In other words, do they support storing text/blob that has length larger than 2^32 (4GiB)?

If yes, then the type of TEXT should always be LargeUtf8 (and Uft8 is coerced into LargeUft8).
If no, then the type of TEXT should always be Utf8 (and coercion is reversed).
Similar for binary types.

DuckDB kindly answers this question by returning a schema that contain Utf8 when you declare a column as VARCHAR or TEXT.

This means that it might not be possible to store an Arrow in a database. We need an error for that. And we need to indicate that in coerce_type.

@aljazerzen aljazerzen changed the title does PostgreSQL and SQLite store Utf8 or LargeUtf8? can PostgreSQL and SQLite store LargeUtf8? Feb 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant