DEV Community

Mike Houngbadji
Mike Houngbadji

Posted on • Edited on

Apache Spark SQL: CTAS USING CSV with specific delimiter

#sql #spark #database #tips

To use CTAS (Create table as Select) in Apache Spark with a specific delimiter using the OPTION syntax:

CREATE TABLE sample_table
USING CSV
OPTIONS ('delimiter'='|')
AS
SELECT ....
Enter fullscreen mode Exit fullscreen mode

SparkSQL Documentation

PS:
I wrote this to also help myself retrieve the solution faster.

Top comments (0)

Read next

franckpachot profile image

You Probably Don't Need Serializable Isolation

Franck Pachot -

markyu profile image

The True Cost of Poor Data Quality: Why It Matters and How to Improve It

Mark Yu -

jacktt profile image

[Postgres] Isolation levels

JackTT -

alexmercedcoder profile image

Getting Started with Data Analytics Using PyArrow in Python

Alex Merced -