DEV Community

Mike Houngbadji
Mike Houngbadji

Posted on • Edited on

Apache Spark SQL: CTAS USING CSV with specific delimiter

#sql #spark #database #tips

To use CTAS (Create table as Select) in Apache Spark with a specific delimiter using the OPTION syntax:

CREATE TABLE sample_table
USING CSV
OPTIONS ('delimiter'='|')
AS
SELECT ....
Enter fullscreen mode Exit fullscreen mode

SparkSQL Documentation

PS:
I wrote this to also help myself retrieve the solution faster.

Top comments (0)

Read next

bladepipe profile image

Move Data from Oracle to ClickHouse in Minutes

BladePipe -

pentest_testing_corp profile image

Preventing SQL Injection (SQLi) in React.js Apps

Pentest Testing Corp -

bkhebert profile image

Three Tier Architecture. Overview and Each tier explained.

Barrington Hebert -

leewalter profile image

Exploring new AWS Aurora DSQL. What is it ? Why it is important ? How to quickstart ?

Walter Lee -