DEV Community

Mike Houngbadji
Mike Houngbadji

Posted on • Updated on

Apache Spark SQL: CTAS USING CSV with specific delimiter

#sql #spark #database #tips

To use CTAS (Create table as Select) in Apache Spark with a specific delimiter using the OPTION syntax:

CREATE TABLE sample_table
USING CSV
OPTIONS ('delimiter'='|')
AS
SELECT ....
Enter fullscreen mode Exit fullscreen mode

SparkSQL Documentation

PS:
I wrote this to also help myself retrieve the solution faster.

Top comments (0)

Read next

tylerlwsmith profile image

Upsert a row in a DB that doesn't use primary keys or unique constraints

Tyler Smith -

jagroop2001 profile image

SQL Cheatsheet: A Handy Reference for SQL Commands with Examples

Jagroop Singh -

mrcaption49 profile image

ACID properties in SQL

Pranav Bakare -

alexmercedcoder profile image

A Guide to dbt Macros - Purpose, Benefits, and Usage

Alex Merced -