DEV Community

Discussion on: What is faster? Read file CSV or Oracle table?

Collapse
 
rhymes profile image
rhymes

It might depend on the load and frequency of these ETL jobs and data format.

Dumping a table allows you to decouple the extraction and insertion steps, which means extraction could be done by a serial job and insertion to the destination DB could be done in parallel. Granted this can also be accomplished by using an intermediate programming language but ETL tools are normally equipped at handling massive CSV.

Depending on how the data is it might not matter to have data type conversion in place.