DEV Community

Mallikarjun H T
Mallikarjun H T

Posted on • Edited on

Bulk insert data to ES

#elasticsearch #automation #elasticdump

Elastic Search Version 6.2 is used for this example

Elasticdump

take index mappings dump to json 

/usr/bin/elasticdump \
  --type=mapping \
  --input=http://localhost:9200/index_mame \
  --output "/file/to/write/index_name.mapping.json"
Enter fullscreen mode Exit fullscreen mode

take index data dump to json 

/usr/bin/elasticdump \
  --type=data \
  --concurrency=100 \
  --intervalCap=500 \
  --input=http://localhost:9200/index_mame \
  --output "/file/to/write/index_name.data.json"
Enter fullscreen mode Exit fullscreen mode

create index with mappings 

/usr/bin/elasticdump \
 --type=mapping \
  --input "/path/to/maping-file.mapping.json"  \
  --output=http://localhost:9200/index_name
Enter fullscreen mode Exit fullscreen mode

restore data from other index 

/usr/bin/elasticdump \
  --type=data \
  --concurrency=100 \
  --intervalCap=500 \
  --input "/file/to/data-dump.data.json"  \
  --output=http://localhost:9200/index_name
Enter fullscreen mode Exit fullscreen mode

_source only backup 

/usr/bin/elasticdump \
  --type=data \
  --concurrency=100 \
  --intervalCap=500 \
  --sourceOnly=true \
  --input=http://localhost:9200/index_name \
  --output "/file/to/data-dump.data.json"
Enter fullscreen mode Exit fullscreen mode

_bulk API 

curl -XPOST localhost:9200/index_name/Document_Type/_bulk -H 'Content-Type: application/json' --data-binary @/path/to/file
Enter fullscreen mode Exit fullscreen mode

Top comments (0)

Read next

zpillsbury profile image

How to make an AI agent with OpenAI, Langgraph, and MongoDB 💡✨

zpillsbury -

erykpiast profile image

The guiding light of a North Star - Bringing long-term vision to our Frontend transformation at Hotjar

Eryk Napierała -

shannonlal profile image

Enhancing Hybrid Search in MongoDB: Combining RRF, Thresholds, and Weights

Shannon Lal -

aryan_shourie profile image

The JavaScript History API

Aryan Dev Shourie -