Bigdata - Latest posts - DEV Community

Momenul Ahmad

May 10

What Should Be Followed While Scraping Data From Local Citations?

#citation #scraping #data #bigdata

1 min read

Ovais

May 8

Automating Data Processes for Efficiency and Accuracy

#dataextraction #bigdata #datamanagement #datascience

5 min read

Apache Doris

May 8

Auto-increment columns in Apache Doris

#database #dataegnineering #tutorial #bigdata

11 min read

Ovais

May 7

Accelerating ETL Processes for Timely Business Intelligence

#changedatacapture #bigdata #datamanagement #datascience

4 min read

Hitesh

May 7

What to use parquet or CSV?

#datascience #database #python #bigdata

9

3 min read

Kostas Pardalis

May 2

A glimpse into the future of data processing infrastructure.

#database #bigdata #snowflake #spark

9 min read

Ovais

Apr 30

Safeguarding Data Quality By Addressing Data Privacy and Security Concerns

#datascience #bigdata #datamanagement #datamigration

4 min read

Ovais

Apr 30

Blockchain Technology and Data Governance: Enhancing Security and Trust

#blockchain #datamanagement #datascience #bigdata

4 min read

Ovais

Apr 30

Best Practices for Designing an Efficient ETL Pipeline

#etl #datascience #bigdata #datamanagement

4 min read

bfuller

Apr 25

LLMs, DevOps, and Big Data Musings

#devops #llm #ai #bigdata

3 min read

Yusen Meng

Apr 25

Understanding and Mitigating Message Loss in Apache Kafka

#bigdata #datareliability #streamprocessing #distributed

9 min read

Suyash Salvi

Apr 23

Snowflake 101: A Comprehensive Guide to the Data Cloud

#virtualdatawarehouse #snowflake #bigdata #datacloud

4 min read

Paige Niedringhaus

Apr 22

Create a Custom Formatted CSV from Python Data

#python #bigdata #csv

8 min read

ChelseaLiu0822

Apr 18

PySpark： missing value

#pyspark #python #dataengineering #bigdata

2 min read

jbx1279

Apr 13

Are There “Queries over Trillion-Row Tables in Seconds”? Is “N-Times Faster Than ORACLE” an Exaggeration?

#sql #performance #bigdata #database

4 min read

Astra Bertelli

Apr 12

AI enthusiasm #3 - AlphaFold2, a game-changer🧬

#opensource #learning #bigdata #ai

2 min read

AutoMQ

Apr 10

Redis License Change: A Look at the Competitive Game between OSS and Cloud Computing Giants

#bsl #opensource #automq #bigdata

5 min read

elliott cordo for AWS Heroes

Apr 5

MWAA Plugins and Dependency Survival Guide

#airflow #bigdata #dataengineering #aws

2

3 min read

Farrruh

Apr 3

GenAI Model Optimization: Guide to Fine-Tuning and Quantization

#ai #aiops #cloud #bigdata

4 min read

Sandeep

Apr 2

What is Surrogate Key in SQL?

#sql #database #bigdata

2 min read

hexfloor

Mar 28

SQL Pro Tips : industrial AWS Athena SQL using WITH

#aws #database #bigdata #sql

3

4 min read

hexfloor

Mar 28

SQL Pro Tips : industrial GCP BigQuery SQL using WITH

#gcp #sql #database #bigdata

3

5 min read

hexfloor

Mar 28

SQL Pro Tips : industrial Oracle SQL using WITH

#sql #oracle #bigdata #database

3

4 min read

Apache Doris

Mar 27

Variant in Apache Doris 2.1.0: a new data type 8 times faster than JSON for semi-structured data analysis

#database #dataengineering #bigdata #logging

12 min read

Ajay

Mar 27

The Role of Big Data Analytics in BFSI: Leveraging Data for Competitive Advantage

#bigdata #bfsi #data #analytics

4 min read

Jose Luis Sastoque Rey for AWS Community Builders

Mar 27

Data Streaming Architecture

#aws #bigdata #architecture

4

4 min read

Hải Phạm Ngọc

Mar 25

Các khái niệm cơ bản về Apache Kafka

#kafka #datapipeline #bigdata #scalable

1 min read

jbx1279

Mar 23

How come there are tens of thousands of tables in a database

#database #bigdata #sql

2

1

5 min read

vivekpophale

Mar 23

Amazon EMR deployment on EKS

#emr #eks #bigdata #aws

7 min read

Shaheryar

Mar 14

Tools Every Data Scientist Should Know

#datascience #python #machinelearning #bigdata

2 min read

Ovais

Mar 12

The Role of AI in Enhancing Data Governance Strategies

#datascience #bigdata #ai #webdev

5 min read

Ahmed Magdy

Mar 10

Simplifying Big Data Analytics with AWS Serverless EMR

#aws #bigdata #datascience #tutorial

2 min read

Sunny Srinidhi

Mar 8

Understanding the Battle of Database Storage: Row-Oriented vs. Columnar

#database #bigdata #storage #datascience

1

6 min read

anujd64

Mar 3

Hadoop configuration

#hadoop #bigdata

3 min read

Balram Prasad

Feb 29

Unlock the Power of Azure: A Video Playlist for Aspiring Data Engineers and Analysts

#dataengineering #azure #bigdata #database

3 min read

Scofield Idehen

Feb 23

Why Python and SQL are Must-Have Skills for Marketing Analysts in the Age of Big Data

#bigdata #python #datascience #sql

10

6 min read

Ravikanth Kowdeed

Feb 14

Big data with Software Systems

#softwareengineering #bigdata

1

1 min read

Cris Crawford

Feb 10

BigQuery Machine Learning

#bigdata #machinelearning #googlecloud #sql

2

5 min read

nivelepsilon

Feb 10

Understanding Elasticsearch. A Guide for Beginners

#elasticsearch #devops #bigdata #beginners

1

4 min read

Cris Crawford

Feb 10

BigQuery best practices

#dataengineering #bigdata

1

2 min read

Ovais

Feb 7

Leveraging API Management for Building Scalable Applications

#api #bigdata #datascience #webdev

4 min read

Ovais

Feb 7

Data Movement in Multi-Cloud Strategies: Best Practices and Challenges

#datamovement #bigdata #datascience #webdev

4 min read

Peer Mohamed

Feb 5

Data Analytics - Top Institute at Chennai in 2024

#data #analytics #analysts #bigdata

5 min read

Gianluigi Mucciolo for AWS Community Builders

Feb 4

Serverless Apache Zeppelin on AWS

#serverless #tutorial #aws #bigdata

6 min read

Osama Shamout

Feb 2

Leveraging AWS Redshift for Your Organization's Needs

#aws #redshift #bigdata #cloud

8 min read

Crawlbase

Jan 25

How to Scrape Target.com data

#scraping #bigdata #webscrape #python

19 min read

Crawlbase

Jan 25

How to scrape Producthunt profiles and products

#html #javascript #webscraping #bigdata

13 min read

guiadeti

Jan 27

Cursos FIAP Gratuitos: Big Data, Python, DevOps, IA E Outras 16 Opções

#cursogratuito #bigdata #cursosgratuitos #designthinking

6 min read

Nils Whitmont

Jan 24

Supercharge Your S3 Data with AWS S3 Transfer Acceleration

#s3 #aws #performance #bigdata

1

3 min read

Eddie Adams

Jan 22

Data Science Landscape

#datascience #data #bigdata #machinelearning

1 min read

Gaurav Raje for AWS Community Builders

Jan 17

Choosing the right AWS Database

#bigdata #beginners #architecture #database

5

4 min read

Crawlbase

Jan 15

How to Scrape Flipkart Products

#webscraping #bigdata #flipcart #javascript

30 min read

Akshit Zatakia

Jan 14

Mastering Flink Streaming: A Practical Guide to Word Counting for Beginners in Big Data

#apacheflink #streaming #bigdata #java

2 min read

jbx1279

Jan 13

A major culprit in the slow running and collapse of a database

#bigdata #database #datawarehouse #performance

5

10 min read

Cesar Mostacero

Jan 2

In BIG Data, SMALL Things Matter

#bigdata #development #community #data

4 min read

Marcelo Costa

Dec 29 '23

How to use BigQuery Query Caching with Dynamic Wildcard Tables

#bigdata #googlecloud #bigquery #python

2 min read

Crawlbase

Dec 29 '23

How to Scrape Booking.com

#javascript #webscraping #bigdata #scraping

20 min read

Andre Yai

Dec 28 '23

Steps of Big Data Pipeline

#bigdata #aws #datalake

2 min read

عبدالله عياد | Abdullah Ayad for AWS Community Builders

Dec 24 '23

AWS Lake Formation Summarization

#aws #beginners #cloud #bigdata

3

3 min read

jbx1279

Dec 23 '23

Here comes big data technology that rivals clusters on a single machine

#bigdata #database #performance #sql

6

6 min read