Spark

6 min read

Musa Atlıhan

Oct 26

Predicting machine failures with distributed computing (Spark, AWS EMR, and DL)

#spark #emr #bigdata #deeplearning

10 min read

Sachin Gupta

Oct 2

can a map function be executed on multiple executors for an item in RDD.

#spark

1 min read

Ken Tune for Aerospike

Oct 21

Using Aerospike Connect For Spark

#aerospike #spark

5 min read

Gustavo Martin Morcuende for Adevinta Spain

Oct 15

Spark: unit, integration and end-to-end tests.

#scala #spark #testing

11

5 min read

Dust on Mint

Aug 29

Spark Side Menu Micro-Interactions Deconstruction

#microinteraction #email #spark #frontend

2 min read

Saša Zejnilović

Sep 20

Working with nested structures in Spark

#spark #bigdata #scala #library

5 1

3 min read

Moshe Roth

Sep 28

Spark Journey begins...

#spark #python #bigdata

3 min read

Manikantha Nekkalapudi

Sep 14

Intoduction to Apache Spark

#dataengineering #apachespark #bigdata #spark

6 min read

Samuele Resca

Sep 2

Large-Scale Data Quality Verification in .NET PT.1

#dotnet #spark #dotnetcore #dataengineering

9 min read

Bartosz Gajda

Aug 10

Unit Testing Apache Spark Structured Streaming using MemoryStream

#spark #apachespark #testing #bigdata

4 min read

Kevin Wallimann

Jul 11

How to make a column non-nullable in Spark Structured Streaming

#spark

2 min read

Joy Uche-Nwachukwu

Jun 30

The Big Data Bravura: Introducing Apache Spark

#bigdata #spark #pyspark #datascience

19 2

3 min read

Hugo Estrada S.

Jun 1

Apache Spark and Databricks 101 pt. I - The Big Picture

#databricks #spark #datascience

2 min read

Ben Steadman

May 3

Python, Spark and the JVM: An overview of the PySpark Runtime Architecture

#python #spark #pyspark #architecture

4 min read

Ryan

Feb 27

Writing Spark: Scala Vs Java

#spark #scala #java

8 2

7 min read

Jan 14

The 5-minute guide to using bucketing in Pyspark

#spark #python #bigdata

8 4

4 min read

Jakub T

Jan 1

How to run pyspark with additional Spark packages

#spark #python #pyspark #delta

2 min read

Andrew (he/him)

Dec 13 '19

Installing and Running Hadoop and Spark on Ubuntu 18

#hadoop #spark #java #scala

24 5

10 min read

Subash Sivaji

Nov 27 '19

Types of Apache Spark tables and views

#spark #databricks

8

2 min read

Michel's fanboi

Oct 12 '19

Path to become a junior+ data engineer?

#help #distributedsystems #spark #hadoop

4 1

1 min read

Aug 17 '19

Spark. Anatomy of Spark application

#bigdata #spark #python

9

6 min read

Flo

Apr 6 '19

Live notetaking as I learn Spark

#spark #distributedsystems #learningplan

24 2

11 min read

Andrew (he/him)

Nov 21 '18

Big Data Analysis with Hadoop, Spark, and R Shiny

#hadoop #spark #r #bigdata

28 1

12 min read

Andrew (he/him)

Nov 5 '18

Installing and Running Hadoop and Spark on Windows

#hadoop #spark #windows #tutorial

45 57

8 min read

Dhoomil B Sheta

Nov 5 '18

Processing Streaming Twitter Data using Kafka and Spark - Part 2: Creating Kafka Twitter producer

#kafka #spark #firebase #bigdata

21 5

7 min read

Dhoomil B Sheta

Nov 5 '18

Processing Streaming Twitter Data using Kafka and Spark — The Plan

#kafka #spark #bigdata

9

2 min read

Frank Rosner

Dec 17 '17

Monitoring Data Quality in Data Science Applications

#showdev #datascience #scala #spark

26

8 min read

Bill Schneider

Dec 11 '17

Learning Scala for Spark, or, what's up with that triple equals?

#spark #scala

16

2 min read

Shad Amez

Jul 10

Why are we building DevOps platform for Big Data?

#spark #devops #bigdata #motivation

3 min read

Bartosz Gajda

Aug 10

Setting up IntelliJ IDEA for Apache Spark and Scala development

#spark #scala #intellij #tutorial

2 min read

crowintelligence

Jun 30

Graph Theory and Network Science for Natural Language Processing – Part 2, Databases and Analytics Engines

#networkscience #graphtheory #spark #janusgraph

6 min read

Sascha Dittmann

Jul 18

How to create a low-cost Apache Spark cluster on Microsoft Azure

#bigdata #azure #spark #azurebatch

4 min read

Sascha Dittmann

Jul 18

Configuring an Azure VNET to use AZTK in mixed mode

#bigdata #azure #spark #azurebatch

3 min read

Riccardo Bernardini

Jul 9

Proving the correctness of a binary search procedure with SPARK/Ada

#spark #ada #formalchecking #tutorial

9 min read

Avantika Shergil

Jul 10

Hadoop vs Spark: Which is a better framework to select for processing Big Data?

#bigdataframework #hadoop #spark #bigdata

5 min read

Kovid Rathee

Jun 2

When To Cache?

#datascience #python #pyspark #spark

2 min read

Akalanka Weerasooriya

May 28

Building a Spark cluster with two PCs and a Raspberry Pi.

#spark #hadoop #bigdata #raspberrypi

5 min read

Kevin Mack

May 18

Weekly Links – 5/18

#links #privatelink #spark

2 1

2 min read

Cecil L. Phillip 🇦🇬 for Microsoft Azure

May 18

On.NET Episode: Scaling .NET for Apache Spark processing jobs

#dotnet #azure #bigdata #spark

1 min read

Cecil L. Phillip 🇦🇬 for .NET

May 12

On.NET Episode: Data processing with .NET for Apache Spark

#dotnet #spark #bigdata #azure

1 min read

Saša Zejnilović

May 1

How to compare your data in/with Spark

#spark #scala #testing #bigdata

6 min read

Pushpa Sree Potluri

Apr 27

Environment setup for Data Analysis with PySpark and Spark SQL

#machinelearning #datascience #python #spark

2 min read

kambala yashwanth

Jan 27

Implementing Spark in Spring-boot

#springboot #spark #restapi

1 min read

Shad Amez

Jan 12

spark-submit command builder with live preview

#spark #bigdata #productivity #scala

1 min read

Sameh Sharaf

Jan 9

Databricks Delta Lake - A Friendly Intro

#databricks #delta #datalake #spark

10

1 min read

anilkulkarni87

Jan 4

How to view Spark History logs locally

#logs #spark #sparkhistory #tutorial

1 min read

Francisco Ruiz A

Dec 31 '19

My Databricks article compilation of 2019

#databricks #delta #spark #bigdata

2 min read

Igor Bertnyk

Oct 29 '19

Yet another journey to Cloudera Spark and Hadoop Developer Certification - CCA 175

#spark #cloudera #certification #cca175

6 min read

Todd Birchard for Hackers And Slackers

Oct 10 '19

Structured Streaming in PySpark

#spark #apache #python #dataengineering

10

9 min read

lukaszkuczynski

Oct 6 '19

Spark is Pandas on steroids

#pandas #spark #databricks

8

5 min read

Samuele Resca

Sep 30 '19

Getting started with Apache Spark using .NET Core

#dotnet #machinelearning #spark #dotnetcore

11 1

7 min read

Saloni Goyal

Sep 25 '19

Introduction to Apache Spark

#spark #hadoop #beginners #mapreduce

3 min read

Sep 22 '19

Azure Blob Storage with Pyspark

#python #spark #bigdata

10 1

2 min read

Sumit Kumar

Sep 21 '19

Why we chose Apache Spark for ETL (Extract-Transform-Load)

#spark #dataengineering #pyspark #whywechose

22

6 min read

goatmale

Sep 6 '19

Three things from today - 9/6

#devjournal #kubernetes #spark #datascience

7 1

1 min read

goatmale

Sep 5 '19

Three things from today - 9/5

#devjournal #kubernetes #spark #datascience

1 min read

AsifYar

Aug 31 '19

Divide RDD into sub parts

#scala #spark

2 min read

goatmale

Aug 30 '19

Three things from today - 8/30

#devjournal #spark #kubernetes

8

2 min read