List: Big data concepts | Curated by Sairamdgr8 -- An Aspiring Full Stack Data Engineer | Medium

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

May 14, 2023

3 stories

2 saves

Big data concepts

In

Level Up Coding

by

Luís Oliveira

Polars vs PySpark: Testing with Middle Size Data

Checking execution time

May 5, 2023

Polars vs PySpark: Testing with Middle Size Data

May 5, 2023

Sanjay T

Scaling Apache Spark Pipelines from 2TB/day to 100TB/day

In this blog post, we will discuss some of the key things which we did in Microsoft for scaling Spark pipelines from 2 TB/day to 100 TB/day…

Jan 17, 2023

Scaling Apache Spark Pipelines from 2TB/day to 100TB/day

Jan 17, 2023

Mykola-Bohdan Vynnytskyi

Understanding Hadoop. Yarn

Yet another article about Yet Another Resource Negotiator

Aug 14, 2022

Understanding Hadoop. Yarn

Aug 14, 2022

Sairamdgr8 -- An Aspiring Full Stack Data Engineer
421 Followers
Data Engineer @ AWS | SPARK | PYSPARK | SPARK SQL | enthusiast about #DataScience #ML Enthusiastic#NLP#DeepLearning #OpenCV-Face Recognition #ML deployment
Following
The Medium Blog
Stephen David-Williams
Tomas Peluritis
Manikandan Muthiah
See all (27)

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams