Sairamdgr8 -- An Aspiring Full Stack Data Engineer – Medium

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Instagram Data Analytics project using Pyspark,Snowflake,PowerBI

5 min readApr 26, 2024

--

Instagram Data Analytics project using Pyspark,Snowflake,PowerBI

--

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Acing Apache Spark DataFrames Interview Questions Series using PySpark with Window functions

In this blog we will see a scenario based Dataframe question.

1 min readFeb 25, 2024

--

1

Acing Apache Spark DataFrames Interview Questions Series using PySpark with Window functions

--

1

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Acing Apache Spark DataFrames Interview Questions Series using PySpark with Lead and Lag

In this blog we will see a scenario based Dataframe question.

1 min readFeb 19, 2024

--

Acing Apache Spark DataFrames Interview Questions Series using PySpark with Lead and Lag

--

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Drive Pyspark shell scripts for Cloud agnostics data pipelines

In this blog we going to discuss about working with shell scripts for pyspark codes.

4 min readDec 25, 2023

--

Drive Pyspark shell scripts for Cloud agnostics data pipelines

--

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Building SchemaValidation Project with Pyspark

In this blog we going to discuss about working with schema validation of Source data using PYSPARK.

3 min readDec 3, 2023

--

2

Building SchemaValidation Project with Pyspark

--

2

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Working with JSON data structure using PySpark series -4

In this blog we going to discuss about working with json file normalizing from json to structured row -columnar format using PYSPARK.

2 min readAug 3, 2023

--

Working with JSON data structure using PySpark series -4

--

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Working with Complex JSON data structure using PySpark series - 3

In this blog we going to discuss about working with json file and removing some unwanted data in json file using pyspark.

2 min readJun 28, 2023

--

Working with Complex JSON data structure using PySpark series - 3

--

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Acing Apache Spark Senario-based Question Series-5 using PySpark Dataframes

Joining two tables Vetrically when no common column is involved in Pyspark using monotonically_increasing_id() & zipwithIndex() functions.

1 min readApr 28, 2023

--

Acing Apache Spark Senario-based Question Series-5 using PySpark Dataframes

--

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Python interview questions Series-3 frequently asked in written tests.

Write a function solution that given a string S consisting of N letters ‘a’ and/or ‘b’ return True when all the occurences of letter ‘a’…

1 min readMar 16, 2023

--

Python interview questions Series-3 frequently asked in written tests.

--

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Acing Apache Spark Senario-based Question Series-4 using PySpark Dataframes

Understanding the famous Employee analytical Questions on SQL to be derived in pythonic way using PySpark

2 min readMar 11, 2023

--

Acing Apache Spark Senario-based Question Series-4 using PySpark Dataframes

--

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Sairamdgr8 -- An Aspiring Full Stack Data Engineer

Data Engineer @ AWS | SPARK | PYSPARK | SPARK SQL | enthusiast about #DataScience #ML Enthusiastic#NLP#DeepLearning #OpenCV-Face Recognition #ML deployment

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams