Devesh  ·  AWS Spark Data Engineer  ·  3+ yrs

Junior
Bengaluru3+ years experienceonsite
Available within 48 hrs

About Devesh

Devesh is a skilled Data Engineer with a strong background in developing data pipelines and utilizing big data technologies. His expertise includes working with AWS services and various data processing tools to create scalable solutions. He has contributed to projects across multiple domains, including finance and e-commerce, showcasing his ability to adapt and deliver results in diverse environments.

Core expertise

Python
language
10/10
Apache Spark
tooling
10/10
SQ
SQL
language
9/10
AWS
cloud
9/10
AA
Apache Airflow
devops
9/10
Snowflake
database
8/10
Apache Kafka
messaging
8/10

Additional skills(23)

PythonApache SparkApache KafkaHadoopDjangoJavaScriptPostgreSQLPysparkHiveHTML

Why hire Devesh?

Production deploy authorityBuilt from scratch / 'ground up'

Designed and maintained complex data pipelines for large-scale data processing

Automated data workflows for banking operations, enhancing efficiency

Implemented real-time event data processing platforms for user behavior tracking

Developed a full-featured E-Commerce website with secure payment integration

Successfully designed and maintained complex data pipelines for large-scale data processing using Spark

Engineered Spark ETL scripts to clean, transform data, and calculate scores for financial analytics, supporting data-driven decision-making

Automated data workflows for banking operations and integrated diverse data sources into centralized data lakes

Project highlights(5)

L&T Finance Loan Origination System – Data Engineer

Overview: This project focused on enhancing Loan Origination System (LOS) and Business Rules Engine (BRE) processes for financial products. Responsibilities: Designed and implemented Spark ETL scripts to clean, transform data, and calculate scores based on various financial parameters. Ingested data from diverse sources into a centralized Data Lake using AWS S3, EMR, Glue, and Athena.

PythonApache SparkAWS S3AWS EMRAWS GlueAWS AthenaApache Airflow

Key outcomes:

  • Enhanced LOS and BRE processes through advanced data analytics

  • Supported data-driven decision-making for various Lines of Business

Good Data Analytics Event Data Collection – Data Engineer

Overview: This project focused on building an open-source data collection platform that generates complete, accurate, and well-structured event data across all platforms and channels. Responsibilities: Collected raw Snowplow events data via Stream Collector, sent to Apache Kafka Sink, and transformed raw data into TSV format using Stream Enricher.

PythonSnowplow AnalyticsApache KafkaApache SparkHadoop

Key outcomes:

  • Implemented a robust open-source data collection platform

  • Enabled continuous data ingestion and transformation using Spark and Kafka

E-Commerce Website Development – Software Developer

Overview: Developed a full-featured E-Commerce website allowing customers to buy electronic gadgets, physical goods, and clothes. Responsibilities: Developed the website using the Django Framework for the backend, implemented features for customers to manage products and process online payments.

PythonDjangoJavaScriptPostgreSQL

Key outcomes:

  • Developed a complete E-Commerce platform with core shopping functionalities

  • Implemented secure payment gateway integration

User Behavior Tracking – Data Engineer

User Behavior Tracking — gathering + analyzing website event data via Snowplow Analytics with HDFS storage. PySpark + Spark-Streaming + Snowplow + Apache Kafka + Hadoop.

PysparkSpark-StreamingSnowplow AnalyticsApache KafkaHadoopHiveShell-ScriptsPythonJavaScript

Key outcomes:

  • Enabled comprehensive user behavior tracking on a website.

  • Implemented real-time data processing for event data.

  • Ensured structured storage of partitioned event data for efficient querying.

  • Utilized Snowplow Analytics for accurate and complete data collection.

E-Commerce Website – Software Developer

E-Commerce Website — full-featured site with cart + wish lists + secure online payment. Django + HTML + CSS + JavaScript + PostgreSQL.

DjangoHTMLCSSJavaScriptPostgreSQLDockerAjaxJQueryPaypalPython

Key outcomes:

  • Developed a complete E-Commerce platform with core shopping functionalities.

  • Implemented secure payment gateway integration.

  • Created a custom admin panel for efficient management of website operations.

  • Enabled sales and customer reporting for business insights.

3+ years of industry experience

FinTech3 projects
  • •L&T Finance Loan Origination System— Data EngineerPython · Apache Spark · AWS S3 · AWS EMR +3
  • •E-Commerce Website Development— Software DeveloperPython · Django · JavaScript · PostgreSQL
  • •E-Commerce Website— Software DeveloperDjango · HTML · CSS · JavaScript +6
InsuranceReported in resume
BankingReported in resume
Logistics & Supply ChainReported in resume

Ready to work with Devesh?

Onboard within 48 hours. No long hiring cycles, no recruiter middleman.

At a Glance

LocationBengaluru
Experience3+ years
Work modeonsite
Direct hirePossible
Start within48 hours
From$2,299/ month

Single contract. Billed in USD.

Typically responds within 4 business hours.

5-day replacement guarantee
48-hour onboarding, single invoice
Direct chat — no recruiter middleman

Top Skills

Python
10/10
Apache Spark
10/10
SQL
9/10
AWS
9/10
Apache Airflow
9/10
Seniority signals
Owns production deploysGreenfield architect
VerifiedVetted by Witarist
Technical skills assessed & verified
Background & identity checked
English communication verified
Ready to onboard in 48 hours

Not sure if this is the right fit?

Tell us your requirements and we'll match you with the best candidates.

Devesh

AWS Data Engineer