Sachin · Senior AWS Spark Data Engineer · 7+ yrs
SeniorAbout Sachin
Sachin is an experienced Data Engineer specializing in building efficient data pipelines and automating data processes. With a strong focus on data accuracy and security, he has successfully integrated diverse data sources and leveraged cloud services like AWS and Google Cloud for robust ETL solutions. His expertise in Big Data technologies, including Apache Spark and Airflow, enables him to deliver high-performance data processing solutions.
Core expertise
Additional skills(26)
Bootstrap
HTMLWhy hire Sachin?
Designed and implemented cutting-edge data pipelines driving actionable insights for clients.
Spearheaded projects that increased data processing efficiency and ensured data accuracy and security.
Proficiently utilized AWS Glue and Google Dataflow for robust ETL pipeline creation and management.
Leveraged Apache Airflow to automate and schedule complex data workflows across diverse systems.
Successfully integrated Big Data technologies like Spark and Hadoop for large-scale data processing and analysis.
Built Project-AI — AWS Glue data pipeline + schema/jobs/trigger config + Datacatalog as Data Engineer
Built Health channel — GCP services automation + data workflows + accessibility + decision-making as Data Engineer
Built MCE — multi-source data integration with Apache Airflow + Snowflake + PySpark + SFTP + AWS S3 as Data Engineer
Built Merchant Leanscale — web scraping Amazon + Ali Express + Walmart + Asos.com + MongoDB storage as Data Engineer
Project highlights(4)
E-commerce Order Automation – Data Engineer
Overview: Involved in data scraping from websites like Amazon, Ali Express, Walmart, and Asos.com. Responsibilities: Created scripts for scraping data from major e-commerce websites and storing the data inside MongoDB. Used Python for XML, JSON processing, data exchange, and business logic implementation. Developed data-driven applications using Python for order automation.
Key outcomes:
Created scripts for scraping data from major e-commerce websites.
Healthcare Data Management – Data Engineer
Overview: Implemented a robust data management and automation solution using Google Cloud Platform (GCP) services. Responsibilities: Developed, deployed, and maintained data pipelines using Google Dataflow for ETL. Implemented efficient data ingestion and integration processes from various sources into Google BigQuery.
Key outcomes:
Streamlined data workflows and improved data accessibility and decision-making.
Data Pipeline Automation – Data Engineer
Overview: Streamlined data operations, enhanced data reliability, and empowered data-driven decision-making. Responsibilities: Designed, developed, and maintained data pipelines using Apache Airflow to automate and schedule data workflows.
Key outcomes:
Optimized SQL queries and data transfer processes within Snowflake.
Merchant (Leanscale) – Data Engineer
Merchant (Leanscale) — Amazon + Ali Express + Walmart + Asos.com scraping + MongoDB.
Key outcomes:
Created scripts for scraping data from major e-commerce websites (Amazon, Ali Express, Walmart, Asos.com)
Developed data-driven applications using Python for data scraping and order automation
Deployed scripts on AWS server with MongoDB database
7+ years of industry experience
- •E-commerce Order Automation— Data EngineerPython · MongoDB · AWS
At a Glance
Single contract. Billed in USD.
Typically responds within 4 business hours.
Top Skills
Vetted by WitaristNot sure if this is the right fit?
Tell us your requirements and we'll match you with the best candidates.
Sachin
Data Engineer