Shivam · Senior AWS Data Engineer · 6+ yrs
Mid-LevelAbout Shivam
Shivam Kumar is a skilled Data Engineer specializing in AWS technologies and data pipeline orchestration. With over 6 years of experience, he has successfully managed large-scale data lakes and implemented efficient ETL processes. His expertise extends to integrating various data sources and developing insightful dashboards for strategic decision-making.
Core expertise
Additional skills(20)
PySpark
HTML
GitLab
GitWhy hire Shivam?
Managed a 75+ TB AWS Data Lake with 99.9% reliability.
Achieved 80% reduction in migration time through optimized ETL processes.
Developed 10+ QuickSight Dashboards that influenced strategic decisions.
Implemented a real-time user data collection pipeline capable of ingesting 10K+ records daily.
Reduced manual efforts by 60% through Salesforce-WebEngage integration.
Pioneered and managed a 75+ TB AWS Data Lake with 99.9% reliability.
Achieved an 80% reduction in migration time and 99% improvement in data reliability.
Implemented a real-time user data collection pipeline (FAST API) capable of ingesting 10K+ records daily.
Reduced data processing time by 95% for academic result uploads, enabling 99% faster access to insights.
Project highlights(4)
Salesforce-WebEngage Integration – Senior Data Engineer
Overview: Built an end-to-end integration for migrating objects from Salesforce to S3 and performing ETL for incremental data to WebEngage. Responsibilities: Automated the entire data flow using EventBridge, Lambda, and Glue for daily processing. Integrated and processed 0.5M+ records daily for 10+ attributes. Empowered decision-making and reduced manual efforts by 60%.
Key outcomes:
Reduced manual efforts by 60%
Processed 0.5M+ records daily
User Data API – Senior Data Engineer
Overview: Implemented a FAST API pipeline for real-time user data collection across platforms. Responsibilities: Seamlessly ingested user data into a Data Lake via Kinesis DataStream. Enhanced insights reporting for collected data.
Key outcomes:
Ingested 10K+ records daily for real-time insights
Academic Integration – Senior Data Engineer
Overview: Engineered a user-friendly pipeline for Academic heads to upload exam results via a web interface. Responsibilities: Reduced data processing time by 95%. Enabled 99% faster access to reliable insights for dashboards and developments through RDS.
Key outcomes:
Achieved 95% reduction in data processing time
Enabled 99% faster access to reliable insights
User onboarding to QuickSight – Data Engineer Intern
Overview: Built an automated flow for employee onboarding to AWS QuickSight. Responsibilities: Automated credentialing and role management for new and existing employees. Managed account deletion upon employee departure automatically. Reduced onboarding time by 90% and man-hours by 95%.
Key outcomes:
Reduced onboarding time by 90%
Reduced man-hours by 95%
6+ years of industry experience
- •User Data API— Senior Data EngineerAPIs · Python · Kinesis DataStream
- •User onboarding to QuickSight— Data Engineer InternAWS QuickSight · AWS · Python · SQL +4
- •Academic Integration— Senior Data EngineerSQL · AWS · Spark · PySpark +6
At a Glance
Single contract. Billed in USD.
Typically responds within 4 business hours.
Top Skills
Vetted by WitaristNot sure if this is the right fit?
Tell us your requirements and we'll match you with the best candidates.
Shivam
AWS Data Engineer