Shivani · AWS Python Data Engineer · 4.2+ yrs
Mid-LevelAbout Shivani
Shivani is a skilled Data Engineer with over 4 years of experience in designing and developing data pipelines for scalability, reliability, and security. She has hands-on experience with various AWS services, including Lambda, Glue, and Redshift, and is proficient in Python and SQL databases. Her expertise extends to real-time data streaming solutions and data warehousing, making her a valuable asset for any data-driven organization.
Core expertise
Additional skills(8)
Why hire Shivani?
Designed and developed data pipelines for scalability, reliability, and security.
Expertise in query optimization for Redshift and PostgreSQL.
Developed and deployed robust ETL pipelines for data processing across multiple projects.
Successfully migrated data systems to AWS cloud infrastructure and next-gen platforms.
Implemented data enrichment and data lineage tracking for improved data quality and governance.
Automated data extraction and loading processes into data warehouses like Redshift.
Optimized data queries and managed database maintenance for improved performance.
Successfully transitioned systems to next-gen products using modern data tools.
Project highlights(4)
Automated Email Extraction Tool – Data Engineer
Overview: Developed a tool to automate email address extraction using first name, last name, and company domain. Responsibilities: Extracted valuable information, performed data enrichment, and maintained data lineage.
Key outcomes:
Successfully automated the process of finding and extracting email addresses.
Automated data loading into Redshift.
Next-Gen Product Transition – Data Engineer
Overview: Focused on transitioning to next-gen products leveraging Talend, Golden Gate, Python, and AWS services. Responsibilities: Developed robust ETL pipelines for comprehensive data processing.
Key outcomes:
Successfully transitioned systems to next-gen products using modern data tools.
Developed and deployed comprehensive ETL pipelines for data processing.
Forecasting Model Data Management – Data Engineer
Overview: Managed data ingestion from multiple channels (email, FTP, Amazon S3) into ETL pipelines. Responsibilities: Processed collected data to feed into forecasting models.
Key outcomes:
Successfully managed data from diverse sources for forecasting models.
Automated database maintenance and job monitoring.
Data Extraction from PDFs – Data Engineer
Overview: Extracted valuable information from PDF files and stored it in JSON format in AWS S3. Responsibilities: Led data extraction, enrichment, and loading processes.
Key outcomes:
Successfully extracted and structured data from unstructured PDF files.
Ensured data quality through enrichment and maintained data lineage.
4.2+ years of industry experience
At a Glance
Single contract. Billed in USD.
Typically responds within 4 business hours.
Top Skills
Vetted by WitaristNot sure if this is the right fit?
Tell us your requirements and we'll match you with the best candidates.
Shivani
Data Engineer