Rahul is a seasoned Data Engineer with extensive experience in designing and implementing data models, developing data pipelines, and managing cloud-based solutions. He has worked on diverse projects across E-commerce, HealthTech, and Data Analytics, showcasing his ability to handle complex data transformations and migrations. Rahul is proficient in a wide range of technologies including Python, PySpark, Snowflake, and various cloud platforms, making him a versatile asset for any data-driven organization.
Developed and optimized data pipelines for large-scale data migrations.
Implemented CI/CD practices through Azure DevOps for seamless delivery.
Built RESTful APIs using Django and FastAPI for efficient data access.
Managed and optimized databases including Snowflake and PostgreSQL.
Migrated over 400 jobs to Snowflake, significantly improving data accessibility.
Automated ETL processes, reducing manual intervention by 50%.
Successfully delivered high-quality, scalable software solutions on time and within budget.
Overview: Zid is a cutting-edge e-commerce platform tailored for SaaS applications in Arabic countries. Responsibilities: Developed data pipelines using Medolina architecture and DBT to process data for analytics. Created Spark pipelines for rapid data transformation and processing for reporting. Managed and optimized Postgres and Snowflake databases, including performance optimization.
Key outcomes:
Ensured smooth operation and maintenance of Postgres and Snowflake databases.
Monitored Spark jobs for timely execution and resolved issues.
Overview: This project focused on transforming healthcare in the United States. Responsibilities: Developed data pipelines using PySpark, Postgres, Python, and Airflow to process healthcare data for machine learning. Collaborated on ETL processes, ensuring data accuracy and consistency.
Key outcomes:
Achieved seamless continuous integration and delivery (CI/CD) with high reliability.
Overview: Revealera analyzes hiring trends for companies and usage trends for SaaS products. Responsibilities: Analyzed user specifications and developed back-end business logic and database operations. Integrated Python scripts with other systems and APIs.
Key outcomes:
Implemented Snowflake as the data warehousing solution, managing large volumes of hiring trends data effectively.
Revealera — hiring trends + SaaS-product-usage trend analytics by scraping + processing + REST API exposure. Python + Django + MySQL + Pandas + Power BI.
Key outcomes:
Implemented Snowflake as the data warehousing solution, managing large volumes of hiring trends data effectively.
Wrote complex SQL queries to efficiently retrieve and manipulate hiring trends and usage pattern data.
Ensured data integrity and implemented database security measures.
Rahul
Data Engineer