Ajay Kumar · Data Engineer · 6+ yrs
Mid-LevelAbout Ajay
Ajay Kumar is a seasoned Senior Data Engineer with over 6 years of experience in the IT industry. He specializes in architecting, developing, and optimizing robust data pipelines, leveraging technologies such as Python, PySpark, and cloud platforms like AWS and Azure. His work spans across healthcare and e-commerce domains, ensuring timely insights and operational efficiency through effective data management and processing solutions.
Core expertise
Additional skills(32)
JavaScript
MySQL
HTML5
CSS3
BootstrapWhy hire Ajay?
Architected Azure-based data pipelines handling millions of records for healthcare.
Implemented event-driven data pipelines on AWS for automated workflows.
Led development of machine learning models for real-time safety monitoring.
Achieved significant reductions in file processing time through parallel processing techniques.
Developed scalable, high-performance data processing pipelines using PySpark and Scala.
Ensured timely insights and operational efficiency for improved patient care.
Project highlights(5)
Healthcare Data Management – Senior Data Engineer
Overview: An Azure-based data pipeline architected to handle millions of healthcare records in various formats, enabling real-time and batch processing for timely insights and actionable intelligence. Responsibilities: Developed Python scripts for data extraction from gz format files and loading into Azure Data Lake Gen 2. Utilized Azure Data Factory, Azure Databricks, and Delta Lake for regular ETL tasks and implemented a data cleaning framework.
Key outcomes:
Achieved significant reductions in file processing time.
Ensured timely insights and actionable intelligence for improved patient care.
Event-Driven E-commerce Data Pipeline – Senior Data Engineer
Overview: Implemented an event-driven e-commerce data pipeline on AWS, leveraging EventBridge for triggering scheduled workflows and integrated various AWS services for efficient data processing. Responsibilities: Developed the data pipeline on AWS using EventBridge for workflow triggers and integrated S3 storage, Glue Crawler, and ETL jobs.
Key outcomes:
Automated data analysis with Athena via scheduled workflow execution.
Ensured the reliability, scalability, and performance optimization of pipeline components.
Safety Monitoring System – Senior Data Engineer
Overview: A real-time safety monitoring system implemented with machine learning to process live video feeds and detect workers without proper safety gear. Responsibilities: Led the development and optimization of machine learning models for image recognition, including object detection algorithms to identify safety gear violations.
Key outcomes:
Enabled real-time safety monitoring and timely corrective actions based on safety protocol adherence.
Developed a comprehensive Django-based dashboard for worker safety compliance overview.
NoshList – Data Engineer
- A restaurant wait list management app enabling customers to be added to a waitlist and receive free text messages when their tables are ready.
- Developed a Python script for extracting gz format files, converting them to CSV or JSON, and loading data into Redshift.
- Analyzed user specifications and requirements.
- Developed the code as per the requirements.
- Developed full back-end business logic and performed required database operations.
Key outcomes:
Streamlined restaurant waitlist management, enabling customers to receive timely table readiness notifications.
Developed robust backend for data handling and messaging.
Security Capture – Data Engineer
- A real-time safety monitoring system implemented with machine learning to process live video feeds and detect workers without proper safety gear.
- Led the development and optimization of machine learning models for image recognition, including object detection algorithms to identify safety gear violations.
- Applied computer vision techniques to analyze live camera feeds, crafting algorithms for identifying individuals not wearing safety gear.
- Established data pipelines for streaming and storing live camera feeds, upholding data quality and reliability standards.
- Led the design and development of the Django-based dashboard, integrating ML and computer vision results, and implementing user authentication.
- Oversee deployment and management of live camera feed infrastructure, establishing scalable and reliable cloud services.
Key outcomes:
Enabled real-time safety monitoring and timely corrective actions based on safety protocol adherence.
Developed a comprehensive Django-based dashboard for worker safety compliance overview.
Ensured stringent data security and privacy compliance measures.
6+ years of industry experience
- •Healthcare Data Management— Senior Data EngineerPython · SQL · PySpark · Azure Databricks +3
At a Glance
Single contract. Billed in USD.
Typically responds within 4 business hours.
Top Skills
Vetted by WitaristNot sure if this is the right fit?
Tell us your requirements and we'll match you with the best candidates.
Ajay Kumar
Azure Engineer