Thirunagari Gopi Chaithanya  ·  Data Engineer  ·  5+ yrs

Mid-Level
India5+ years experienceremote
Available within 48 hrs

About Thirunagari

Thirunagari Gopi Chaithanya is a Senior Data Engineer with extensive experience in the IT industry, focusing on Big Data, Hadoop, and Java/J2EE. He possesses strong technical skills in developing and deploying Machine Learning pipelines, implementing ETL/ELT processes, and managing Big Data applications across AWS and Azure cloud environments. His expertise includes Spark, Kafka, and various NoSQL/SQL databases, and he is adept at designing data architectures for analytics and real-time streaming.

Core expertise

AWS
cloud
10/10
Apache Spark
backend
10/10
Kafka
backend
10/10
Azure
cloud
10/10
Java
language
9/10
TA
Talend
tooling
9/10
Python
language
8/10
Docker
devops
8/10
Kubernetes
devops
8/10
Snowflake
database
8/10

Additional skills(16)

KafkaSparkAzureSpring BootElasticsearchPySparkPostgreSQLJavaSpringHibernate

Why hire Thirunagari?

Production deploy authorityDesigned data architectures

Designed and implemented ETL Warehouse data modeling using Informatica, Cassandra, and Power BI.

Engineered and deployed end-to-end ML applications within Azure MLops Cloud Environment.

Optimized Hive QL/Pig scripts using execution engines like Tez and Spark, improving query performance.

Developed robust real-time data streaming and analytics solutions using Kafka, Storm, HBase, and Spark.

Implemented CI/CD pipelines with Jenkins and Terraform for automated deployments.

Multi-cloud (AWS + Azure) data engineering

Project highlights(4)

Financial Services Data Pipeline – Senior Data Engineer

Overview: This project involved data processing and transformation for a financial advisory client, focusing on Big Data solutions. Responsibilities: Developed multiple Kafka & Kafka Connectors for producing and consuming data based on software requirements. Configured Spark Streaming Jobs in Airflow for automated script deployment to process ongoing data from Kafka and store it in HDFS. Designed and implemented jobs in Azure Databricks, Azure Data Storage, Azure Synapse ETL, Azure Cosmos DB, EventHub, Azure Data Catalog, Azure Functions, Azure Purview, and MDM.

KafkaSparkAirflowAzureHDFS

Key outcomes:

  • Configured Spark Streaming jobs in Airflow for automated script deployment, resulting in easier job scheduling.

  • Designed data migration pipelines to Azure cloud using Azure SQL.

Big Data Processing for Credit Suisse – Senior Data Engineer

Overview: This project focused on Big Data batch and real-time processing solutions within a financial services context. Responsibilities: Integrated Spring Boot with Elastic Search and Kibana to display application status and log records. Wrote and tuned queries using PySpark, PostgreSQL & Airflow Application for data analysis.

Spring BootElasticsearchKibanaPySparkPostgreSQL

Key outcomes:

  • Implemented Spring Boot integration with Elastic Search and Kibana to provide real-time application status.

  • Designed and developed authorization policies for Big Data Hadoop resources using Ranger API.

Real-time Data Streaming for SoftBank Group – Senior Data Engineer

Overview: This project focused on real-time data streaming and analytics for a financial services group, involving Microservices deployment in Azure. Responsibilities: Designed and developed real-time data streaming and analytics using Kafka, Storm, and HBase, Spark.

KafkaStormHBaseSparkSpring Boot

Key outcomes:

  • Designed and developed real-time data streaming and analytics solutions using Kafka, Storm, HBase, and Spark.

  • Deployed microservices using SpringBoot, MongoDB, and Kafka in an Azure Production Cluster.

Customer Credit Card System for Lakshmi Villas Bank – Java Consultant

Overview: This project involved a customer credit card system and an Online Investment Service (OIS). Responsibilities: Worked on the complete life cycle of software development, including new requirement gathering, redesigning, and implementing business functionalities.

JavaSpringHibernateOracle

Key outcomes:

  • Successfully implemented new business functionalities for a customer credit card system.

  • Managed database objects and enhancements in Oracle 11g database.

5+ years of industry experience

FinTech3 projects
  • •Big Data Processing for Credit Suisse— Senior Data EngineerSpring Boot · Elasticsearch · Kibana · PySpark +1
  • •Real-time Data Streaming for SoftBank Group— Senior Data EngineerKafka · Storm · HBase · Spark +1
  • •Customer Credit Card System for Lakshmi Villas Bank— Java ConsultantJava · Spring · Hibernate · Oracle
Banking2 projects
  • •Real-time Data Streaming for SoftBank Group— Senior Data EngineerKafka · Storm · HBase · Spark +1
  • •Customer Credit Card System for Lakshmi Villas Bank— Java ConsultantJava · Spring · Hibernate · Oracle
Logistics & Supply ChainReported in resume
Manufacturing & IndustrialReported in resume

Ready to work with Thirunagari?

Onboard within 48 hours. No long hiring cycles, no recruiter middleman.

At a Glance

LocationIndia
Experience5+ years
Work moderemote
Direct hirePossible
Start within48 hours
From$2,443/ month

Single contract. Billed in USD.

Typically responds within 4 business hours.

5-day replacement guarantee
48-hour onboarding, single invoice
Direct chat — no recruiter middleman

Top Skills

AWS
10/10
Apache Spark
10/10
Kafka
10/10
Azure
10/10
Java
9/10
Seniority signals
Owns production deploysGreenfield architectSystem owner
VerifiedVetted by Witarist
Technical skills assessed & verified
Background & identity checked
English communication verified
Ready to onboard in 48 hours

Not sure if this is the right fit?

Tell us your requirements and we'll match you with the best candidates.

Thirunagari Gopi Chaithanya

Big Data engineer with Talend