Siva Krishna  ·  Senior Azure Databricks Data Engineer  ·  7+ yrs

Senior
Hyderabad7+ years experienceremote
Available within 48 hrs

About Siva

Sivakrishna specializes in data engineering, focusing on Azure Data Factory and Azure Databricks for building robust data pipelines. He has extensive experience in processing large datasets and optimizing Spark applications. His work spans various industries, including energy, real estate, and finance, demonstrating his versatility and ability to adapt to different business needs.

Core expertise

Azure Databricks
cloud
10/10
AD
Azure Data Factory
cloud
10/10
PySpark
language
9/10
SQ
SQL
database
9/10
Python
language
8/10

Additional skills(14)

Azure DatabricksPythonPySparkAzure DevOpsSQL ServerOracleAzure Data FactoryInformatica PowerCenterAzure Data Lake StorageAzure SQL DB

Why hire Siva?

Production deploy authority

Designed and implemented robust data pipelines using Azure Data Factory and Azure Databricks.

Optimized Spark applications and developed solutions using PySpark for large datasets.

Involved in Agile project delivery frameworks, requirement gathering, and design documentation.

Achieved business transformation using Data Flow, Stored Procedures, and PySpark.

Implemented CDC and SCD Type 2 for data warehousing solutions.

Regular participation in testing and data validation to ensure data integrity.

Project highlights(5)

Energy Data Pipeline – Data Engineer

Overview: Shell is an international energy company focused on exploration, production, refining, and marketing of oil, natural gas, and chemicals, leveraging advanced technologies for sustainable energy solutions. Responsibilities: Gathered requirements and created Design documents for data solutions. Developed data pipelines using Azure Databricks to read data from Azure Data Lake Storage into target Synapse for fact tables. Utilized Python and PySpark to create data frames, implement incremental date functions, and define views. Scheduled and monitored pipelines using Azure Data Factory's scheduling and tumbling triggers, resolving pipeline issues.

Azure Data FactoryAzure DatabricksPythonPySpark

Key outcomes:

  • Achieved business transformation using Data Flow, Stored Procedures, and PySpark.

  • Involved in testing and data validation.

Real Estate Data Solutions – Data Engineer

Overview: RexHub provides an online platform offering real estate appraisal management software for appraisal management companies and lenders. Responsibilities: Developed data solutions using Azure Data Factory and Azure Databricks.

Azure Data FactoryAzure Databricks

Finance Data Solutions – Data Engineer

Overview: RBL Bank is a leading private sector bank in India, offering specialized services across Corporate & Institutional Banking, Commercial Banking, Branch & Business Banking, Retail Assets, and Treasury and Financial Markets Operations. Responsibilities: Developed data solutions using Azure Data Factory and Azure Databricks.

Azure Data FactoryAzure Databricks

Project 4 – Development

  • RBL Bank is a leading private sector bank in India, offering specialized services across Corporate & Institutional Banking, Commercial Banking, Branch & Business Banking, Retail Assets, and Treasury and Financial Markets Operations.
  • Developed data solutions using Azure Data Factory, Informatica, and Azure Databricks.
Azure Data FactoryInformatica PowerCenterAzure DatabricksAzure DevOpsAzure Data Lake StorageAzure SQL DBSSMSSQL ServerPythonPySparkShell Scripting

Project 5 – Development and support

  • Classic Foods, Inc. is a family-owned manufacturer of branded snack foods, distributed throughout the United States and Canada, including Kettle Classics® Potato Chips and Stoned Classics® Tortilla Chips.
  • Designed parallel jobs using DataStage tool.
  • Applied various stages (Sequential file, Data Set, Aggregator, Remove Duplicates, Lookup, Join, Filter, Sort, Surrogate Key Generator) according to business requirements.
  • Involved in unit testing, test execution, and deployment.
  • Developed ETL processes using DataStage Tools.
DataStageSQL ServerOracleUNIXAzure Data FactoryPythonPySparkShell Scripting

Key outcomes:

  • Understood business requirements and design documents.

7+ years of industry experience

Banking2 projects
  • •Finance Data Solutions— Data EngineerAzure Data Factory · Azure Databricks
  • •Project— DevelopmentAzure Data Factory · Informatica PowerCenter · Azure Databricks · Azure DevOps +7
Energy & Utilities1 project
  • •Energy Data Pipeline— Data EngineerAzure Data Factory · Azure Databricks · Python · PySpark
FinTech2 projects
  • •Finance Data Solutions— Data EngineerAzure Data Factory · Azure Databricks
  • •Project— DevelopmentAzure Data Factory · Informatica PowerCenter · Azure Databricks · Azure DevOps +7
Manufacturing & Industrial5 projects
  • •Energy Data Pipeline— Data EngineerAzure Data Factory · Azure Databricks · Python · PySpark
  • •Real Estate Data Solutions— Data EngineerAzure Data Factory · Azure Databricks
  • •Finance Data Solutions— Data EngineerAzure Data Factory · Azure Databricks
  • •Project— DevelopmentAzure Data Factory · Informatica PowerCenter · Azure Databricks · Azure DevOps +7
  • •Project— Development and supportDataStage · SQL Server · Oracle · UNIX +4

Ready to work with Siva?

Onboard within 48 hours. No long hiring cycles, no recruiter middleman.

At a Glance

LocationHyderabad
Experience7+ years
Work moderemote
Direct hirePossible
Start within48 hours
From$1,868/ month

Single contract. Billed in USD.

Typically responds within 4 business hours.

5-day replacement guarantee
48-hour onboarding, single invoice
Direct chat — no recruiter middleman

Top Skills

Azure Databricks
10/10
Azure Data Factory
10/10
PySpark
9/10
SQL
9/10
Python
8/10
Seniority signals
Owns production deploysGreenfield architectSystem owner
VerifiedVetted by Witarist
Technical skills assessed & verified
Background & identity checked
English communication verified
Ready to onboard in 48 hours

Not sure if this is the right fit?

Tell us your requirements and we'll match you with the best candidates.

Siva Krishna

Azure Data Bricks