Shivam  ·  Data Engineer  ·  5+ yrs

Mid-Level
Indore5+ years experienceremote
Available within 48 hrs

About Shivam

Shivam is a skilled Data Engineer specializing in data pipeline automation and optimization. He has extensive experience in deploying projects to production environments, particularly using AWS. His expertise includes working with both structured and unstructured data, applying advanced machine learning techniques, and leading development teams. Shivam is proficient in a variety of technologies, including Python, SQL, and MongoDB, and has successfully integrated various APIs and services to enhance project functionality.

Core expertise

Python
language
10/10
AWS
cloud
9/10
R
language
8/10
SQ
SQL
database
8/10
MongoDB
database
8/10
PostgreSQL
database
8/10
LA
Langchain
tooling
8/10

Additional skills(10)

PythonAWSMongoDBApache KafkaTwilioGHLLangchainOpenAIMachine LearningNLP

Why hire Shivam?

Production deploy authorityMentored 5+ juniorsLed development teams

Developed and deployed an AI Voice Assistant on AWS EC2, capable of scheduling and answering product queries.

Led the development of a PDF summarization ChatBot using Langchain and OpenAI, streamlining information extraction.

Built efficient and robust ETL pipelines for large datasets, significantly enhancing data ingestion and processing efficiency.

Successfully deployed an AI Voice Assistant on AWS EC2.

Automated various data pipelines using Python, reducing manual intervention and improving data flow efficiency.

Implemented a Car Recommendation system utilizing collaborative filtering and Random Forest to predict hot-selling vehicles.

Project highlights(4)

AI Voice Assistant – Sr. Software Developer

Overview: Built an AI voice assistant to answer queries and manage schedules for users, serving as a platform for AI-driven customer interaction. Responsibilities: Gathered data from PDFs to form the knowledge base for the organization. Responsible for integrating RAG (Retrieval-Augmented Generation). Built the general architecture diagram for the system. Integrated Twilio with AI for communication functionalities. Retrieved data from GHL (GoHighLevel) to create contacts, appointments, tasks, and notes. Fine-tuned the LLM model and evaluated its performance using a BLEU score. Deployed the entire project on an AWS EC2 instance.

PythonAWSTwilioGHL

Key outcomes:

  • Successfully deployed an AI voice assistant on AWS EC2.

  • Fine-tuned an LLM model for specific business query resolution.

PDF Summarization ChatBot – Developer

Overview: Developed a ChatBot leveraging Langchain and OpenAI models to summarize PDF data, streamlining information extraction for efficiency. Responsibilities: Used the OpenAI API key to import Langchain for AI model integration. Utilized Pinecone as a VectorDB for efficient data retrieval. Employed OpenAI Embeddings for finding similar searches by vectorDB. Responsible for integrating RAG (Retrieval-Augmented Generation) within the chatbot. Led the project with a team of 6 developers, orchestrating the integration of the Langchain framework with OpenAI models for PDF data summarization.

LangchainOpenAIAWS

Key outcomes:

  • Successfully developed an innovative ChatBot for PDF summarization.

  • Led a team of 6 developers, ensuring seamless integration of AI frameworks.

Sales Prediction Analysis – Developer

Overview: Developed an ML model for sales prediction to provide insights for inventory management, revenue growth, and new investment decisions. Responsibilities: Gathered requirements directly from the Business Team and collected necessary data. Performed Exploratory Data Analysis (EDA) to understand data patterns. Applied various Feature Engineering and Feature Selection techniques.

Machine LearningNLPPython

Key outcomes:

  • Built and validated an ML model that provided actionable sales predictions.

Car Recommendation System – Developer

Overview: Developed a system to recommend hot-selling cars to users visiting a website, predicting cars likely to sell within 24-48 hours. Responsibilities: Created the ETL pipeline using AWS Glue, connecting to MongoDB and Apache Kafka. Connected to Databricks to perform machine learning operations. Applied feature transformation and filtering, then stored the processed data into a Data Warehouse.

AWSMongoDBApache Kafka

Key outcomes:

  • Successfully developed a predictive car recommendation system.

5+ years of industry experience

AI / ML Platform4 projects
  • •AI Voice Assistant— Sr. Software DeveloperPython · AWS · Twilio · GHL
  • •PDF Summarization ChatBot— DeveloperLangchain · OpenAI · AWS
  • •Sales Prediction Analysis— DeveloperMachine Learning · NLP · Python
  • •Car Recommendation System— DeveloperAWS · MongoDB · Apache Kafka
Automotive4 projects
  • •AI Voice Assistant— Sr. Software DeveloperPython · AWS · Twilio · GHL
  • •PDF Summarization ChatBot— DeveloperLangchain · OpenAI · AWS
  • •Sales Prediction Analysis— DeveloperMachine Learning · NLP · Python
  • •Car Recommendation System— DeveloperAWS · MongoDB · Apache Kafka
E-commerce1 project
  • •Car Recommendation System— DeveloperAWS · MongoDB · Apache Kafka
Logistics & Supply Chain1 project
  • •Car Recommendation System— DeveloperAWS · MongoDB · Apache Kafka

Ready to work with Shivam?

Onboard within 48 hours. No long hiring cycles, no recruiter middleman.

At a Glance

LocationIndore
Experience5+ years
Work moderemote
Direct hirePossible
Start within48 hours
From$2,012/ month

Single contract. Billed in USD.

Typically responds within 4 business hours.

5-day replacement guarantee
48-hour onboarding, single invoice
Direct chat — no recruiter middleman

Top Skills

Python
10/10
AWS
9/10
R
8/10
SQL
8/10
MongoDB
8/10
Seniority signals
Owns production deploysGreenfield architectSystem ownerMentor / leads juniors
VerifiedVetted by Witarist
Technical skills assessed & verified
Background & identity checked
English communication verified
Ready to onboard in 48 hours

Not sure if this is the right fit?

Tell us your requirements and we'll match you with the best candidates.

Shivam

Data Engineer