Lead modernization of a large-scale AWS data platform: design, build, and optimize scalable ETL/ELT pipelines, migrate Airflow/EMR to AWS-native services (Glue, MWAA), implement data lake/warehouse solutions, enforce data governance/lineage/metadata, build data quality and monitoring frameworks, automate deployments with IaC, and support BI (QuickSight) and Power BI migration, UAT, and production support.
About us:
Working at Tech Holding isn't just a job, it's an opportunity to be a part of something bigger. We are a full-service consulting firm that was founded on the premise of delivering predictable outcomes and high-quality solutions to our clients. Our founders and team members have industry experience and have held senior positions in a wide variety of companies – from emerging startups to large Fortune 50 firms – and we have taken our combined experiences and developed a unique approach that is supported by the principles of deep expertise, integrity, transparency, and dependability.
About the Role
We are looking for a Senior AWS Data Engineer to join our team and lead the modernization of a large-scale cloud data platform. You will be responsible for designing, building, and optimizing scalable data pipelines, modernizing ETL/ELT workloads, implementing data governance, and enabling analytics and reporting solutions on AWS.
The ideal candidate has deep expertise in AWS data services, data engineering, pipeline orchestration, and data warehouse modernization, with a passion for building reliable, secure, and scalable data platforms.
Location: Remote
Experience Required: 5+ Years
Employment Type: Contract
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on AWS.
- Modernize legacy data platforms by migrating Apache Airflow/MWAA workloads to AWS-native orchestration services.
- Migrate and optimize Amazon EMR workloads to AWS Glue.
- Design and implement scalable data lake and data warehouse solutions using AWS services.
- Develop robust data models, semantic layers, and standardized KPI definitions to support business analytics.
- Build and maintain data quality, validation, anomaly detection, and monitoring frameworks.
- Implement metadata management, data lineage, and data governance best practices.
- Develop automated deployment pipelines and infrastructure using Infrastructure as Code (IaC).
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Collaborate with business stakeholders to understand reporting requirements and translate them into scalable data solutions.
- Support QuickSight semantic datasets, dashboard optimization, and Power BI migration initiatives.
- Participate in UAT, production deployments, knowledge transfer, and post-production support.
Required Skills & Qualifications
• 5+ years of experience in Data Engineering.
• Strong programming skills in Python and SQL.
• Hands-on experience with Apache Spark / PySpark.
• Extensive experience with AWS data services including:
- AWS Glue
- Amazon S3
- Amazon Redshift
- Amazon Athena
- AWS Lambda
- AWS Step Functions
- Amazon EventBridge
- AWS IAM
• Experience designing and implementing ETL/ELT pipelines.
• Strong knowledge of data modeling, data warehousing, and data lake architecture.
• Experience with Apache Airflow or Amazon MWAA.
• Strong understanding of Data Governance, Metadata Management, Business Glossary, and Data Lineage.
• Experience implementing Data Quality, Audit Logging, and Data Reconciliation frameworks.
• Experience with Amazon QuickSight, semantic datasets, and BI reporting.
• Experience with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation).
• Excellent analytical, troubleshooting, and communication skills.
Preferred Qualifications
• Strong knowledge of data modeling, data warehousing, and data lake architecture.
• Experience with Apache Airflow or Amazon MWAA.
• Strong understanding of Data Governance, Metadata Management, Business Glossary, and Data Lineage.
• Experience implementing Data Quality, Audit Logging, and Data Reconciliation frameworks.
• Experience with Amazon QuickSight, semantic datasets, and BI reporting.
• Experience with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation).
• Excellent analytical, troubleshooting, and communication skills.
Preferred Qualifications
- Experience with Power BI migration projects.
- Experience working with Healthcare or Life Sciences data platforms.
- Knowledge of Lake Formation, AWS Glue Data Catalog, and AWS security best practices.
- Familiarity with ML-ready data pipelines and feature engineering.
- AWS Certification (Data Engineer, Solutions Architect, or Developer) is a plus.
Tech Holding is proud to be an Equal Opportunity Employer and is committed to fostering a diverse and inclusive workplace. We welcome applicants from all backgrounds and experiences, and we consider qualified applicants without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected characteristic. If you require accommodation in the application process, please contact our HR
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.
Top Skills:
AWSDockerDtcc RttmDtcc Settlement WebEksEltETLFixFxmlIbm MqIndexingIso 15022KafkaKubernetesRdsRest ApiS3SQLSQL ServerStored ProceduresUnified Trade Record (Utr)
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle processing. Ingest, transform, and normalize high-volume financial data (DTCC, ISO15022), implement MQ/API-based ingestion, optimize SQL Server performance, maintain UTR schemas and trade exception databases, ensure data quality, lineage and governance, and collaborate with reconciliation, settlements, and operations stakeholders.
Top Skills:
Aws EksAws RdsAws S3DockerDtcc RttmDtcc Settlement WebEtl/Elt FrameworksFixFxmlIbm MqIso 15022KafkaKubernetesRest ApisSQL ServerUnified Trade Record (Utr)
.jpg)
AdTech • Cloud • Marketing Tech • Productivity • Software • Analytics • Automation
Hands-on Staff Software Engineer building and shipping backend features with enterprise reliability and scale. Own full product lifecycle, mentor peers, and adopt AI-native workflows to accelerate development and ensure quality.
Top Skills:
Ai AgentsAPIsC++Ci/CdClaude CodeDatabasesGithub CopilotGoHTTPJavaJavaScriptMvcOpencodePythonRubyTesting
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
