The Senior Full Stack Data Engineer will design and develop scalable data platforms, manage cloud infrastructure, and ensure data quality through pipelines and orchestration tools.
About the Role
RequirementsRequired Skills & Qualifications
We are looking for a Full Stack Data Engineer to design, build, and maintain scalable data platforms and pipelines. The ideal candidate has strong hands-on experience across data ingestion, transformation, orchestration, and cloud-based analytics, with a focus on modern lakehouse architectures.
Key Responsibilities- Design, develop, and maintain end-to-end data pipelines using Python, PySpark, and SQL
- Build and optimize data transformation workflows using dbt on Snowflake
- Develop scalable lakehouse architectures for structured and semi-structured data
- Implement reliable data ingestion frameworks using Kafka, AWS Glue, and custom connectors
- Orchestrate workflows and manage dependencies using Apache Airflow
- Manage cloud infrastructure on AWS (S3, Glue, EMR, Redshift/Snowflake integrations)
- Implement Infrastructure as Code (IaC) using Terraform
- Collaborate with cross-functional teams to deliver analytics-ready datasets
- Ensure data quality, performance optimization, and cost efficiency
- Use GitLab for version control, CI/CD, and collaborative development
- Monitor, troubleshoot, and resolve data pipeline issues in production environments
RequirementsRequired Skills & Qualifications
- 4+ years of experience with AWS data services and cloud-based data engineering
- Strong programming skills in Python and PySpark
- Hands-on experience with Snowflake and dbt for data modeling and transformations
- Solid understanding of SQL for complex analytical queries
- Experience with Apache Airflow for workflow orchestration
- Proficiency in Kafka for real-time/streaming data ingestion
- Experience with AWS Glue/ Airflow for ETL development
- Experience with Terraform for infrastructure automation
- Strong experience with GitLab and CI/CD pipelines
Top Skills
Apache Airflow
AWS
Aws Glue
Dbt
Emr
Gitlab
Kafka
Pyspark
Python
Redshift
Snowflake
SQL
Terraform
Similar Jobs
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
The Sr. Financial Systems Analyst manages the NetSuite instance, oversees technical support, drives improvements, and works on reporting and data governance.
Top Skills:
AgileCsvExcelNetSuiteSuitebuilderSuiteflowSuitescript
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
The Engagement Manager will implement Coupa solutions for clients, manage project phases, optimize processes, and ensure successful go-live, requiring strong consulting and client management skills.
Top Skills:
ActAribaBaswareConcurCoupaGreat PlainsNetSuiteOb10OracleSalesforceSAPWorkday
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Quality Assurance Analyst II will automate tests, perform functional testing, analyze results, and document reports while collaborating with development teams in an agile environment.
Top Skills:
BddCucumberGitlabInsomniaJavaMavenPlaywrightPostmanRestassuredSeleniumTestng
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
