The Senior Full Stack Data Engineer will design and develop scalable data platforms, manage cloud infrastructure, and ensure data quality through pipelines and orchestration tools.
About the Role
RequirementsRequired Skills & Qualifications
We are looking for a Full Stack Data Engineer to design, build, and maintain scalable data platforms and pipelines. The ideal candidate has strong hands-on experience across data ingestion, transformation, orchestration, and cloud-based analytics, with a focus on modern lakehouse architectures.
Key Responsibilities- Design, develop, and maintain end-to-end data pipelines using Python, PySpark, and SQL
- Build and optimize data transformation workflows using dbt on Snowflake
- Develop scalable lakehouse architectures for structured and semi-structured data
- Implement reliable data ingestion frameworks using Kafka, AWS Glue, and custom connectors
- Orchestrate workflows and manage dependencies using Apache Airflow
- Manage cloud infrastructure on AWS (S3, Glue, EMR, Redshift/Snowflake integrations)
- Implement Infrastructure as Code (IaC) using Terraform
- Collaborate with cross-functional teams to deliver analytics-ready datasets
- Ensure data quality, performance optimization, and cost efficiency
- Use GitLab for version control, CI/CD, and collaborative development
- Monitor, troubleshoot, and resolve data pipeline issues in production environments
RequirementsRequired Skills & Qualifications
- 4+ years of experience with AWS data services and cloud-based data engineering
- Strong programming skills in Python and PySpark
- Hands-on experience with Snowflake and dbt for data modeling and transformations
- Solid understanding of SQL for complex analytical queries
- Experience with Apache Airflow for workflow orchestration
- Proficiency in Kafka for real-time/streaming data ingestion
- Experience with AWS Glue/ Airflow for ETL development
- Experience with Terraform for infrastructure automation
- Strong experience with GitLab and CI/CD pipelines
Top Skills
Apache Airflow
AWS
Aws Glue
Dbt
Emr
Gitlab
Kafka
Pyspark
Python
Redshift
Snowflake
SQL
Terraform
Similar Jobs
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Design, develop, and maintain Big Data solutions for Disability & Absence products. Collaborate with teams to improve existing solutions and create automation scripts.
Top Skills:
Ci/CdHbaseHiveKafkaNifiNoSQLPigPythonShell ScriptSolrSpark
Enterprise Web • Fintech • Financial Services
Lead engineering efforts in enterprise automation for Sales and Finance technologies, build and coach teams, ensuring robust integrations and high-quality performance.
Top Skills:
AWSBillingCatalystCpqDockerErpGainsightGCPJavaKafkaKubernetesOpenapiPythonRestSalesforceSnowflakeSQLWorkato
Enterprise Web • Fintech • Financial Services
The Lead Security Analyst supports application security automation by integrating analysis tools, helping with vulnerability remediation, and training technical staff.
Top Skills:
.NetBrightsecJavaJavaScriptJenkinsPHPRubySemgrepWaf
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
