Senior Data Engineer - DBT

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

JOB ROLE : Senior Data Engineer

Experience : 4-7 Years

Location : Mumbai/Bangalore

Must have Primary skills:

• 3+ years of hands-on experience building large-scale AWS data engineering solutions.

• Strong hands-on experience with DBT(Cloud+Core).(highly recommended skill)

• Hands-on expertise into Redshift warehouse and Analytics.

• Strong hands-on expertise in SQL (analytical queries, window functions, stored procedures), Spark/PySpark, Python.

• Hands-on experience designing and implementing Lakehouse solutions using Apache Iceberg.

• Strong knowledge of AWS services including SMUS, EC2, DynamoDB, API Gateway, MWAA, EMR, S3, Athena, Glue Catalog, Aurora PostgreSQL, Lambda, CloudWatch, SQS, SNS, EventBridge, Secrets Manager, CloudWatch and IAM.

• Experience building scalable batch and streaming data pipelines on AWS.

• Strong experience in Spark/PySpark performance tuning and optimization.

• Hands-on experience optimizing Apache Iceberg and Aurora PostgreSQL for performance and scalability.

• Strong understanding of data modeling, partitioning, file formats, and Lakehouse/Data Lake architectures.

• Experience implementing monitoring, logging, alerting, and observability for production data pipelines.

• Strong knowledge of data quality, troubleshooting, debugging, and production support.

• Experience with CI/CD, Git, and data engineering best practices.

• Strong communication, problem-solving, and stakeholder management skills.

• AWS Data Engineer Associate or equivalent AWS Certification is preferred.

Good to have skills : 

• Experience with AWS Step Functions.

• Experience with Terraform or Infrastructure as Code.

• Exposure to Kafka, Hive, HDFS or other Big Data technologies.

• Hands-on experience using GenAI-assisted development tools such as Kiro, Copilot,Cursor, or similar AI coding assistants to improve engineering productivity. 

• Experience with ClickHouse Database

• Telecom/Mobile Network domain knowledge is preferred.

• Experience and knowledge of Atscale design and development.

• knowledge of Docker and Kubernetes.