Design, build, and maintain scalable ETL/ELT pipelines and data warehouses using Snowflake, AWS Glue, Python, and SQL. Optimize performance, implement CI/CD with Azure DevOps, ensure data quality and governance, collaborate with analytics teams, and troubleshoot pipeline issues.
Job Description - Sr Data Engineer
Experience: 5 to 7 years
Preferred Locations: Delhi NCR, Gurgaon, Noida, Bangalore, Jaipur, Indore, Ahmedabad (please avoid Pune and Hyderabad)
Mandatory Skills: Strong hands-on experience in Snowflake, Python, SQL, and AWS Glue
Job Summary
We are looking for a highly skilled Data Engineer with strong expertise in Snowflake, Python, SQL, AWS Glue, and modern data engineering practices. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, ensuring data quality, and supporting business intelligence and analytics initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of data.
- Build and optimize data models, data warehouses, and data lake solutions.
- Develop robust data integration workflows using AWS Glue and orchestration tools such as Apache Airflow.
- Manage and optimize Snowflake environments, including performance tuning, query optimization, and cost management.
- Write efficient and scalable SQL queries and Python scripts for data transformation and automation.
- Implement CI/CD practices and deployment automation using Azure DevOps.
- Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Business Stakeholders.
- Ensure data quality, governance, security, and compliance across data platforms.
- Participate in Agile/Scrum ceremonies and contribute to continuous improvement initiatives.
- Troubleshoot and resolve data pipeline and performance-related issues.
Required Skills & Qualifications
- 5+ years of experience in Data Engineering or related roles.
- Strong proficiency in SQL and Python.
- Hands-on experience with Snowflake Data Warehouse architecture, administration, and performance optimization.
- Proven experience with AWS Glue for data integration and transformation.
- Experience with workflow orchestration tools such as Apache Airflow.
- Strong understanding of data modeling, data warehousing, and data lake concepts.
- Experience with Azure DevOps, including version control, CI/CD pipelines, and deployment automation.
- Familiarity with cloud-based data solutions and best practices.
- Experience working in Agile/Scrum environments.
- Excellent problem-solving, analytical, and communication skills.
Preferred Qualifications
- Experience with large-scale data migration and modernization projects.
- Exposure to AWS cloud services and ecosystem.
- Knowledge of data governance and security best practices.
- Relevant cloud or Snowflake certifications are a plus.
Similar Jobs
Database • Analytics
The Senior Data Engineer will enhance the data warehouse platform, develop reusable components, optimize data models, and contribute to team efforts in a fast-paced startup environment.
Top Skills:
AirflowAWSClickhouseDbtGithub ActionsPython
Blockchain • Hardware • Software • Energy • Cryptocurrency • Big Data Analytics
The Data Engineer will build and manage scalable data pipelines and databases, collaborate on architecture, and drive data systems towards real-time capabilities in a fast-paced, innovative environment.
Top Skills:
AirflowClickhouseDockerKafkaKubernetesPl/PgsqlPostgresPythonRedpandaTrino
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Manage billing, financial reporting, month-end close, treasury/cash management, reconciliations and accruals for MetLife Investment Management. Prepare journals, bank reconciliations, expense and billing reports, liaise with cash teams, and ensure GAAP/IFRS compliance while supporting regional distributions and PeopleSoft postings.
Top Skills:
CadencyFxcmHfmExcelMS OfficePeoplesoftRevportVBA
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
