Build and automate data validation and reconciliation tests for ETL pipelines and data warehouses. Write and optimize complex SQL, investigate data discrepancies, design ETL test strategies, and implement automated testing frameworks to ensure data integrity.
We are seeking a highly skilled and detail-oriented Software Development Engineer in Test (SDET) to join our team with a focus on data reconciliation, complex SQL, and ETL testing. The ideal candidate will have a unique blend of skills in software development, quality assurance, and data engineering. You will be responsible for ensuring data accuracy, validating ETL processes, and building automation frameworks for data-related testing processes. This is a key role to ensure the integrity and quality of our data infrastructure and analytics platforms.
Key Responsibilities:
- Complex SQL Queries:
- Write and optimize complex SQL queries to validate data pipelines, transformations, and reporting accuracy.
- Perform root cause analysis of data discrepancies and provide insights into data quality issues.
- Develop automated SQL scripts to streamline data validation and reconciliation processes.
- ETL Testing:
- Validate ETL processes by designing comprehensive test strategies to ensure data accuracy and completeness.
- Test and verify ETL pipelines from various data sources (structured and unstructured) into data warehouses, ensuring data conforms to business rules and logic.
- Implement automated ETL testing frameworks and continuously improve them to optimize the data validation process.
- Data Reconciliation:
- Develop, implement, and automate test scripts to validate data integrity between source and target systems.
- Identify and resolve data inconsistencies, mismatches, and errors in large datasets.
- Design and execute reconciliation processes to ensure accurate data migration and transformation.
Nice to have:
- Experience with HiveQL for Hive Database
- Experience with Python as a scripting language
Similar Jobs
Agency • Information Technology
Senior SDET responsible for web and API testing, designing automation frameworks (Selenium), implementing BDD (Cucumber), using build tools (Gradle), test management (Xray/ALM), JIRA for defect tracking, source control (GitLab/Bitbucket), and supporting performance testing and scripting/SQL for test data.
Top Skills:
AlmBitbucketBlazemeterCucumberGitlabGradleJIRAJmeterSeleniumSQLXray
Agency • Information Technology
Experienced SDET responsible for web and API testing, building automation frameworks with Selenium, applying BDD (Cucumber) and build tools (Gradle), managing tests with Xray/ALM, using JIRA for defects, and collaborating with source control (GitLab/Bitbucket). Performance testing (JMeter/BlazeMeter) and scripting/SQL skills are desirable.
Top Skills:
AlmBitbucketBlazemeterCucumberGitlabGradleJIRAJmeterSeleniumSQLXray
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The role involves managing finance change, regulatory reporting, project management, and software testing, requiring extensive experience in financial services and team leadership.
Top Skills:
Automation Testing ToolsExcelSQL
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
