Designs and implements scalable, reliable data pipelines and platforms on AWS using Snowflake and dbt Cloud. Integrates data across warehouses, databases, lakes, and lakehouses to support analytics, reporting, predictions, and models. The role leads engineering quality, automation, testing, coding standards, technical debt management, stakeholder collaboration, and mentoring while delivering secure, high-performing data products in an Agile environment.
Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organization, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Staff Data Engineer
Location: Bangalore - Manyata Tech Park
Business & Team: Bank west
Impact & Contribution:
As a Staff Data Engineer, you are:
- Empathetic and self-aware. You think and care deeply about how you might interact with your team, stakeholders and customers.
- A Mentor, harboring a passion to nurture, grow and influence those around you to think differently and always maintain a growth mindset.
- Innovative. You continually seek to improve the status quo for our customers. You inspire your team to do the same and remain resilient through change.
- Promoting quality and delivering at pace through the maximization of automation is one of the key focus areas of the role.
- Ownership, you take responsibility for the software design, engineering processes and quality standards of yours as well as your team members as you work in a collaborative environment.
Roles & responsibilities:
- Continuously improve the data products with best engineering solutions.
- Strategize, Design and Implement (hands on) highly reliable and scalable data pipelines and data platforms with comprehensive test coverage on AWS Cloud using Snowflake and dbt cloud.
- Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud Lake houses to enable data predictions and models, and reporting and visualization analysis via data integration tools and frameworks.
- Work with the team to understand our customers' core business objectives and deliver quality data centric solutions within committed timeframes
- Contribute to thought leadership enabling analytics teams to deliver world class data centric solutions and analytics by championing sustainable and re-useable data assets
- Design and build group data assets by integrating diverse data from internal and external sources.
- Help to promote best in class coding standards and practices to ensure high quality and minimum risk.
- Collaborating and communicating with business and delivery stakeholders and working without supervision.
- Identify and escalate Technical Debt through simple processes to support effective planning and risk management.
- Risk Mindset – All Bankwest employees are expected to proactively identify and understand, openly discuss and act on current and future risks.
- Able to build solutions that are fit for purpose, perform well with large data volume and complex data transformation rules, and reliable to operate
- Understanding of the development and release cycle following Change Management processes.
- Creative problem solver, with open thinking to generate and support new or better ways of doing things.
- Strong capability and experience with modern engineering practices and techniques
- Experience with Agile working practices is beneficial
Essential skills:
- 11+ years of experience in relevant field.
- Continuously improve the data products with best engineering solutions.
- Strategize, Design and Implement (hands on) highly reliable and scalable data pipelines and data platforms with comprehensive test coverage on AWS Cloud using Snowflake and dbt cloud.
- Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud Lake houses to enable data predictions and models, and reporting and visualization analysis via data integration tools and frameworks.
- RDBMS Experience on any prominent Database is required with strong SQL expertise.
- AWS Data Engineer certification.
- Must have hands-on experience in Development projects using Snowflake, dbt (cloud), AWS, SQL, ETL, Datawarehouse
- AWS (Amazon Web Services) Cloud (working experience with some of the core services EMR, EC2, S3, Auto-scaling, etc.) desirable.
Required skills:
- Strategic thinking, External perspective, Product delivery
- Working with distributed teams, Continuous delivery and Agile practices, People leadership, Building high performing teams
- Development, analysis or testing
Good to have Skills:
- Knowledge on Data Analysis, Banking Domain Experience, PySpark, Github Co-pilot, CI/CD.
- Experience in working within a Data Delivery Life Cycle framework & Agile Methodology.
Education/Qualifications
Bachelor’s degree or Master’s degree in engineering in Information Technology
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Similar Jobs
Fintech • Financial Services
Build and lead end-to-end data-centric solutions for Business Banking. Responsibilities include defining ETL strategies, developing pipelines, designing scalable data solutions, collaborating with stakeholders and infrastructure teams, ensuring secure and highly available delivery, contributing to agile planning, and mentoring engineers. The role requires extensive Snowflake, cloud, ETL, Hadoop, database, BI, and Python experience, alongside strong analytical and communication skills.
Top Skills:
AgileAmazon CloudwatchSparkAutosys JilAws Ec2Aws LambdaAws S3ClaudeClineCloudera HadoopHiveOracle SqlPl/SqlPythonRooScalaSnowflakeTableauTeradataUnix Shell
Fintech • Financial Services
Lead data engineering initiatives for CommBank’s HomeBuying Technology unit. Responsibilities include designing large-scale data pipelines and distributed systems, supporting cloud-native platforms, troubleshooting complex technical issues, applying DevSecOps and CI/CD practices, and leading high-performing engineering teams. The role also requires stakeholder management, coaching, agile delivery, operations support, and collaboration across banking technology teams.
Top Skills:
AWSAzureCi/CdDatastageDbtGitHadoopScalaSnowflakeSparkTeradataUnix
Fintech • Financial Services
Provides technical leadership for scalable, secure data platforms, pipelines, and products supporting analytics, real-time data, and AI use cases. Responsibilities include designing ETL strategies, data architectures, integrations, cloud solutions, and consumption patterns; mentoring engineers; setting standards; improving automation and reliability; partnering with cross-functional teams; managing technical roadmaps; and participating in on-call support.
Top Skills:
Apache FlinkApache KafkaSparkAWSCloudera HadoopHiveHugging FaceLangchainLlamaObieeOracle SqlPl/SqlPysparkPythonSASScalaTableauTeradataUnix Shell ScriptVector Databases
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
