Similar Jobs
Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things
Job Title: Senior Data Engineer
Location: Bangalore-Manyata Tech Park (Hybrid)
Business & Team: Financial Crime Technology – Enterprise Data Platform
Impact & contribution:
You will work with Product Owner /lead engineer in the squad working towards impact of Enterprise Transformation Program across key applications.
Roles & Responsibilities:
- In your role as a Senior Data Engineer, you will be reporting to a Data Engineering Manager
- Utilizing Big Data technologies to solve our customer data centric problems.
- Working closely with the Senior Data engineer, Solution Designers and Business Analysts to understand and perform Data Ingestion, Enrichment and Egression
- Working across the Group Data Warehouse (GDW), Big Data Platform (Omnia) & AWS Cloud Platform
- Building group data products by integrating diverse data from hundreds of internal and external sources
- Adopting tools, programming languages and templates to improve our data quality and efficiency
- Building and optimizing Big Data pipelines, architecture and data sets
- End to end ownership and accountability of the business requirements, identify technical / performance issues and solve them.
- Learn and adapt to new technologies to solve problems and improve existing solutions
- Required to maintain and build excellent relationships with CDAO peers and stakeholders as well as actively contribute to business outcomes and team culture
Essential Skills:
- Minimum of 7+ years of hands-on experience in Software Engineering or development to build solution in Hadoop, Hive and Spark technologies.
- Strong hands-on experience in any of the language (Scala/Python) with spark ETL development.
- Good experience in any of them (Teradata / Oracle / SQL Server / MySQL) with strong SQL expertise
- Good hands-on experience in any of the CI/CD tools like IntelliJ, TeamCity & Github cloud action.
- The code maintenance repository like Github & bit bucket
- Minimum of 7+ years of experience on Shell Scripting
- Hands on experience in any cloud platform like AWS
- Good to have hands-on experience in any ETL Tool like Ab initio GDE/BRE
- Good Understanding of Distributed system and computing
- Good to have hands on experience on Performance Tuning
- Should be aware of AGILE processes and methodologies
- A natural ability to effectively communicate, educate and influence the different stakeholders/ peers, to solve challenging problems, while working in collaboration with other cross-functional engineering and solution design teams
- A positive desire to contribute towards initiatives, along with a strong ‘can- do’ attitude in juggling between constantly changing priorities
- Flexible to cross trained to organisational adopted tools & technologies
Education Qualifications:
- A degree in Engineering / Computer Science or a related discipline
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
