Senior Data Engineer

Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Senior Data Engineer
Location: Bangalore-Manyata Tech Park

Business & Team:

Retail Tech CE&D – Customer Engagement & Comms is responsible for the world leading application of technology and operations across every aspect of CommBank, from innovative product platforms for our customers to essential tools within our business. We also use technology to drive efficient and timely processing, an essential component of great customer service.

CommBank is recognized as leading the industry in IT (Information Technology) and operations with its world-class platforms and processes, agile IT infrastructure, and innovation in everything from payments to internet banking and mobile apps.

The RT CE&D provides specialized data services and platforms for the CommBank group & is accountable for developing Group’s data strategy, data policy & standards, governance and set requirements for data enablers/tools. The team is also accountable to facilitate a community of practitioners to share best practice and build data talent and capabilities

Impact &contribution:

To ensure the Group achieves sustainable competitive advantage through data & analytics, you will need to play a key role in supporting the RT -CE&D- Data Delivery in executing to the Groups data strategy.

You will be accountable for building advanced data capabilities for CE&D projects/programs.  A key aspect of the role is to utilize knowledge of data engineering principles and practices, coupled with specific data technology and domain knowledge, to design and deliver solutions for business needs and drive strong software and systems engineering thinking.

This will include sound knowledge of the Groups data strategy, architecture and technology roadmap, aligning CE&D-Data Delivery business needs.

Roles & responsibilities:

• Design and develop highly reliable and scalable data pipelines and data platforms with comprehensive test coverage.
• Collaborate with stakeholders to analyse and translate requirements to technical implementation.
• Identify and drive opportunities for continuous improvement within the team and in delivery of products.
• Provide mentoring and technical assistance to other members of the team, including more junior Data Engineers.
• Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice.
• Provide technical governance of product delivery to ensure successful delivery and adoption.
• Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load.
• Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lakehouses to enable data predictions and models, reporting and visualisation analysis via data integration tools and frameworks.
• Contribute to domain planning, providing guidance to ensure that technical deliveries are aligned to engineering direction and strategy

Essential skills:

• Experience: 8 to 12 years of experience in cyber security, with a focus on incident response.
• Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform.  Preferably with at least 5+ years of hands-on experience in a Data Engineering role.
• Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing.  Preferably with at least 5+ years of hands-on experience.
• Experience in building data solution using AWS Cloud technology (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift, Document DB, S3, etc.).  Preferably with 3+ years of hands-on experience and certified AWS Data Engineer.
• Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.
• Proficient in SQL scripting, writing complex SQLs for building data pipelines.
• Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
• Experience in working in Agile teams, including working closely with internal business stakeholders.
• Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus.
• Certification on Cloudera CDP, Hadoop, Spark, Teradata, AWS Data Engineer, Ab Initio is a plus.
• Experience in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.) is a plus.

Education Qualification: Bachelor’s degree or Master’s degree in Engineering in Computer Science/Information Technology

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.