Senior Data Engineer
Bangalore - Manyata Tech Park Road
Commonwealth Bank
CommBank offers personal banking, business solutions, institutional banking, company information, and moreOrganization :-At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title :-Senior Data Engineer
Location :-Bangalore
Business & Team :-
Technology Team is responsible for the world leading application of technology and operations across every aspect of CommBank, from innovative product platforms for our customers to essential tools within our business. We also use technology to drive efficient and timely processing, an essential component of great customer service.
CommBank is recognised as leading the industry in IT and operations with its world-class platforms and processes, agile IT infrastructure, and innovation in everything from payments to internet banking and mobile apps.
The Group Security (GS) team protects the Bank and our customers from cyber compromise, through proactive management of cyber security, privacy, and operational risk. Our team includes:
- Cyber Strategy & Performance
- Cyber Security Centre
- Cyber Protection & Design
- Cyber Delivery
- Cyber Data Engineering
- Identity & Access Technology
The Group Security Data Engineering team provides specialised data services and platforms for the CommBank group & is accountable for developing Group’s data strategy, data policy & standards, governance and set requirements for data enablers/tools. The team is also accountable to facilitate a community of practitioners to share best practice and build data talent and capabilities.
Impact & contribution :-
To ensure the Group achieves sustainable competitive advantage through data engineering, you will need to play a key role in supporting and executing the Groups data strategy.
We are looking for an experienced Senior Data Systems Engineer to join our Group Security Team, which is part of the wider Cyber Security Engineering practice. In your role as Data Engineer, you will be required to setup Group Security Data Platform to ingests data (structured and unstructured) from organisations security telemetry data with additional data assets to provide security controls and services that are leveraged across the Group
Roles & Responsibilities :-
- Contribute to thought leadership enabling business and technology teams to deliver world class data centric solutions and analytics by championing sustainable and re-useable data products.
- Participate in the full lifecycle of agile projects (ideation through implementation)
- Design and build group data products by integrating diverse data from hundreds of internal and external sources.
- Help to promote good coding standard and practices to ensure high quality and minimum risks.
- Utilizing Big Data technologies to solve our customers' data centric problems.
- Working closely with the Solution Designers and Business Stakeholders to perform Data Ingestion, Enrichment and Egression
- Designing and building group data products by integrating diverse data from hundreds of internal and external sources
- Adopting tools, programming languages and templates to improve our data quality and efficiency.
- Building and optimizing Big Data pipelines, architecture, and data sets
- Working with and extracting data from large disconnected / unstructured datasets
- Required to maintain and build excellent relationships with CDAO peers and stakeholders as well as actively contribute to business outcomes and team culture.
Essential Skills :-
- Minimum 11+ years of experience with expert level knowledge.
- AWS + Erwin + Python/pyspark
- Hands-on experience in Software Engineering or development using Scala or Java to build solution in Hadoop, Hive and Spark technologies.
- System Integration, Infra design, Familiar with Security(Cyber Arc, splunk, Synk, SonarQube, Obstack/Observe), APIs , microservices, Automation, CI/CD, pen testing, devsecops + relevant cloud certifications
- Demonstrated experience in SQL.
- A good high-level understanding of any source control tools like GitHub/ BitBucket etc.
- Strong experience in Shell Scripting and Should be well aware of AGILE processes and methodologies.
- Hands on Experience with AWS (Amazon Web Services) and or public cloud infrastructure.
- Demonstrated experience in delivering data solutions and querying on Redshift or other data warehouses is highly desirable.
- Practical knowledge on any programming language like Java/Python
- Experience with automation, orchestration working across; Ansible, GitHub, Teamcity, Artifactory and or Octopus Deploy desirable
Education Qualification :-
- Bachelor’s degree or Master’s degree in Engineering in Computer Science/Information Technology
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Advertising End Date: 06/12/2024* Salary range is an estimate based on our InfoSec / Cybersecurity Salary Index 💰
Tags: Agile Analytics Ansible APIs Automation AWS Banking Big Data Bitbucket CI/CD Cloud Computer Science DevSecOps GitHub Governance IT infrastructure Java Microservices Pentesting Privacy Python Scala Scripting SonarQube Splunk SQL Strategy
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.