Gen AI – Staff Engineer

Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Gen AI – Staff Engineer

Location: Bengaluru-Manyata Tech Park

Business & Team:

As we continue our pursuit of NPS +30 we need to transform the way we engage with our customers and colleagues. This requires a shift from a two-track digital vs assisted approach to instead a deeply personal and empathic end-to-end digital experience enriched and augmented by our colleagues. This will require self-healing adaptive work orchestration systems that can blend the capabilities of our colleague, AI, and APIs. These systems must be able to handle the high frequency of exceptional circumstances that arise during our customer journeys, all while remaining compliant with policies and regulations without the significant change and maintenance burden of today. The Gen AI Domain has been set up to build the tools and capabilities needed within the group tapping into the promise of Generative AI as a key technology to solve those needs. This team will be leading an initiative called “Transformer Banking”.

This domain within CDAO is focused on solution practices, tools and platforms required to successfully leverage Large Language Models, rather than the tools and capabilities required to create those models. We will accomplish this through building: technology platforms and tools such as the Gen AI Hub including RAG tooling, knowledge management services, LLM access and control planes; business platforms and tools such as the Customer Conversation Manager and Customer Activity Manager; and practice capability co-creating patterns and practices for Gen AI usage in solutions with crews across CBA leveraging our services alongside other frameworks/libraries.

Gen AI domain will provide services, tools and practices to enable crews across CBA to safely and effectively leverage Generative AI as components of more traditional solutions. We are looking for people who can thrive in a high level of ambiguity, have a strong team culture, are obsessed about customer needs, constantly think about how to effectively manage a wide variety of risks, and are passionate about the potential to lead the world in transforming a large enterprise in a heavily regulated environment using Gen AI as the technology evolves.

Impact & Contribution: As a Staff Engineer for Gen AI, you utilize technical expertise of engineering principles and practices in Gen AI platform to achieve business outcomes. You provide core technology and domain knowledge to inform technical strategy of the crew and lead the solution design, enhancement, maintenance of complex challenges within Gen AI. We are leading the world in AI ambition within Australia’s largest bank and fintech! Together, we will engineer the future of banking with innovative Gen AI solutions!

Roles & Responsibilities:

  • Developing and maintaining robust, scalable systems to support the deployment and operations of generative AI models, ensuring efficient use of computational resources.
  • Build Gen AI capability among engineers including but not limited to Knowledge Engineering/prompt engineering/platform engineering.
  • Knowledge Engineering: identifying and gathering relevant domain specific knowledge from various sources and structuring it in a structured way for LLM model to understand and utilize.
  • Prompt Engineering: Building effective instructions for Gen AI models to generate more relevant, accurate and creative text formats.
  • Platform engineering: Collaborate with other teams to integrate AI solutions into existing workflows and systems to get the platform running and available. They configure and manage the underlying infrastructure that supports the platform, ensuring scalability, reliability, and high availability
  • Evaluating the performance of Gen AI models, identifying areas for improvement and iteratively refining models to enhance their accuracy, efficiency and fairness.
  • Provide strategic guidance and oversee medium complexity system engineering initiatives and solutions.
  • Overseeing the design, development and maintenance of Gen AI Hub including infrastructure, tools and APIs.
  • Working with various teams like Data Scientists etc to ensure the platform integrates seamlessly with existing workflows and meets user needs.
  • Are confident in using your expertise to solve platform issues, improve ways of working, enhance, and automate existing platform using latest automation tool
  • Staying up to date on advancements: The field of generative AI is constantly evolving, so staying informed about the latest research and developments, latest releases on different models and their performances are crucial.
  • Ability to develop, suggest best practices of designing infrastructures that support fine-tuning of models to improve performance and efficiency, and troubleshoot any issues that arise during development or deployment.
  • Security integration: GenAI platform engineers weave security best practices throughout the development lifecycle to safeguard the platform from vulnerabilities and data breaches.
  • Monitoring and logging: Implementation of robust monitoring and logging systems, LLMOps best practices that allows for proactive identification and resolution of potential issues.
  • Responsible AI Guardrails: GenAI platform engineers are responsible for ensuring all Responsible AI metrics are governed through proper system infrastructure and monitoring.

Essential Skills:

  • Have tech delivery expertise (i.e. an expert in tech that can also get tech delivery done)
  • High level of communications and negotiation skills, including the demonstrated ability to solicit opinions and accept feedback.
  • Experience in operating effectively as part of cross-functional teams.
  • Proficiency in key capabilities – IT SDLC processes, written documentation/ specification skills
  • Have experience in Prompt Engineering / Platform Engineering / Knowledge Engineering disciplines
  • Experience in following:
  • Cloud Solution Architecture/Development/Security/IaaC (AWS + Azure)
  • Python / TypeScript / C#
  • Prompt Engineering
  • Gen AI frameworks & tools (e.g. Langchain, Semantic Kernel)
  • Vector/Graph/SQL Databases
  • Non-deterministic automated testing
  • Machine Learning, including LLM fine-tuning
  • System Reliability Engineering
  • Secure Coding
  • Customer engagement systems
  • Workflow platforms

Qualifications:

  • Education: Advanced degree in Computer Science, Engineering, or related field
  • Minimum of 8 years of experience in relevant field
  • Proven track record of building and leading a team of engineering professionals.
  • Excellent problem-solving skills and ability to identify creative solutions to complex problems.
  • Strong cross-cultural communication skills and the ability to effectively manage collaboration across time zones.

Similar AI Jobs