Published: Nov 14, 2024

innovating customer support for Singapore Ministry of Manpower’s contact centre through GenAI enhancements

Generative AI (GenAI) is a fast-evolving technology that can deliver many transformational benefits to businesses and organisations. It can help to reinvent customer experiences, increase employee productivity and optimise business processes.

However, one of the challenges faced by many organisations when adopting GenAI is that they have existing infrastructure that may not be easily upgraded to realise new capabilities. Upgrading often requires substantial additional investment, significant implementation effort and long time-to-value.

In this post, we describe how NCS used Amazon Web Services (AWS) cloud services complemented with ins8.ai, NCS’ hyperlocal speech recognition solution, to add GenAI features to the Singapore Ministry of Manpower's (MOM) Contact Centre. The use of innovative capabilities has helped to unlock benefits to streamline contact centre operations and improve customer experiences.
 

• ins8.ai transcribes Singapore-accented calls in real time with 95% accuracy.
• RAG-based assistant answers complex queries with 93% precision, speeding agent training.
• AI summaries cut after-call work by >50% and trim average handling time by 12%.
• Simpler workflows lift job satisfaction and overall productivity by 6 %, all while safeguarding data privacy with Amazon Bedrock.
   

The MOM’s Contact Centre is a key touchpoint for the businesses, human resource professionals, employees and the public as it manages queries on manpower and employment related issues. The queries received from the customers can be multi-faceted or cross-cutting. Addressing such queries with precision requires the agents to possess a deep understanding of the subject matter and ability to analyse the needs of the customer.

When determining the needs of the customer, the agents would reference past records from the caller and documents from internal systems to determine suitable advice. Referencing multiple information sources would sometimes stretch out the duration of the call. After-call work, which includes call summarisation and other documentation, impacts the total amount of time taken by agents to handle each call, especially for complex cases.
 

To help the contact centre reap the benefits of GenAI, NCS developed an approach to augment the contact centre with features that addresses these challenges without the need for an expensive rip-and-replace strategy. We refer to this tool as “GenAssist”.

As illustrated in the architecture diagram below, new modules were developed to augment and integrate with the existing contact centre solution.

Figure 1. Architecture for NCS’ GenAssist solution deployed for MOM

When engaging callers on complex queries, agents need to have in-depth understanding of the relevant subject matter to provide accurate advice and good customer experience. Onboarding new agents to the level required for the job requires a considerable amount of time and resources to train them well.

NCS pioneered the use of an onboarding chatbot which accelerates the onboarding process while complementing trainer effort. Agents can use the chatbot to assist them in looking up answers to complex customer queries during training. The GenAssist Onboarding Chatbot is implemented using the retrieval augmented generation (RAG) approach with LangChain, Amazon Kendra and Anthropic’s Claude Instant model in Amazon Bedrock. Internal knowledge documents are stored in Amazon Simple Storage Service and indexed by Amazon Kendra. The solution can generate responses to complex queries within seconds with 93% accuracy.

Conversation audio between each caller and contact centre agent is captured by the GenAssist audio service. Callers often use colloquial accents in their conversations with contact centre agents, which can be challenging for most commercial speech-to-text products to transcribe accurately.

Ins8.ai, NCS’ hyperlocal speech recognition engine, performs hyperlocal voice transcription at scale with high accuracy. The audio service sends the audio stream to ins8.ai to transcribe call conversations in real-time with 95% accuracy.

The summariser service retrieves the call transcript from ins8.ai, preprocesses it and sends it together with an optimised prompt to the LLM hosted on Amazon Bedrock to perform the summarisation task. In this case, Anthropic’s Claude Instant model was selected as it strikes the balance between speed, accuracy and cost-effectiveness.

While there are many available LLM evaluation metrics, different evaluation metrics have different advantages and limitations. For the first release, NCS used a human-in-the-loop approach to evaluate the generated summary. Using this approach, the Claude Instant model achieved a 99% accuracy score. NCS continues to research the most suitable text summarisation evaluation metric so that this process can be automated in the future.

The contact centre agent uses the GenAssist Summariser plugin in the Agent Desktop Client to retrieve the generated summary, review it for accuracy and make necessary edits if required before logging the summary into the customer relationship management system. With the GenAI-powered summarisation tool, agents can now perform this task twice as fast.

Data protection and privacy
To ensure data protection and privacy, Amazon Bedrock neither stores nor logs customers’ prompts and completions. Furthermore, Amazon Bedrock does not use customers’ prompts and completions to train any AWS models or distribute them to third parties. Model providers also do not have access to Amazon Bedrock logs or to customers’ prompts and completions.

Benefits
With the new GenAI-enabled contact centre, MOM achieved key improvements across various critical metrics of the contact centre:

• The average call handing time (AHT) was reduced by 12%. The average after-call-work (ACW) was reduced by more than 50%.
• Harnessing the AI tools to streamline the tasks of agents simplified their responsibilities and empowered the agents to fully focus on connecting with each caller, fostering a deeper understanding of their concerns and alleviating anxiety while effectively resolving queries.
• This change has also cultivated a more positive work environment and contributed to heightened job satisfaction among contact centre agents, along with an improvement in overall productivity of 6%.

Roadmap
NCS is looking at further improving the solution with roadmap features. For example, using real-time transcription to detect and proactively push context-relevant information and content to the agent in real-time that can help to reduce call handling time.

By Royston Bok, Senior Director, AI Innovations, NCS Group
By Kok Soon Toh, Enterprise Architect, NCS Group
By Henry Soh, Lead IT Architect and Generative AI Specialist, NCS Group
By Voon Wong Wong, Principal Partner Solutions Architect, AWS
By Vincent Oh, Senior Specialist Solutions Architect (Generative AI), AWS
 

By weaving together AWS services, NCS’s ins8.ai speech engine and retrieval-augmented GenAI, the Ministry of Manpower transformed its contact centre without costly upheaval. Agents now receive accurate transcriptions, instant knowledge lookups and auto-generated call summaries, letting them focus on resolution rather than administration. The result? Shorter calls, swifter wrap-ups and a noticeably better experience for both call centre agents and customers.