Speech Technology for Trading, Market Surveillance and Cyber Security

Speech Technology for Trading, Market Surveillance and Cyber Security

Jeroen Aumand

Senior Consultant at Capco

Views 321

Speech Technology for Trading, Market Surveillance and Cyber Security

10.02.2016 09:15 am

“Rrrrrrr”. No, I am not cold or angry. I’m teaching Siri to pronounce my name: Jeroen Aumand. After a few attempts, I settle for second best – an anglicised [Jeron] instead of [Yuron]. Then the app asks for help with my last name and I feel a sense of doom creeping upon me. We are told constantly that speech technology will revolutionise financial services, but beyond turning the lights on in the office, how can we use it in finance?

Today, there are a number of speech tools with potential to enhance trading desk operations, market surveillance and cyber security. These include voice identification, natural language understanding and speech-to-text transcript.


Traders will benefit from technology that instantly processes speech into market quotes and prices. Electronic trading already has a limited automated response to the words of news broadcasters, industry bodies and regulators. Already in use by news agencies and some hedge funds, these solutions are on their way to becoming mainstream for other capital markets players. In the near future, we can expect early adopters to commoditise speech technology and offer it as an additional service for their High Frequency Trading clients.

Speech technology can also be used to record live order information in the trade capture window during a trade negotiation. The trader would then validate the order details to complete the trade, increasing the processing speed of voice OTC trades.

Traders and sales staff can leverage Computer Voice Stress Analysers (CVSA) and Voice inflection software to support negotiations and manage client relationships. CVSAs can identify stress levels in our speech and are already used by call centres to improve client interactions and help operators better deal with callers. Voice inflection software is used to sound more positive when speaking to clients.

Market surveillance

Listening to recordings takes time—a lot of it. But finding the right conversation in the first place can feel like searching for a needle in a haystack.

Search is an important function of speech technology. It is already used for market surveillance to narrow down the scope of conversations being analysed, by using both voice and keyword identification. Additionally, speech-to-text provides a text transcript that significantly reduces the listening time by switching directly to the relevant part of the conversation.

Combined with Artificial Intelligence (AI), recorded conversations can be linked to trades to identify best execution and illicit trading. AI can also scan recordings for signs of fraudulent / suspicious conversations. This reinforces the quality of market surveillance and demonstrates banks’ commitment to preventing fraud and minimising financial and reputational risk.

Cyber security

Voice identification is a powerful tool against social engineering where fraudsters impersonate someone, often a bank employee or a client, to obtain confidential information. On the rise in 2015, social engineering is best combatted by educating employees. But with voice identification, financial institutions can also identify and review all past conversations for possible fraudulent or criminal activities. This can lead to a better understanding of how social engineers operate and enable banks to create effective training tools and campaigns for employees. In addition, known offenders’ voice identification could be stored and shared with relevant organisations to prevent future attacks, increasing overall security within the industry. Voice identification is already used by some UK, US and Spanish banks to identify customers, instead of using password or security questions.


Speech technology’s future is bright, but not without challenges

For trading, speech technology needs to be both accurate and contextual. For example, it needs to be able to distinguish between homophones such as buy or by. It introduces the notion of contextual risk, whereby speech technology is required to identify sarcastic or humorous statements. An example of speech technology that addresses contextual intelligence is Hound which can remember and change preliminary inputs. Later stage solutions will also need to encompass cultural differences - such as accents, dialects, words borrowed from other languages as well as cultural references - in the delivery of a message.

Another challenge is identifying the tonality of a message. IBM Watson, for instance, provides a tone analyser that scores words with either a positive or a negative value to detect and interpret emotional and social nuances. But electronic markets always depend on speed, and a tone analyser with language models that predicts the probability of language expression increases the overall response time. In addition, after interpreting a message there’s still the need to rate the relevance of the information and ‘calculate’ its impact on the market.

It is clear that speech technology is already here in financial services, improving speed, accuracy and quality of processing, and enhancing customer service. There’s still an appetite for greater efficiencies, not least the ability to support (not replace) good decision making. Although it is tempered by scepticism, especially around security, speech technology’s presence is undeniably set to grow, with opportunities for innovation across capital markets, other financial sectors, as well as other industries.

Latest blogs

Darren Capehorn Icon Solutions

Unbanked and Unconnected: Supporting Financial Inclusion Beyond Digital

Many of us take it for granted, but accessing basic financial services is fundamental to our economic and social development. It is hard to ‘get on’ if you are forced to hide life savings under the mattress, or rely on predatory loan sharks for Read more »

Konstantin Demishev Archer Software

How Machine Learning Helps Fintech Companies Detect Fraud

Machine learning (ML) is one of the most discussed technological tools, and if in the past only a few companies could use it due to high cost and lack of resources, today many industries use ML. The financial sector is not an exception and embraces Read more »

Nish Kotecha Finboot and Bryan Foss, NED, Visiting Professor at Bristol Business School and member of the FRC Audit & Assurance Council

How Listed Companies Can Use Blockchain to Prevent Auditing and Reporting Malpractice and Avoid Scandal

Not too long ago, there was very little to link Wirecard, the disgraced payments platform in Aschheim, Germany, with Boohoo, the fast-fashion online retailer in Leicester, England, but both have recently been embroiled in high-profile scandals. Read more »

Leon Muis Yolt Technology Services

The Time for Financial Services to Become Truly Digital is Now

The financial services industry looks set to change dramatically over the next couple of years in response to COVID-19. The pandemic has certainly highlighted some inefficiencies and weak spots in current processes for many businesses, such as those Read more »

Granville Turner Turner Little

The Lockdown Money Revolution

Many Brits have found that lockdown has been beneficial for their money, having cut back on personal spending and managing to put away some extra cash. According to eToro, Brits with unspent discretionary income are set to accumulate £75.5bn in Read more »

Free Newsletter Sign-up
+44 (0) 208 819 32 53 +44 (0) 173 261 71 47
Download Our Mobile App
Financial It Youtube channel