First Derivatives Introduces System to Test High Frequency Trading Strategies
by
Adil Siddiqui
First Derivatives has developed a comprehensive testing system - the Delta AlgoLab - that serves two key purposes; for exchanges and regulators to profile and monitor HFT strategies, and for firms to test their algorithms and HFT strategies before releasing them into live markets.
Such a system has not been available in the past due to issues with speed of data capture; availability of realistic matching engine technology; and the complexity of sourcing and putting together all the required components.
Regulators globally have become increasingly concerned with algorithmic and HFT strategies since the 'Flash Crash ' in 2008. However, firms are understandably reluctant to hand over their costly intellectual property, and regulators are not necessarily equipped with the resources to understand how these complex algorithms work. There are also acknowledged deficiencies in the simulators currently in use.
"A key issue in simulation is that it assumes zero market impact, wherein historic replay might trigger a strategy but then fails to take into account the impact of any HFT strategy order that is generated." said Rob Hodgkinson. "That's not realistic, as obviously a live market is the result of all the participants interacting with each other."
The FD system has four key features that make it different from other approaches:
• A sophisticated simulation that takes market impact into account, generating each new order around the current bid/ask spread;
• A very fast 'production' matching engine that can simulate multiple markets at once;
• Injection of market events such as sector movements or a simulated 'flash crash' scenario to see how the algorithm will react;
• Realtime market data capture of all orders and trades to create a genetic footprint - the 'Strategy DNA' - of each algorithm's behaviour.
Hodgkinson, who has been developing Exchange matching systems since 1992 and has automated more than a dozen exchanges around the world, said a key new development in the FD system is a new kind of matching engine.
"A great problem that has prevented the production of this kind of sophisticated testing lab in the past is the cost of a matching engine, which is in the millions," he said. "To test algorithms properly, you need to recreate a real environment - which may mean buying several matching engines to simulate several markets. This cost is prohibitive for even the world's biggest firms and unthinkable for smaller one. You really need a 'production' matching engine that can do the job of a real matching engine but isn't prohibitively expensive, and that's what we have created."
The Delta AlgoLab overcomes a number of hurdles that have been preventing such a system from being developed in the past.
"The total cost - even excluding the matching engine - of putting together such a system has been prohibitive to date," Hodgkinson said. "It's a complex job to integrate all the components as they haven't all been available from a single source. Also, firms have traditionally seen market data capture as too slow to keep pace with matching engines."
The Delta AlgoLab captures each algorithm's behaviour across the simulation and stores it in a sophisticated database that can analyse the algorithm's characteristics. It then provides a detailed report of what FD is calling the 'Strategy DNA' - a set of metrics providing a clear behavioural description of the algorithm.
"The beauty of this kind of reporting is that it can be provided to third parties such as regulators, in layman's terms using agreed metrics," Hodgkinson said. "This recognises the fact that while such strategies are usually developed by high-level mathematicians, they need to be understood by a broader audience concerned with market quality. At the same time, it protects the IP inherent in the strategy."
First Derivatives has developed a comprehensive testing system - the Delta AlgoLab - that serves two key purposes; for exchanges and regulators to profile and monitor HFT strategies, and for firms to test their algorithms and HFT strategies before releasing them into live markets.
Such a system has not been available in the past due to issues with speed of data capture; availability of realistic matching engine technology; and the complexity of sourcing and putting together all the required components.
Regulators globally have become increasingly concerned with algorithmic and HFT strategies since the 'Flash Crash ' in 2008. However, firms are understandably reluctant to hand over their costly intellectual property, and regulators are not necessarily equipped with the resources to understand how these complex algorithms work. There are also acknowledged deficiencies in the simulators currently in use.
"A key issue in simulation is that it assumes zero market impact, wherein historic replay might trigger a strategy but then fails to take into account the impact of any HFT strategy order that is generated." said Rob Hodgkinson. "That's not realistic, as obviously a live market is the result of all the participants interacting with each other."
The FD system has four key features that make it different from other approaches:
• A sophisticated simulation that takes market impact into account, generating each new order around the current bid/ask spread;
• A very fast 'production' matching engine that can simulate multiple markets at once;
• Injection of market events such as sector movements or a simulated 'flash crash' scenario to see how the algorithm will react;
• Realtime market data capture of all orders and trades to create a genetic footprint - the 'Strategy DNA' - of each algorithm's behaviour.
Hodgkinson, who has been developing Exchange matching systems since 1992 and has automated more than a dozen exchanges around the world, said a key new development in the FD system is a new kind of matching engine.
"A great problem that has prevented the production of this kind of sophisticated testing lab in the past is the cost of a matching engine, which is in the millions," he said. "To test algorithms properly, you need to recreate a real environment - which may mean buying several matching engines to simulate several markets. This cost is prohibitive for even the world's biggest firms and unthinkable for smaller one. You really need a 'production' matching engine that can do the job of a real matching engine but isn't prohibitively expensive, and that's what we have created."
The Delta AlgoLab overcomes a number of hurdles that have been preventing such a system from being developed in the past.
"The total cost - even excluding the matching engine - of putting together such a system has been prohibitive to date," Hodgkinson said. "It's a complex job to integrate all the components as they haven't all been available from a single source. Also, firms have traditionally seen market data capture as too slow to keep pace with matching engines."
The Delta AlgoLab captures each algorithm's behaviour across the simulation and stores it in a sophisticated database that can analyse the algorithm's characteristics. It then provides a detailed report of what FD is calling the 'Strategy DNA' - a set of metrics providing a clear behavioural description of the algorithm.
"The beauty of this kind of reporting is that it can be provided to third parties such as regulators, in layman's terms using agreed metrics," Hodgkinson said. "This recognises the fact that while such strategies are usually developed by high-level mathematicians, they need to be understood by a broader audience concerned with market quality. At the same time, it protects the IP inherent in the strategy."
FX Volatility Impacts Q1 Revenue of Compagnie Financière Tradition
Network, Learn, Grow | FMAS:24
Network, Learn, Grow | FMAS:24
Get ready to mark your calendars for FMAS:24, returning this May! Take a quick glimpse of what awaits at the Sandton Convention Centre in Sandton, South Africa from May 20-22, 2024.
Don't miss out on this 5-second invite packed with energy and urgency!
Secure your free ticket now 🔗 https://events.financemagnates.com/yQx0l?utm_source=youtube&utm_campaign=fmas-is-back&utm_medium=video&RefId=FMAS24+Video+Ad+%5B1%5D
#fmas24 #fmas #fmevents #financeinafrica #traders #investors #affiliates #forexTraders #investmentOpportunities #B2BNetworking #finTech #Innovations #TradingCommunity #BusinessOpportunities #AfricanBusiness #Johannesburg #southafrica
📣 Stay updated with the latest in finance and trading!
Follow FMevents across our social media platforms for news, insights, and event updates. Connect with us today:
🔗 LinkedIn: https://www.linkedin.com/showcase/financemagnates-events/
👍 Facebook: https://www.facebook.com/FinanceMagnatesEvents
📸 Instagram: https://www.instagram.com/fmevents_official
🐦 Twitter: https://twitter.com/F_M_events
🎥 TikTok: https://www.tiktok.com/@fmevents_official
▶️ YouTube: https://www.youtube.com/@FinanceMagnates_official
Don't miss out on our latest videos, interviews, and event coverage. Subscribe to our YouTube channel for more!
Get ready to mark your calendars for FMAS:24, returning this May! Take a quick glimpse of what awaits at the Sandton Convention Centre in Sandton, South Africa from May 20-22, 2024.
Don't miss out on this 5-second invite packed with energy and urgency!
Secure your free ticket now 🔗 https://events.financemagnates.com/yQx0l?utm_source=youtube&utm_campaign=fmas-is-back&utm_medium=video&RefId=FMAS24+Video+Ad+%5B1%5D
#fmas24 #fmas #fmevents #financeinafrica #traders #investors #affiliates #forexTraders #investmentOpportunities #B2BNetworking #finTech #Innovations #TradingCommunity #BusinessOpportunities #AfricanBusiness #Johannesburg #southafrica
📣 Stay updated with the latest in finance and trading!
Follow FMevents across our social media platforms for news, insights, and event updates. Connect with us today:
🔗 LinkedIn: https://www.linkedin.com/showcase/financemagnates-events/
👍 Facebook: https://www.facebook.com/FinanceMagnatesEvents
📸 Instagram: https://www.instagram.com/fmevents_official
🐦 Twitter: https://twitter.com/F_M_events
🎥 TikTok: https://www.tiktok.com/@fmevents_official
▶️ YouTube: https://www.youtube.com/@FinanceMagnates_official
Don't miss out on our latest videos, interviews, and event coverage. Subscribe to our YouTube channel for more!
Here's a sneak peek into the FMAS:24 vibrant atmosphere! Join us at Africa’s premium financial event for a transformative experience that combines the best of finance and technology.
From May 20-22, 2024, the Sandton Convention Centre in Sandton, South Africa, will be the hub for over 3,500 attendees to engage in unparalleled networking opportunities, learn from over 150 industry-leading speakers, and explore innovations from 120+ exhibitors.
Secure your free ticket now 🔗 https://events.financemagnates.com/yQx0l?utm_source=youtube&utm_campaign=fmas-is-back&utm_medium=video&RefId=FMAS24+Video+Ad+%5B1%5D
#fmas24 #fmas #fmevents #financeinafrica #traders #investors #affiliates #forexTraders #investmentOpportunities #B2BNetworking #finTech #Innovations #TradingCommunity #BusinessOpportunities #AfricanBusiness #Johannesburg #southafrica
📣 Stay updated with the latest in finance and trading!
Follow FMevents across our social media platforms for news, insights, and event updates. Connect with us today:
🔗 LinkedIn: https://www.linkedin.com/showcase/financemagnates-events/
👍 Facebook: https://www.facebook.com/FinanceMagnatesEvents
📸 Instagram: https://www.instagram.com/fmevents_official
🐦 Twitter: https://twitter.com/F_M_events
🎥 TikTok: https://www.tiktok.com/@fmevents_official
▶️ YouTube: https://www.youtube.com/@FinanceMagnates_official
Don't miss out on our latest videos, interviews, and event coverage. Subscribe to our YouTube channel for more!
Here's a sneak peek into the FMAS:24 vibrant atmosphere! Join us at Africa’s premium financial event for a transformative experience that combines the best of finance and technology.
From May 20-22, 2024, the Sandton Convention Centre in Sandton, South Africa, will be the hub for over 3,500 attendees to engage in unparalleled networking opportunities, learn from over 150 industry-leading speakers, and explore innovations from 120+ exhibitors.
Secure your free ticket now 🔗 https://events.financemagnates.com/yQx0l?utm_source=youtube&utm_campaign=fmas-is-back&utm_medium=video&RefId=FMAS24+Video+Ad+%5B1%5D
#fmas24 #fmas #fmevents #financeinafrica #traders #investors #affiliates #forexTraders #investmentOpportunities #B2BNetworking #finTech #Innovations #TradingCommunity #BusinessOpportunities #AfricanBusiness #Johannesburg #southafrica
📣 Stay updated with the latest in finance and trading!
Follow FMevents across our social media platforms for news, insights, and event updates. Connect with us today:
🔗 LinkedIn: https://www.linkedin.com/showcase/financemagnates-events/
👍 Facebook: https://www.facebook.com/FinanceMagnatesEvents
📸 Instagram: https://www.instagram.com/fmevents_official
🐦 Twitter: https://twitter.com/F_M_events
🎥 TikTok: https://www.tiktok.com/@fmevents_official
▶️ YouTube: https://www.youtube.com/@FinanceMagnates_official
Don't miss out on our latest videos, interviews, and event coverage. Subscribe to our YouTube channel for more!
Join 3500+ Attendees at FMAS:24 | Africa's Premium Financial Event
Join 3500+ Attendees at FMAS:24 | Africa's Premium Financial Event
Looking to expand your network in #Africa? Join 3500+ attendees at FMAS:24, where online trading, fintech, payments, and crypto meet! Connect with industry leaders and innovators for an unmatched networking experience.
20-22 MAY 2024
Sandton Convention Center, Sandton, South Africa
Register now to secure your spot: https://bit.ly/3JbUpCK
#fmas #fmas24 #fmevents #networking #finance #africa
📣 Stay updated with the latest in finance and trading!
Follow Finance Magnates for news, insights, and event updates across our social media platforms. Connect with us today:
🔗 LinkedIn: https://www.linkedin.com/company/financemagnates/
👍 Facebook: https://www.facebook.com/financemagnates/
📸 Instagram: https://www.instagram.com/financemagnates_official
🐦 X (Twitter): https://twitter.com/financemagnates/
📡 RSS Feed: https://www.financemagnates.com/feed/
▶️ Telegram: https://t.me/financemagnatesnews
Don't miss out on our latest videos, interviews, and event coverage.
🔔 Subscribe to our YouTube channel for more!🔔
Looking to expand your network in #Africa? Join 3500+ attendees at FMAS:24, where online trading, fintech, payments, and crypto meet! Connect with industry leaders and innovators for an unmatched networking experience.
20-22 MAY 2024
Sandton Convention Center, Sandton, South Africa
Register now to secure your spot: https://bit.ly/3JbUpCK
#fmas #fmas24 #fmevents #networking #finance #africa
📣 Stay updated with the latest in finance and trading!
Follow Finance Magnates for news, insights, and event updates across our social media platforms. Connect with us today:
🔗 LinkedIn: https://www.linkedin.com/company/financemagnates/
👍 Facebook: https://www.facebook.com/financemagnates/
📸 Instagram: https://www.instagram.com/financemagnates_official
🐦 X (Twitter): https://twitter.com/financemagnates/
📡 RSS Feed: https://www.financemagnates.com/feed/
▶️ Telegram: https://t.me/financemagnatesnews
Don't miss out on our latest videos, interviews, and event coverage.
🔔 Subscribe to our YouTube channel for more!🔔
Join 3500+ Attendees at FMAS:24 - Africa's Premium Financial Event
Join 3500+ Attendees at FMAS:24 - Africa's Premium Financial Event
Looking to expand your network in #Africa?
Join 3500+ attendees at FMAS:24, where online trading, fintech, payments, and crypto meet! Connect with industry leaders and innovators for an unmatched networking experience.
20-22 MAY 2024
Sandton Convention Center, Sandton, South Africa
Register now to secure your spot: https://bit.ly/3JbUpCK
#fmas #fmas24 #fmevents #networking #finance #africa
Looking to expand your network in #Africa?
Join 3500+ attendees at FMAS:24, where online trading, fintech, payments, and crypto meet! Connect with industry leaders and innovators for an unmatched networking experience.
20-22 MAY 2024
Sandton Convention Center, Sandton, South Africa
Register now to secure your spot: https://bit.ly/3JbUpCK
#fmas #fmas24 #fmevents #networking #finance #africa
Where the Prop Trading Industry Goes from Here | Finance Magnates Podcast
Where the Prop Trading Industry Goes from Here | Finance Magnates Podcast
Explore the tumultuous world of prop trading in this Finance Magnates podcast episode, featuring insights from Head of Axi Select, Greg Rubin.
We're discussing the challenges and shifts caused by MetaQuotes' pivotal decisions affecting MT4 and MT5 users, and how Axi Select offers a unique, realistic path to professional trading, steering clear of traditional prop firm pitfalls.
Tune in for expert analysis on the future of trading and innovative funding models.
The Axi Select programme is only available to clients of AxiTrader Limited. CFDs carry a high risk of investment loss. In our dealings with you, we will act as a principal counterparty to all of your positions. This content is not available for AU, NZ, EU and UK residents. For more information, refer to our Terms of Service. Standard trading fees apply.
This content is provided solely for general informational purposes and should not be construed as financial product advice or an investment recommendation. It has been prepared without considering your personal circumstances.
📣 Stay updated with the latest in finance and trading!
Follow Finance Magnates for news, insights, and event updates across our social media platforms. Connect with us today:
🔗 LinkedIn: https://www.linkedin.com/company/financemagnates/
👍 Facebook: https://www.facebook.com/financemagnates/
📸 Instagram: https://www.instagram.com/financemagnates_official
🐦 X (Twitter): https://twitter.com/financemagnates/
📡 RSS Feed: https://www.financemagnates.com/feed/
▶️ Telegram: https://t.me/financemagnatesnews
Don't miss out on our latest videos, interviews, and event coverage.
🔔 Subscribe to our YouTube channel for more!🔔
Explore the tumultuous world of prop trading in this Finance Magnates podcast episode, featuring insights from Head of Axi Select, Greg Rubin.
We're discussing the challenges and shifts caused by MetaQuotes' pivotal decisions affecting MT4 and MT5 users, and how Axi Select offers a unique, realistic path to professional trading, steering clear of traditional prop firm pitfalls.
Tune in for expert analysis on the future of trading and innovative funding models.
The Axi Select programme is only available to clients of AxiTrader Limited. CFDs carry a high risk of investment loss. In our dealings with you, we will act as a principal counterparty to all of your positions. This content is not available for AU, NZ, EU and UK residents. For more information, refer to our Terms of Service. Standard trading fees apply.
This content is provided solely for general informational purposes and should not be construed as financial product advice or an investment recommendation. It has been prepared without considering your personal circumstances.
📣 Stay updated with the latest in finance and trading!
Follow Finance Magnates for news, insights, and event updates across our social media platforms. Connect with us today:
🔗 LinkedIn: https://www.linkedin.com/company/financemagnates/
👍 Facebook: https://www.facebook.com/financemagnates/
📸 Instagram: https://www.instagram.com/financemagnates_official
🐦 X (Twitter): https://twitter.com/financemagnates/
📡 RSS Feed: https://www.financemagnates.com/feed/
▶️ Telegram: https://t.me/financemagnatesnews
Don't miss out on our latest videos, interviews, and event coverage.
🔔 Subscribe to our YouTube channel for more!🔔