As we alluded to in our trends post, the number of researchers, developers and companies that focus on eXplainable AI (XAI) is growing faster each year.
💡
XAI is an umbrella term for methods, algorithms and tools that increase insight into the inner workings of AI. This is in contrast with the usual state of affairs where AI solutions are "black-box", i.e. where the developer cannot explain the result of the algorithm. XAI enables developers, decision-makers, consumers and other stakeholders to better understand why and how a certain prediction made by AI came to be.
There are three main drivers behind this evolution.
1. XAI is a significant competitive advantage in a market where only a few players harness its capabilities.
Maximally leveraging AI solutions requires stakeholder trust at every level, which can be attained through XAI. Moreover, XAI functions as a catalyst for a company's journey up the AI maturity curve and provides added value for the same level of maturity.
For example, XAI can facilitate advanced insights into existing AI solutions, allowing companies to derive more value without extensive investment. It can also enable new applications, such as human-in-the-loop approaches, where AI and humans collaborate to tackle challenges where neither can provide a satisfactory solution by themselves. So, what is stopping companies from adopting XAI?
- In corporations, extensive coordination & investment may be necessary to integrate AI-driven decisions into business processes, which can be exacerbated by internal divisions taking up different positions on the AI maturity curve altogether.
- In general, companies have not yet sufficiently progressed up the AI maturity curve, and do not have a clear path to integrating XAI in their AI solutions and business processes. However, increasingly industry-ready solutions are making that integration possible.
2. The software ecosystem supporting AI applications has advanced to the point where XAI is among the largest remaining obstacles to AI adoption and integration.
💡
Together with other evolutions in the AI software stack, data governance is becoming more and more straightforward to implement. Applications using unstructured data such as video, images & text are more accessible than ever, with fewer time spent on (pre)-processing & centralizing data, boosting time for value creation. Orchestration of AI infrastructure has become smoother, enabling consistent and scaleable solutions that can be adjusted to meet constantly evolving organizational needs. In our Datatrends 2022 video, our experts give their view on trends in the entire AI ecosystem.
Despite the increasing maturity of AI as a technology, we're still far away from making many AI solutions understandable to a satisfactory level in a straightforward manner. For example, how do we make sure an AI model is performing as intended over time, and doesn't negatively impact the bottom line, nor any of its end-users?
While there is a growing body of work dedicated to tackling such problems, it often takes a mix of domain experts & developers to interpret and translate the insights from contemporary XAI to non-technical, understandable explanations. While there are many solutions popping up that reduce the need for either domain experts or developers altogether, they do not always provide explainability at the level a stakeholder or regulator desires, which takes us to our next point.
3. Regulators are turning their attention to the exponential risk imposed by the AI-driven transformation of industries.
AI adoption is on the rise, and consequently impacting larger segments of society. In turn, European regulators are mandating interpretability and transparency to offset the potentially harmful effects on its citizens.
In 2016, EU significantly impacted the landscape of data-driven solutions with GDPR, propelling industry to shape their policies and technologies to adhere to these regulations. Potentially stricter enforcement of GDPR's "right-to-explanation" will require additional investment into existing XAI technologies and a system to provide insight to users and how they are impacted by automated AI decision-making.
Potential impact of stronger enforcement of GDPR or the new European AI Act on AI maturity curve
In 2021, European legislators announced they wish to further restrict applications of AI through the “Artificial Intelligence Act” which will drive the need for AI insight, transparency and governance. Especially for companies that have yet to integrate AI into their business processes (moving from the adoption phase to the operational phase) XAI may become a severe bottleneck.
Moreover, the new European AI Act will require entirely novel XAI methods to be developed for some industries, especially those operating in high-risk contexts, pushing the XAI bottleneck even to the early adoption phases.
XAI bottleneck in high-risk applications can potentially shift from the operational phase to the adoption phase due though enforcement of new EU AI regulations.
In conclusion, XAI will continue to grow as a target of investment in the near future. For those companies already leveraging AI solutions, early investment can ensure the continuity of their services offering. For others, the XAI bottleneck may pose a significant barrier of entry. At dataroots, we are actively working towards a more favorable status quo with established XAI standards for particular business contexts and risk levels, accelerating companies in their journey up the AI maturity curve.
Our data strategy and machine learning experts are actively developing XAI-as-a-service so your company can effortlessly clear the XAI barrier. Contact us if you're interested to learn more for your business case.
At dataroots research, we're actively monitoring the latest trends in research and industry to develop industry-ready tooling and integrate them into our existing services offering, so you can benefit from the best-in-class XAI for your business goals.
For a more technical deep dive into trends in XAI from the top AI conference NeurIPS in December 2021, take a look at our latest post.
Are you a student passionate about XAI? Our first XAI intern has just started and will help us in XAI research & development. Interested in an internship? Take a look at our open opportunities: https://careers.dataroots.io/
Top comments (0)