Topic · updated daily · RSS feed for this topic
Transparency
Explainable AI, audits, model cards, disclosure law and accountability mechanisms — tracked daily.
Revised Surgical CAse REport (SCARE) Guideline: An Update for the Age of Artificial Intelligence
INTRODUCTION Artificial intelligence (AI) is rapidly transforming healthcare and scientific publishing. Reporting guidelines need to be updated to consider this advance.The SCARE Guideline 2025 update introduces a new AI-focused domain to promote transparency, reproducibility, and ethical integrity in surgical case reports (SCAREs) involving AI. METHODS A Delphi consensus exercise was conducted to update the SCARE guidelines. A panel of 49 surgical and scientific experts was invited to rate prop
Transparency in the Reporting of Artificial Intelligence – The TITAN Guideline
The use of AI in research and the literature is increasing. The need for transparency is clear. Here we present a guideline to transparently report the use of AI in any manuscript in general. The guideline items cover; declaration, purpose and scope, AI tools and configuration, data inputs and safeguards, human oversight and verification, bias, ethics and regulatory compliance and reproducibility and transparency. These items have been confirmed in a recent Delphi consensus exercise with high pa
Explainable artificial intelligence for energy systems maintenance: A review on concepts, current techniques, challenges, and prospects
The rising demand for energy requires high investments in network extensions and renewable sources, alongside replacing inefficient systems. Smart maintenance is important in minimizing unscheduled outages, reducing costs, improving network security, and increasing equipment’s life expectancy. The vast amount of data collected by sensors and measurements in energy networks makes it hard for humans to detect failures continuously. Thanks to recent breakthroughs in AI, the energy sector has booste
Disclosing artificial intelligence use in scientific research and publication: When should disclosure be mandatory, optional, or unnecessary?
Currently there is a broad consensus among scholars that artificial intelligence (AI) tools can be used in research and publication, and that their use should be disclosed. Publishers and influential organizations, like the International Committee of Medical Journal Editors, have developed different and sometimes contradictory disclosure policies. We review some of these policies, examine the ethical reasons for disclosing AI use in research, and develop a framework for disclosure. We distinguis
The role of explainable artificial intelligence in disease prediction: a systematic literature review and future research directions
Explainable Artificial Intelligence (XAI) enhances transparency and interpretability in AI models, which is crucial for trust and accountability in healthcare. A potential application of XAI is disease prediction using various data modalities. This study conducts a Systematic Literature Review (SLR) following the PRISMA protocol, synthesizing findings from 30 selected studies to examine XAI's evolving role in disease prediction. It explores commonly used XAI methods, such as Shapley Additive Exp
Impact of Information and Communication Technologies on Democratic Processes and Citizen Participation
Background: This systematic review will address the influence of Information and Communication Technologies (ICTs) on democratic processes and citizens’ participation, which is enabled by such tools as social media, e-voting systems, e-government initiatives, and e-participation platforms. Methods: Based on an in-depth analysis of 46 peer-reviewed articles published between 1999 and 2024, this review emphasizes how ICTs have improved democratic engagement quality, efficiency, and transparency, b
Guiding AI in radiology: ESR’s recommendations for effective implementation of the European AI Act
This statement has been produced within the European Society of Radiology AI Working Group and identifies the key policies of the EU AI Act as they pertain to medical imaging. It offers specific recommendations to policymakers and the professional community for the effective implementation of the legislation, addressing potential gaps and uncertainties. Key areas include AI literacy, classification rules for high-risk AI systems, data governance, transparency, human oversight, quality management
Recent Emerging Techniques in Explainable Artificial Intelligence to Enhance the Interpretable and Understanding of AI Models for Human
Recent advancements in Explainable Artificial Intelligence (XAI) aim to bridge the gap between complex artificial intelligence (AI) models and human understanding, fostering trust and usability in AI systems. However, challenges persist in comprehensively interpreting these models, hindering their widespread adoption. This study addresses these challenges by exploring recently emerging techniques in XAI. The primary problem addressed is the lack of transparency and interpretability in AI models
Explainability, transparency and black box challenges of AI in radiology: impact on patient care in cardiovascular radiology
Abstract The integration of artificial intelligence (AI) in cardiovascular imaging has revolutionized the field, offering significant advancements in diagnostic accuracy and clinical efficiency. However, the complexity and opacity of AI models, particularly those involving machine learning (ML) and deep learning (DL), raise critical legal and ethical concerns due to their "black box" nature. This manuscript addresses these concerns by providing a comprehensive review of AI technologies in cardio
Transparency and accountability in AI systems: safeguarding wellbeing in the age of algorithmic decision-making
The rapid integration of artificial intelligence (AI) systems into various domains has raised concerns about their impact on individual and societal wellbeing, particularly due to the lack of transparency and accountability in their decision-making processes. This review aims to provide an overview of the key legal and ethical challenges associated with implementing transparency and accountability in AI systems. The review identifies four main thematic areas: technical approaches, legal and regu
A Perspective on Explainable Artificial Intelligence Methods: SHAP and LIME
eXplainable artificial intelligence (XAI) methods have emerged to convert the black box of machine learning (ML) models into a more digestible form. These methods help to communicate how the model works with the aim of making ML models more transparent and increasing the trust of end‐users in their output. SHapley Additive exPlanations (SHAP) and Local Interpretable Model Agnostic Explanation (LIME) are two widely used XAI methods, particularly with tabular data. In this perspective piece, the w
Explainable artificial intelligence: A survey of needs, techniques, applications, and future direction
Post-hoc vs ante-hoc explanations: xAI design guidelines for data scientists
The growing field of explainable Artificial Intelligence (xAI) has given rise to a multitude of techniques and methodologies, yet this expansion has created a growing gap between existing xAI approaches and their practical application. This poses a considerable obstacle for data scientists striving to identify the optimal xAI technique for their needs. To address this problem, our study presents a customized decision support framework to aid data scientists in choosing a suitable xAI approach fo
TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods
The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) statement was published in 2015 to provide the minimum reporting recommendations for studies developing or evaluating the performance of a prediction model. Methodological advances in the field of prediction have since included the widespread use of artificial intelligence (AI) powered by machine learning methods to develop prediction models. An update to the TRIPOD statement is thus need
Interpreting artificial intelligence models: a systematic review on the application of LIME and SHAP in Alzheimer’s disease detection
Explainable artificial intelligence (XAI) has gained much interest in recent years for its ability to explain the complex decision-making process of machine learning (ML) and deep learning (DL) models. The Local Interpretable Model-agnostic Explanations (LIME) and Shaply Additive exPlanation (SHAP) frameworks have grown as popular interpretive tools for ML and DL models. This article provides a systematic review of the application of LIME and SHAP in interpreting the detection of Alzheimer's dis
Navigating and reviewing ethical dilemmas in AI development: Strategies for transparency, fairness, and accountability
As artificial intelligence (AI) continues to permeate various aspects of our lives, the ethical challenges associated with its development become increasingly apparent. This paper navigates and reviews the ethical dilemmas in AI development, focusing on strategies to promote transparency, fairness, and accountability. The rapid growth of AI technology has given rise to concerns related to bias, lack of transparency, and the need for clear accountability mechanisms. In this exploration, we delve
Explainable Artificial Intelligence (XAI) 2.0: A manifesto of open challenges and interdisciplinary research directions
Understanding black box models has become paramount as systems based on opaque Artificial Intelligence (AI) continue to flourish in diverse real-world applications. In response, Explainable AI (XAI) has emerged as a field of research with practical and ethical benefits across various domains. This paper highlights the advancements in XAI and its application in real-world scenarios and addresses the ongoing challenges within XAI, emphasizing the need for broader perspectives and collaborative eff
Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence
Abstract Recent years have seen a tremendous growth in Artificial Intelligence (AI)-based methodological development in a broad range of domains. In this rapidly evolving field, large number of methods are being reported using machine learning (ML) and Deep Learning (DL) models. Majority of these models are inherently complex and lacks explanations of the decision making process causing these models to be termed as 'Black-Box'. One of the major bottlenecks to adopt such models in mission-critica
DETERMINANTS OF AUDIT QUALITY IN THE PUBLIC SECTOR
This study aims to provide a literature review on audit quality in the public sector. There are 15 articles used from 3 journal categories, namely Scopus quartile 2, international, and national indexed by Sinta 3 which were published from 2017 to 2021. This study used the Systematic Literature Review method developed by Kitchenham et al (2009). Article searches are carried out through the publish or perish application with a search focus on Scopus as the main search source. Researchers also use
Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence
Artificial intelligence (AI) is currently being utilized in a wide range of sophisticated applications, but the outcomes of many AI models are challenging to comprehend and trust due to their black-box nature. Usually, it is essential to understand the reasoning behind an AI model’s decision-making. Thus, the need for eXplainable AI (XAI) methods for improving trust in AI models has arisen. XAI has become a popular research subject within the AI field in recent years. Existing survey papers have
A systematic review of trustworthy and explainable artificial intelligence in healthcare: Assessment of quality, bias risk, and data fusion
Transparency and explainability of AI systems: From ethical guidelines to requirements
Recent studies have highlighted transparency and explainability as important quality requirements of AI systems. However, there are still relatively few case studies that describe the current state of defining these quality requirements in practice. This study consisted of two phases. The first goal of our study was to explore what ethical guidelines organizations have defined for the development of transparent and explainable AI systems and then we investigated how explainability requirements c
Accountability in artificial intelligence: what it is and how it works
Abstract Accountability is a cornerstone of the governance of artificial intelligence (AI). However, it is often defined too imprecisely because its multifaceted nature and the sociotechnical structure of AI systems imply a variety of values, practices, and measures to which accountability in AI can refer. We address this lack of clarity by defining accountability in terms of answerability, identifying three conditions of possibility (authority recognition, interrogation, and limitation of power
Survey of Explainable AI Techniques in Healthcare
Artificial intelligence (AI) with deep learning models has been widely applied in numerous domains, including medical imaging and healthcare tasks. In the medical field, any judgment or decision is fraught with risk. A doctor will carefully judge whether a patient is sick before forming a reasonable explanation based on the patient's symptoms and/or an examination. Therefore, to be a viable and accepted tool, AI needs to mimic human judgment and interpretation skills. Specifically, explainable A
Fairness, Accountability, Transparency, and Ethics (FATE) in Artificial Intelligence (AI) and higher education: A systematic review
The use of Artificial Intelligence or AI is rising in higher education. With this rise, the morality of AI programs is being questioned. There is as such a need to understand how notions of Fairness, Accountability, Transparency, and Ethics or FATE are identified in the AI and higher education studies to date. This systematic review paper aims to understand definitions and studies on FATE and AI in higher education literature. The contribution of this work is to provide a summary of FATE develop
Explainable medical imaging AI needs human-centered design: guidelines and evidence from a systematic review
Transparency in Machine Learning (ML), often also referred to as interpretability or explainability, attempts to reveal the working mechanisms of complex models. From a human-centered design perspective, transparency is not a property of the ML model but an affordance, i.e., a relationship between algorithm and users. Thus, prototyping and user evaluations are critical to attaining solutions that afford transparency. Following human-centered design principles in highly specialized and high stake
AI adoption and diffusion in public administration: A systematic literature review and future research agenda
Artificial Intelligence (AI) implementation in public administration is gaining momentum heralded by the hope of smart public services that are personalised, lean, and efficient. However, the use of AI in public administration is riddled with ethical tensions of fairness, transparency, privacy, and human rights. We call these AI tensions. The current literature lacks a contextual and processual understanding of AI adoption and diffusion in public administration to be able to explore such tension
On the Tractability of SHAP Explanations
SHAP explanations are a popular feature-attribution mechanism for explainable AI. They use game-theoretic notions to measure the influence of individual features on the prediction of a machine learning model. Despite a lot of recent interest from both academia and industry, it is not known whether SHAP explanations of common machine learning models can be computed efficiently. In this paper, we establish the complexity of computing the SHAP explanation in three important settings. First, we cons
A Review of Taxonomies of Explainable Artificial Intelligence (XAI) Methods
The recent surge in publications related to explainable artificial intelligence (XAI) has led to an almost insurmountable wall if one wants to get started or stay up to date with XAI. For this reason, articles and reviews that present taxonomies of XAI methods seem to be a welcomed way to get an overview of the field. Building on this idea, there is currently a trend of producing such taxonomies, leading to several competing approaches to construct them. In this paper, we will review recent appr
Transparency of AI in Healthcare as a Multilayered System of Accountabilities: Between Legal Requirements and Technical Limitations
The lack of transparency is one of the artificial intelligence (AI)'s fundamental challenges, but the concept of transparency might be even more opaque than AI itself. Researchers in different fields who attempt to provide the solutions to improve AI's transparency articulate different but neighboring concepts that include, besides transparency, explainability and interpretability. Yet, there is no common taxonomy neither within one field (such as data science) nor between different fields (law
The medical algorithmic audit
Artificial intelligence systems for health care, like any other medical device, have the potential to fail. However, specific qualities of artificial intelligence systems, such as the tendency to learn spurious correlates in training data, poor generalisability to new deployment settings, and a paucity of reliable explainability mechanisms, mean they can yield unpredictable errors that might be entirely missed without proactive investigation. We propose a medical algorithmic audit framework that
To explain or not to explain?—Artificial intelligence explainability in clinical decision support systems
Explainability for artificial intelligence (AI) in medicine is a hotly debated topic. Our paper presents a review of the key arguments in favor and against explainability for AI-powered Clinical Decision Support System (CDSS) applied to a concrete use case, namely an AI-powered CDSS currently used in the emergency call setting to identify patients with life-threatening cardiac arrest. More specifically, we performed a normative analysis using socio-technical scenarios to provide a nuanced accoun
A Systematic Review of Explainable Artificial Intelligence in Terms of Different Application Domains and Tasks
Artificial intelligence (AI) and machine learning (ML) have recently been radically improved and are now being employed in almost every application domain to develop automated or semi-automated systems. To facilitate greater human acceptability of these systems, explainable artificial intelligence (XAI) has experienced significant growth over the last couple of years with the development of highly accurate models but with a paucity of explainability and interpretability. The literature shows evi
Explainable Deep Learning: A Field Guide for the Uninitiated
Deep neural networks (DNNs) are an indispensable machine learning tool despite the difficulty of diagnosing what aspects of a model’s input drive its decisions. In countless real-world domains, from legislation and law enforcement to healthcare, such diagnosis is essential to ensure that DNN decisions are driven by aspects appropriate in the context of its use. The development of methods and studies enabling the explanation of a DNN’s decisions has thus blossomed into an active and broad area of
Explainable Artificial Intelligence in education
There are emerging concerns about the Fairness, Accountability, Transparency, and Ethics (FATE) of educational interventions supported by the use of Artificial Intelligence (AI) algorithms. One of the emerging methods for increasing trust in AI systems is to use eXplainable AI (XAI), which promotes the use of methods that produce transparent explanations and reasons for decisions AI systems make. Considering the existing literature on XAI, this paper argues that XAI in education has commonalitie
Explainable AI for Healthcare 5.0: Opportunities and Challenges
In the healthcare domain, a transformative shift is envisioned towards Healthcare 5.0. It expands the operational boundaries of Healthcare 4.0 and leverages patient-centric digital wellness. Healthcare 5.0 focuses on real-time patient monitoring, ambient control and wellness, and privacy compliance through assisted technologies like artificial intelligence (AI), Internet-of-Things (IoT), big data, and assisted networking channels. However, healthcare operational procedures, verifiability of pred
Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
This survey presents a comprehensive review of current literature on Explainable Artificial Intelligence (XAI) methods for cyber security applications. Due to the rapid development of Internet-connected systems and Artificial Intelligence in recent years, Artificial Intelligence including Machine Learning and Deep Learning has been widely utilized in the fields of cyber security including intrusion detection, malware detection, and spam filtering. However, although Artificial Intelligence-based
Explainable AI Methods - A Brief Overview
Abstract Explainable Artificial Intelligence (xAI) is an established field with a vibrant community that has developed a variety of very successful approaches to explain and interpret predictions of complex machine learning models such as deep neural networks. In this article, we briefly introduce a few selected methods and discuss them in a short, clear and concise way. The goal of this article is to give beginners, especially application engineers and data scientists, a quick overview of the s
Counterfactuals and causability in explainable artificial intelligence: Theory, algorithms, and applications
Digitalization, accounting and accountability: A literature review and reflections on future research in public services
Abstract This study discusses the current state of the art and future directions of research on digitalization, accountability, and accounting in public services. Through a systematic literature review, we investigate 232 articles published between 1998 and the first quarter of 2020. These studies are analyzed looking at the implications of the increasing digitalization of the public realm for the (i) production of data, (ii) consumption of data, and (iii) their subsequent effects. Based upon th