23:32 UTC
Topic · updated daily · RSS feed for this topic

Safety & alignment

Daily feed of AI safety and alignment work: interpretability, evaluations, red-teaming, frontier-lab safety frameworks and governance of advanced AI.

Economic effects of the COVID-19 pandemic on entrepreneurship and small businesses

The existential threat to small businesses, based on their crucial role in the economy, is behind the plethora of scholarly studies in 2020, the first year of the COVID-19 pandemic. Examining the 15 contributions of the special issue on the "Economic effects of the COVID-19 pandemic on entrepreneurship and small businesses," the paper comprises four parts: a systematic review of the literature on the effect on entrepreneurship and small businesses; a discussion of four literature strands based o
OpenAlex 1784d ago Research Safety & alignmentJobs & economy

On Interpretability of Artificial Neural Networks: A Survey

Deep learning as represented by the artificial deep neural networks (DNNs) has achieved great success recently in many important areas that deal with text, images, videos, graphs, and so on. However, the black-box nature of DNNs has become one of the primary obstacles for their wide adoption in mission-critical applications such as medical diagnosis and therapy. Because of the huge potentials of deep learning, increasing the interpretability of deep neural networks has recently attracted much re
OpenAlex 1963d ago Research Safety & alignmentHealthcare

Artificial Intelligence, Values, and Alignment

Abstract This paper looks at philosophical questions that arise in the context of AI alignment. It defends three propositions. First, normative and technical aspects of the AI alignment problem are interrelated, creating space for productive engagement between people working in both domains. Second, it is important to be clear about the goal of alignment. There are significant differences between AI that aligns with instructions, intentions, revealed preferences, ideal preferences, interests and
OpenAlex 2160d ago Research Safety & alignment

Interpretability of machine learning‐based prediction models in healthcare

Abstract There is a need of ensuring that learning (ML) models are interpretable. Higher interpretability of the model means easier comprehension and explanation of future predictions for end‐users. Further, interpretable ML models allow healthcare experts to make reasonable and data‐driven decisions to provide personalized decisions that can ultimately lead to higher quality of service in healthcare. Generally, we can classify interpretability approaches in two groups where the first focuses on
OpenAlex 2224d ago Research Safety & alignmentHealthcare

On the interpretability of machine learning-based model for predicting hypertension

BACKGROUND: Although complex machine learning models are commonly outperforming the traditional simple interpretable models, clinicians find it hard to understand and trust these complex models due to the lack of intuition and explanation of their predictions. The aim of this study to demonstrate the utility of various model-agnostic explanation techniques of machine learning models with a case study for analyzing the outcomes of the machine learning random forest model for predicting the indivi
OpenAlex 2560d ago Research Safety & alignment

Machine Learning Interpretability: A Survey on Methods and Metrics

Machine learning systems are becoming increasingly ubiquitous. These systems’s adoption has been expanding, accelerating the shift towards a more algorithmic society, meaning that algorithmically informed decisions have greater potential for significant social impact. However, most of these accurate decision support systems remain complex black boxes, meaning their internal logic and inner workings are hidden to the user and even experts cannot fully understand the rationale behind their predict
OpenAlex 2563d ago Research Safety & alignment

Eye tracking in virtual reality

The intent of this paper is to provide an introduction into the bourgeoning field of eye tracking in Virtual Reality (VR). VR itself is an emerging technology on the consumer market, which will create many new opportunities in research. It offers a lab environment with high immersion and close alignment with reality. An experiment which is using VR takes place in a highly controlled environment and allows for a more in-depth amount of information to be gathered about the actions of a subject. Te
OpenAlex 2675d ago Research Safety & alignmentPrivacy

Explaining Explanations: An Overview of Interpretability of Machine Learning

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought processes. XAI allows users and parts of the internal system to be more transparent, providing explanations of their decisions in some level of detail. These explanations are important to ensure algorithmic fairness, identify potential bias/problems in the training
OpenAlex 2861d ago Research Bias & fairnessSafety & alignment

A Survey of Methods for Explaining Black Box Models

In recent years, many accurate decision support systems have been constructed as black boxes, that is as systems that hide their internal logic to the user. This lack of explanation constitutes both a practical and an ethical issue. The literature reports many approaches aimed at overcoming this crucial weakness, sometimes at the cost of sacrificing accuracy for interpretability. The applications in which black box decision systems can be used are various, and each approach is typically develope
OpenAlex 2901d ago Research Safety & alignment

The Mythos of Model Interpretability

In machine learning, the concept of interpretability is both important and slippery.
OpenAlex 2983d ago Research Safety & alignment

MATCHER: manifold alignment reveals correspondence between single cell transcriptome and epigenome dynamics

Single cell experimental techniques reveal transcriptomic and epigenetic heterogeneity among cells, but how these are related is unclear. We present MATCHER, an approach for integrating multiple types of single cell measurements. MATCHER uses manifold alignment to infer single cell multi-omic profiles from transcriptomic and epigenetic measurements performed on different cells of the same type. Using scM&T-seq and sc-GEM data, we confirm that MATCHER accurately predicts true single cell correlat
OpenAlex 3295d ago Research Safety & alignment

Toward Probabilistic Diagnosis and Understanding of Depression Based on Functional MRI Data Analysis with Logistic Group LASSO

Diagnosis of psychiatric disorders based on brain imaging data is highly desirable in clinical applications. However, a common problem in applying machine learning algorithms is that the number of imaging data dimensions often greatly exceeds the number of available training samples. Furthermore, interpretability of the learned classifier with respect to brain function and anatomy is an important, but non-trivial issue. We propose the use of logistic regression with a least absolute shrinkage an
OpenAlex 4110d ago Research Safety & alignmentHealthcare
← Newer