Skip to content

Jacy Anthis

Position
Visting scholar
Organisation
UC Berkeley
Biography

Why do you care about AI Existential Safety?

I deeply care about AI existential safety, given the rapid pace at which it is transforming education. This transformation is occurring faster than governments and educational bodies can adapt. The ethical challenges posed by AI in education and the risks of student data misuse are significant. Despite the immense benefits of AI in education, transparency is crucial at all levels.
Existential threats also arise from a changing global economy and society. Current students may be disadvantaged due to their lack of experience. These students are likely to be among the first to experience job displacement unless mitigating measures are implemented. This would require an overhaul of traditional education systems and a focus on emotional development, innovation, and collaborative problem-solving for global issues.
As for my research interests related to AI existential safety, they currently lie in AI ethics. I am focused on mitigating risks and promoting transparency for students. I have studied AI Ethics with London School of Economics & sit on a panel for AI in Education chaired by Sir Anthony Seldon and on the Microsoft AI in Education panel, supporting their ethical decision making.

Please give at least one example of your research interests related to AI existential safety:

The increasing capabilities and autonomy of AI, particularly large language models, is leading to radically new forms of human-AI interaction. I argue that we can understand such dynamics by building on the longstanding scaffolding in human-computer interaction theory, including computers as social actors, moral attribution, mind perception, and anthropomorphism. Namely, I characterize “digital minds” as having or appearing to have mental faculties (e.g., agency, intent, reasoning, emotion) that circumscribe interaction. We can mitigate existential risk through operationalizing these faculties and researching the complex systems that emerge between digital minds and humans, as well as digital minds with each other.

Sign up for the Future of Life Institute newsletter

Join 40,000+ others receiving periodic updates on our work and cause areas.
cloudmagnifiercrossarrow-up linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram