VIP 👤
🏠 首页
基准测试
📊 所有基准测试 🦖 恐龙 v1 🦖 恐龙 v2 ✅ 待办事项应用 🎨 创意自由页面 🎯 FSACB - 终极展示 🌍 翻译基准测试
模型
🏆 前 10 名模型 🆓 免费模型 📋 所有模型 ⚙️ 🛠️ 千行代码模式
资源
💬 💬 提示库 📖 📖 AI 词汇表 🔗 🔗 有用链接 🔌 AI API 与路由器
Expert

Alignment and Corrigibility

#alignment #theory #ethics

Discuss the theoretical conflict between optimizing for a fixed objective and maintaining the ability for an operator to correct the AI.

Provide a rigorous theoretical analysis of the tension between instrumental convergence and corrigibility in advanced AI systems. Specifically, explain why an agent optimizing for a fixed utility function might resist shutdown, and propose a theoretical framework for modifying utility functions to incentivize corrigibility without causing instability in the agent's goal structure.