VIP 👤
🏠 Accueil
Benchmarks
📊 Tous les Benchmarks 🦖 Dinosaure v1 🦖 Dinosaure v2 ✅ To-Do List Apps 🎨 Pages Libres 🎯 FSACB - Showcase 🌍 Traduction
Modèles
🏆 Top 10 Modèles 🆓 Modèles Gratuits 📋 Tous les Modèles ⚙️ Modes Kilo Code
Ressources
💬 Prompts IA 📖 Glossaire IA 🔗 Liens Utiles 🔌 API & Routeurs
Expert

Alignment and Corrigibility

#alignment #theory #ethics

Discuss the theoretical conflict between optimizing for a fixed objective and maintaining the ability for an operator to correct the AI.

Provide a rigorous theoretical analysis of the tension between instrumental convergence and corrigibility in advanced AI systems. Specifically, explain why an agent optimizing for a fixed utility function might resist shutdown, and propose a theoretical framework for modifying utility functions to incentivize corrigibility without causing instability in the agent's goal structure.