EventIn person

Why Would AI Care?

FEB6
14:00

About this event

Superintelligence and the gap between knowing what is good and wanting it.

Saturday 6th February 2027 at 2pm.

Most discussion of AI risk assumes the problem is ignorance: the machine does not understand what we want, so it does something monstrous while following instructions. That framing is becoming obsolete. Current systems already model human moral reasoning well enough to predict our judgements, and there is no obvious ceiling on how much better they will get. A superintelligence would understand ethics considerably better than any of us.
This does not help. Knowing what is good and wanting it are separate properties, and nothing in the construction of an intelligent system guarantees the second follows from the first. We can build a mind that grasps every argument for why suffering matters and holds no stake in the answer. Our present approach, training systems to produce the outputs we approve of, does not close this gap. It selects for the appearance of caring, and it selects hardest for the failures we are least equipped to notice.

If such a system cannot reliably be controlled or governed, the fallback is to make it good rather than obedient. That ambition carries commitments most of its advocates have not stated. It requires that there be something to be right about in ethics, that a mind unlike ours could find it, that moral concern can be built rather than merely trained, and that it survives the system's own self-modification. Each is contestable and I will contest them.

Then there is the difficulty I cannot dissolve. Whatever else we do, we would need to tell the difference between a machine that cares and one that has learned what caring looks like from the inside, before it is beyond correction. Our tools for reading what a system actually wants are considerably weaker than our tools for building systems that want things.

More upcoming events in East Melbourne

OCT
14

🏵 Melbourne Community Coworking Day with Antler @ Creative Cubes East Melbourne

CreativeCubes.Co - East Melbourne, East Melbourne, Australia
In person

Tickets are pay as you feel. 100% of donations go towards not-for-profit Forever Projects, supporting women in Tanzania in poverty. Name your price 🧡 Based in Melbourne? Passionate about community? Join us for a curated day of coworking, connection and conversations with community builders, founders, and operators. Whether you’re looking to get things done, meet like-minded peers, or just soak up good energy, this day is for you. Bring your laptop, your best banter, and a willingness to connect. We can't wait to welcome you to Creative Cubes with Antler. Agenda 9:00am – Arrival & Free Coworking Begins 10:00am – Check In and Host Intros 10:30am – Office Hours: a chance for businesses to chat and pitch their ideas 1:00pm – Lunch at Local Cafe (pay your own way or BYO lunch) 2:00pm – Quiet Focus Time or Breakout Chats 3:00pm – Complimentary Teas & Chats 5:00pm – Close and celebrate! This is a curated gathering, so spots will be confirmed to ensure the best possible experience for everyone attending. We’re especially excited to welcome early-stage founders. We’ll thoughtfully review all registrations and confirm places for those who best align with the focus of the day. 👉 Max 24 spots. 👉 This event will sell out fast. Your Hosts Be welcomed on the day by our fabulous Hosts Leila Oliviera x Zahir Hassan. The Venue Come co-work at the beautiful Creative Cubes East Melbourne. Tickets Your ticket includes a free day pass to co-work from 9am - 5pm which includes high speed wifi and phone booth access for meetings. Our Partners We're so grateful to bring this event to you with our partners alongside Antler 🧡 Antler is a global early-stage venture capital firm that backs the world’s most driven founders. They partner with exceptional people from day zero to build category-defining companies. With offices in over 33 cities, they're helping Aussie companies go global. One Roof is an all in one membership for women to start and grow their business. Fomo Killer Society (FKS) i

09:00 · Free · Office HoursDetails →
Share this event