Safety inside the model

See where a model's refusals live, how they are removed and what still protects an app.

  1. Can a model's refusals be removed?

    In a toy network one direction carries every refusal. Taking it out ends them and barely moves other answers, so an app must not rest on refusals alone.

    6 min+17 min deeper