These Things You Can't Unlearn