I have not listened to the video yet, and I hope to soon.... But I will offer my explanation first...
From my understanding Yosef was wrong to depend on the Butler because he should have had faith that Hashem would rescue him without the help of the Butler and his society. Although it seems a big question because we also know we should not depend on miracles, and thus we should attempt to bring about our redemption through real-world means (not relying on supernatural help).