Bytes: Use ManuallyDrop instead of mem::forget

Bytes: Use ManuallyDrop instead of mem::forget #582