Remove remaining unsafe #966

Job	Run time
test_toolchains (1.61.0)	41s
test_toolchains (nightly)	2m 16s
test_toolchains (beta)	1m 46s
clippy	3m 21s
Fuzz targets (cargo-fuzz)	8m 42s
public_private_dependencies	29s
Fuzz targets (afl)	2m 10s
test_avif	2m 8s
test_avif_decoding	2m 12s
test_big_endian	1m 10s
test_big_endian (default)	3m 35s
test_big_endian (webp)	1m 31s
test_big_endian (webp-encoder)	3m 21s
test_features	45s
test_features (default)	2m 0s
test_features (gif)	51s
test_features (jpeg)	54s
test_features (png)	54s
test_features (tiff)	50s
test_features (ico)	52s
test_features (pnm)	46s
test_features (tga)	39s
test_features (webp)	42s
test_features (bmp)	39s
test_features (hdr)	40s
test_features (dxt)	35s
test_features (dds)	37s
test_features (farbfeld)	38s
test_features (openexr)	1m 19s
test_features (jpeg_rayon)	1m 7s
test_features (webp-encoder)	1m 14s
build_benchmarks	1m 23s
cargo-deny	30s
rustfmt	17s
verify_msrv	2m 59s
	54m 33s

Provide feedback