Why cross-compilation is harder in Rust than Go?

I found it more difficult to cross compile in Rust, especially for Apple.

In Go it's just a couple env vars GOOS=darwin GOARCH=arm64, but on Rust you need Xcode sdk and this is hassle.

What stops Rust of doing the same?