dbreunig said about 4 years ago on A Rubyist's Apple M1 Review :
  Makes sense. I'll likely develop remotely in the interim. 

Are you running into issues with the arm64 binary not related to gems? So far the pattern seems to be gems calling out to external libraries.