The gemfiles generated by appraisal need to be committed for CI to work. Only ignoring the .gemfile.lock files which are generated at runtime.