The script loads the checkpoint and samples from the model on a test input. Due to the large size of the model (314B parameters), a machine with enough GPU memory is required to test the model with ...
This repository offers 31 different host file variants, in addition to the base variant, with and without the unified hosts included. The Non GitHub mirror is the link to use for some hosts file ...