epfml/landmark-attention

model_name_or_path defaults

Opened this issue · 0 comments

StrangeTcy commented

In llama/train.py you have the following ModelArguments:

@dataclass
class ModelArguments:
    model_name_or_path: Optional[str] = field(default="facebook/opt-125m")

The whole folder is dedicated to finetuning LLaMA, so is defaulting to OPT wise?