Tuesday, 23rd May 2023
TIL
Comparing two training datasets using sqlite-utils
— [WizardLM](https://github.com/nlpxucan/WizardLM) is "an Instruction-following LLM Using Evol-Instruct". It's a fine-tuned model on top of Meta's LLaMA. The fine-tuning uses 70,000 instruction-output pairs from this JSON file: