TIL: Running OpenAI's large context models using llm

13th June 2023

TIL Running OpenAI's large context models using llm — OpenAI [announced new models](https://openai.com/blog/function-calling-and-other-api-updates) today. Of particular interest to me is the new `gpt-3.5-turbo-16k` model, which provides GPT 3.5 with a 16,000 token context window (up from 4,000) priced at 1/10th of GPT-4 - $0.003 per 1K input tokens and $0.004 per 1K output tokens.