OpenAI API Compatibility

This release adds initial compatibility support for the OpenAI Chat Completions API.

curl http://localhost:11434/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "model": "llama2",
        "messages": [
            {
                "role": "system",
                "content": "You are a helpful assistant."
            },
            {
                "role": "user",
                "content": "Hello!"
            }
        ]
    }'

See the OpenAI compatibility docs for more information.

New Models

• Qwen 1.5: Qwen 1.5 is a new family of large language models by Alibaba Cloud spanning from 0.5B to 72B.

What's Changed

• Fixed issue where requests to /api/chat would hang when providing empty user messages repeatedly
• Fixed issue on macOS where Ollama would return a missing library error after being open for a long period of time

New Contributors

• @easp made their first contribution in https://github.com/ollama/ollama/pull/2340
• @mraiser made their first contribution in https://github.com/ollama/ollama/pull/1849

Full Changelog: https://github.com/ollama/ollama/compare/v0.1.23...v0.1.24