What's Changed

• Fix macos CI by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/62
• batched streaming by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/55
• fix: broken pipes caused inference worker to fail by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/61
• fix: default unbatch always generator by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/68
• document streaming by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/49
• document accelerator=auto by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/64
• document batching by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/65
• allow timeout disable by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/63
• Add devices auto by @lantiga in https://github.com/Lightning-AI/LitServe/pull/69
• add license info by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/74
• allow to set mps accelerator explicitly by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/73
• add readme improvements by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/70
• decouple decode_request from get_batch_from_uid by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/79
• fix cuda forking error by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/77
• feat: Support multipart & url-encoded form bodies by @andyland in https://github.com/Lightning-AI/LitServe/pull/80
• Let the user know when "setup" has completed... by @williamFalcon in https://github.com/Lightning-AI/LitServe/pull/82
• format encoded response by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/85
• [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/78
• improve logging by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/87
• Update server.py by @williamFalcon in https://github.com/Lightning-AI/LitServe/pull/89
• removes /stream-predict endpoint and standardizes to /predict by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/93
• validate port by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/92
• Bump version since litserve is different from the last released version by @rasbt in https://github.com/Lightning-AI/LitServe/pull/94
• Add Stream API Example by @rasbt in https://github.com/Lightning-AI/LitServe/pull/95
• add openai spec v0 by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/76
• Exclude markdown files from pre-commit formatter by @rasbt in https://github.com/Lightning-AI/LitServe/pull/96
• fix summary tag by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/97
• add client detail to streaming document by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/98
• Fix installation instructions for case sensitive file systems by @rasbt in https://github.com/Lightning-AI/LitServe/pull/102
• Improve docs for OpenAI spec by @lantiga in https://github.com/Lightning-AI/LitServe/pull/100
• add newline while streaming JSON objects by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/105
• fix pipe reuse by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/108
• add openai streaming by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/101
• Add real docs! by @williamFalcon in https://github.com/Lightning-AI/LitServe/pull/114
• feat: Update OpenAI spec to include image url in message content by @bhimrazy in https://github.com/Lightning-AI/LitServe/pull/113
• feat: Update OpenAI spec to include support for tools by @bhimrazy in https://github.com/Lightning-AI/LitServe/pull/119
• inject context to share/log values across LitAPI methods by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/118
• Track device automatically by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/123
• fix: kill process by @bhimrazy in https://github.com/Lightning-AI/LitServe/pull/124
• [pre-commit.ci] pre-commit suggestions by @pre-commit-ci in https://github.com/Lightning-AI/LitServe/pull/125
• pre-populate context with OpenAISpec by @aniketmaurya in https://github.com/Lightning-AI/LitServe/pull/126

New Contributors

• @andyland made their first contribution in https://github.com/Lightning-AI/LitServe/pull/80
• @pre-commit-ci made their first contribution in https://github.com/Lightning-AI/LitServe/pull/78
• @rasbt made their first contribution in https://github.com/Lightning-AI/LitServe/pull/94
• @bhimrazy made their first contribution in https://github.com/Lightning-AI/LitServe/pull/113

Full Changelog: https://github.com/Lightning-AI/LitServe/compare/v0.1.0...v0.1.1dev0