Miscellaneous performance optimizations#3624

Draft

ChihweiLHBird wants to merge 5 commits into

spinframework:mainfrom

ChihweiLHBird:zhiwei/optimization-1

Commits on Jul 18, 2026

Cache the OTel logs enablement check so it is not re-read from the environment on every guest log write.
ChihweiLHBird
committed
Resolve the application name once at HTTP server construction instead of deserializing it from metadata on every request.
ChihweiLHBird
committed
Check key existence in the SQLite key-value store with a lightweight SELECT ... LIMIT 1 instead of fetching the whole value.
ChihweiLHBird
committed
Move embedding vectors out of the response instead of cloning them when building the embeddings result.
ChihweiLHBird
committed
Clone only the eos_token_id field instead of the entire llama Config when resolving the EOS token.
ChihweiLHBird
committed