v0.41.0 model gateway, provider headers, faster re-reviews
Highlights
- Model gateway keeps provider keys out of docker sandboxes (#492). Set
sandboxGateway: trueon a custom provider and docker sandboxes get a placeholder key and a URL on a newmodel-gatewaysidecar, which adds the real key and forwards over HTTPS. An agent working on untrusted code can no longer read the provider key from its environment. Opt in withCOMPOSE_PROFILES=model-gateway;smolandkubernetesrefuse the option, andgondolin/nonedon’t need it (they call the model host-side). Sandboxes also can no longer read or rewrite the generated firewall and collector configs under/data/proxy. - Literal request headers for custom providers (#486).
providers.<prefix>.headerssends fixed headers (a gateway’s routing or zero-data-retention flag, say) on every model call: the cheap helpers, the agent, and in-process chat. Values must be literal (no!or$), credential headers stay inenvKey, and built-in providers refuseheaders:in favour of declaring your own prefix.agentic-pi’s programmaticrun()now validates itsprovidersoption the same way as--providers. - Re-reviews reuse far more of the unit survey (#491). Unit and obligation ids are now content hashes instead of positions, so a unit whose code didn’t change renders byte-identically and hits the reply cache. On a real re-review with ten changed files, the matching requests went from 9 of 214 to 154 of 214. Expect one full re-survey per PR right after upgrading, since existing cache entries use the old ids.
Upgrade notes
- The
sandbox-egressnetwork gets anip_rangeso sandboxes can never take a sidecar’s static address. Compose has to recreate the network once, which it can’t do while a sandbox is attached.lastlight server update(andserver start) now check for this before stopping anything: if runs are in progress they exit non-zero and name the attached containers. Let the runs finish and re-run the update. An auto-deploy that lands mid-run fails this way with the stack still up.
Packages
lastlight0.41.0,lastlight-core0.41.0lastlight-shared0.14.0lastlight-code-facts0.8.4agentic-pi0.9.0lastlight-evals0.20.6lastlight-workflow-engine0.11.1 (unchanged)
Full changelog: https://github.com/nearform/lastlight/compare/v0.40.5...v0.41.0