02 · Inference infrastructure
Agent API
An inference API for creating coding tasks and executing them in temporary sandbox environments when the work requires it.
- Company
- Blackbox AI
- Period
- 2025 - Present
- Technologies
- Python, LiteLLM, Node.js, Docker
The challenge
What needed to work
Turn an agent workflow into a reliable API that developers can use programmatically without managing execution infrastructure.
My contribution
What I worked on
- Developed the API flow for creating and running agent tasks.
- Connected inference requests with isolated execution environments.
- Focused on response speed and dependable task handling.
The outcome
What shipped
The API accepts coding tasks, provisions sandboxed execution when needed, and returns results through a faster, consistent workflow.