Carlos Costa
IBM Distinguished Engineer and llm-d project lead for inference optimization research
Carlos Costa is a member of the project leadership of llm-d, the Kubernetes-native distributed inference serving stack, listed with IBM as employer, and one of the project's three initial maintainers, representing inference optimization research. llm-d's launch and release posts list Costa as a Distinguished Engineer at IBM.1237
llm-d
The llm-d project document names Costa, Clayton Coleman and Robert Shaw as the initial maintainers, with Costa representing inference optimization research. The current maintainers file lists Costa, with IBM as employer, in the project leadership with Abdullah Gharaibeh and Robert Shaw.21
Costa co-wrote "Announcing the llm-d community!" in May 2025, which presented llm-d as a modular serving stack using KV-cache aware routing and disaggregated serving with Kubernetes tooling. Costa also co-wrote the release posts for llm-d 0.2, 0.3, 0.4 and 0.5.34567
Work
Career timeline
May 20, 2025
Co-authored the post announcing the llm-d community.3
Jul 29, 2025
Co-authored the llm-d 0.2 release post on the project's first well-lit paths.4
Oct 10, 2025
Co-authored the llm-d 0.3 release post on wider hardware support.5
Dec 2, 2025
Co-authored the llm-d 0.4 release post on performance across accelerators.6
Feb 4, 2026
Co-authored the llm-d 0.5 release post, "Sustaining Performance at Scale".7
Related people
More sourced profiles at the same organization, in the same field, or from the same school.
- Aaron TeoAlso at IBM
- 0xSeroInference and serving
- Arvind KrishnaAlso at IBM
- Adrien GallouëtInference and serving
- David D. CoxAlso at IBM Research
- Akshat BubnaInference and serving
- Francesca RossiAlso at IBM Research
- Aldehir RojasInference and serving
- Hendrik StrobeltAlso at IBM Research
- Amir HaghighatInference and serving
- Kate SouleAlso at IBM Research
- Andrew FeldmanInference and serving
Is this you?
Profiles cover public professional work only, and every line cites a source. If something is out of date, missing or wrong, send a correction with a link to an official page and we will update it. Suggest a correction
Add this badge to your website or GitHub profile README. It links back to this page. It is not an endorsement or a rating.
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/people/carlos-costa/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/people/carlos-costa/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/profile.svg" alt="Carlos Costa — Profile on USASI" height="20"></a>
This profile covers public professional work only, from the sources below. It is not an endorsement or a ranking. To correct or remove it, use the correction form.