TensorRT-LLM will be gaining a wrapper for OpenAI's Chat API and performance improvements for LLMs.
NVIDIA adds support for OpenAI's Chat API to its latest GPUs. Here's why it's it's a big deal. : Read more
NVIDIA adds support for OpenAI's Chat API to its latest GPUs. Here's why it's it's a big deal. : Read more