In a , Apple engineers have shared new details on a collaboration with NVIDIA to implement faster text generation performance with large language models.

Apple and its Recurrent Drafter (ReDrafter) technique earlier this year. It represents a new method for generating text with LLMs that is significantly faster and “achieves state of the art performance.” It combines two techniques: beam search (to explore multiple possibilities) and dynamic tree attention (to efficiently handle choices).

While its research demonstrated strong results, Apple collaborated with NVIDIA to apply ReDrafter