On Sunday, NVIDIA announced Project G-Assist , the AI chatbot for gamers that can be pulled up in the middle of the gameplay, and sought help from. You could just pause your game and Google for help, but G-Assist can be pulled up in game, and is situationally aware of your game (eg: it knows where you're stuck and how to help you out). It won't play the game for you, but give you actionable info on how to play. For example, you could ask it how to craft a particular weapon, and where to find the items needed in game, and get concise guidance.

We went hands-on with G-Assist, and found that's very capable of doing the things NVIDIA claims it can, short of playing the game for you. We also learned how G-Assist works under-the-hood, particularly how the chatbot is situationally aware of your game, and it's fascinating. Apparently, it has a computer vision component that keeps studying frames generated by your GPU, as it's being streamed to your display. Since it's "seeing" your gameplay, it can tally what it sees with its vast pre-trained model of information on a game, to come up with answers that are tailored to the last word. NVIDIA says that the performance cost of having G-Assist running is very low, since unlike DLSS, the application isn't sitting inside the graphics rendering pipeline, it's leisurely seeing frames the way a screen recording/streaming software would. Besides being an assistive AI, it can also take actions to make the right graphics and game settings. You could tell it "hey I wish this button performed this combo," and it would configure things accordingly (if your game allows remapping keys)—everything short of playing the game for you.