During Hot Chips 2025, Microsoft showed its latest cybersecurity protection layer, now built directly into the silicon and on the server boards powering its Azure cloud services. At the scale of Azure, embedding layered security protection is a must to avoid cyberattacks, and Microsoft's reputation has been flawless in keeping its customers secure and protected from external attack vectors. These silicon "shields" are hardware security modules (HSMs) and Caliptra Root of Trust (RoT) 2.0—dedicated silicon that verifies cryptographic keys for any modification, stores them, and executes certain operations before reaching the actual CPU. Bryan Kelly, a security architect at Microsoft, explains that "They're specialized hardware that are deployed separately in separate clusters, and this can create some challenges with scaling them as the compute and AI infrastructure is deployed."
Bryan Kelly later explains that "Another challenge is they're remotely accessed. When a workload wants to access its keys that are stored in HSM, it has to do a TLS connection to the HSM, ask it to perform an operation with the key, and then return the data. That creates latency… so, it becomes impractical for some workloads." This would mean that all cloud VMs benefit from these HSMs; however, for larger-scale HPC workloads that are latency-sensitive, Microsoft must employ an entirely different security approach. Additionally, open-source projects like Caliptra RoT 2.0 are also integrated across the server vertical, providing an extra layer of security protection. Finally, CPUs and GPUs have their own trusted execution environments (TEEs), which are the final point of security for VMs and shared hardware. By the time an attack vector is loaded onto the system, it must pass several layers of protection and key checks before any execution happens. At the scale most CSPs operate today, it is necessary to ensure maximum security of sensitive user data. Keep in mind that hyperscalers like Azure work with governments, so all of this is a good selling point for their systems.