Earlier this year, Microsoft made a splash at its Ignite conference for IT professionals when it announced that it has been racking cards of programmable chips together with servers in its cloud data centers.
The chips, called field-programmable gate arrays (FPGAs), can be reconfigured after being deployed to optimize them for particular applications such as networking and machine learning.
Now, Microsoft is investing in tools that would allow customers to program the FPGAs, said Scott Guthrie, the executive vice president in charge of Microsoft’s cloud and enterprise division, during a talk at the Structure conference in San Francisco.
Using those tools could help increase performance of workloads that the chips are deployed to tackle. Guthrie said he hopes businesses will see performance improvements between two or three orders of magnitude using FPGAs compared to CPUs or GPUs.
There are issues with just giving people raw access to the FPGAs, though.
“When something goes wrong, you really need to be able to debug that quickly,” Guthrie said.”Because it’s hardware, it could brick the machine, there are lots of things that we’ve had to learn how to protect against.”
That said, there’s an advantage to be gained from using FPGAs for business applications.
Right now, the FPGAs are being used to power Azure’s Accelerated Networking feature, as well as Microsoft products like Bing. They have the ability to radically speed up some computation.
Doug Burger, a Microsoft researcher who helped spearhead the FPGA project, said that the company’s entire deployment could be used to translate all of English-language Wikipedia in a tenth of a second.
Actually writing code for the FPGAs is something that would likely appeal to a small subset of businesses. But for those companies that want access, Microsoft’s cloud platform could become a more interesting choice.