Daily Trivia - Nvidia & High Speed Network

Daily Trivia - Nvidia & High Speed Network

When Microsoft invest in OpenAI 4 years ago, one company did the same crazy investment on the AI future too.

Nvidia announced that it will acquire Mellanox Technologies for $6.9bn back in March 2019.

Mellanox is a supplier of end-to-end InfiniBand and Ethernet interconnect solutions and services for servers and storage.

Training a large AI model requires a large pool of connected graphics processing units in one place. But all these processors - hundreds of thousands of them - are scattered geographically across more than 60 of the company’s data centers. Microsoft is now adding the latest Nvidia graphics chips - the H100 - and Nvidia’s latest version of Infiniband networking technology for AI workloads to share data faster.

And the Gigabit internet/Wifi that we use for our day to day life is simply not fast enough. Mellanox create the new technology call InifiniBand (IB) and it is the common interconnect standard for HPC because it can easily reach 40-400 Gbps (Our gigabit ethernet is on 1 Gbps)

With how fast OpenAI roll up these day, we going to see a influx of new technology coming to public very quickly. This is a exciting time to live in right now :D