Training of ONE TRILLION Parameter

A US national lab has started training a massive AI brain that could ultimately become the must-have computing resource for scientific researchers.  Argonne National Laboratory (ANL) is creating a generative AI model called AuroraGPT and is pouring a giant mass of scientific information into creating the brain.  The model is being trained on its Aurora supercomputer, which delivers more than an half an exaflop performance at ANL. The system has Intel’s Ponte Vecchio GPUs, which provide the main computing power.

Intel and ANL are partnering with other labs in the US and worldwide to make scientific AI a reality.  “It combines all the text, codes, specific scientific results, papers, into the model that science can use to speed up research,” said Ogi Brkic, vice president and general manager for data center and HPC solutions, in a press briefing.  READ MORE...