Alpa

Alpa is a powerful, open-source platform that helps to train and deploy large-scale neural networks like GPT-3 in a simplified, cost-effective manner. It was created by researchers from Sky Lab, UC Berkeley and some of the advanced techniques employed by Alpa have been discussed in a paper published in OSDI 2022. The Alpa community is growing with contributions from tech giants such as Google, Amazon, AnyScale, and others.