GPT-Neo

GPT-Neo is a transformer-based language model inspired by the GPT architecture. It is an implementation of the GPT2 and GPT3 models, allowing for scaling up to GPT3 sizes using the mesh-tensorflow library. GPT-Neo was developed by EleutherAI, a company that specializes in creating open source AI models.

GPT-Neo screenshots