GPT-2: 6-month follow-up
OpenAI Blog
OpenAI released the 774 million parameter version of GPT-2, completing a staged rollout that began with a 124 million parameter model in February. The company accompanied the release with an open-source legal agreement to facilitate model-sharing partnerships between organizations. The staggered approach reflected OpenAI's process of coordinating with the AI research community on responsible publication practices and monitoring for potential misuse.
Why it matters
We’re releasing the 774 million parameter GPT-2 language model after the release of our small 124M model in February, staged release of our medium 355M model in May, and subsequent research with partners and the AI community into the model’s potential for misuse and societal benefit. We’re also releasing an open-source legal agreement to make it easier for organizations to initiate model-sharing partnerships with each other, and are publishing a technical report about our experience in coordinating with the wider AI research community on publication norms.
