StarCoder 2: An Open Source Code Generator with Improved Performance and Ethical Approach
In the fast-paced world of software development, developers are constantly seeking tools and technologies that can help them streamline their coding tasks. One such tool that has gained significant popularity in recent years is code generators. These AI-powered services can suggest ways to complete unfinished lines of code and retrieve snippets of code when asked in natural language. However, many of these tools come with limitations, such as high costs or restrictive licenses.
Recognizing the need for alternatives, AI startup Hugging Face joined forces with workflow automation platform ServiceNow a few years ago to create StarCoder, an open source code generator with a less restrictive license. The original StarCoder was released last year, and since then, work has been underway on its successor, StarCoder 2.
StarCoder 2 is not just a single code-generating model but rather a family of models. It was released today in three variants, each trained by different organizations. The models range from a 3-billion-parameter model trained by ServiceNow to a 15-billion-parameter model trained by Nvidia, the newest supporter of the StarCoder project.
Compared to its predecessor, StarCoder 2 offers significantly improved performance at lower operating costs. It has been trained with four times more data and can make more accurate, context-aware predictions. This makes it a valuable tool for developers who need to build applications quickly without sacrificing speed or quality.
However, not all developers are convinced of the benefits of code generators. A recent Stanford study found that engineers who use code-generating systems are more likely to introduce security vulnerabilities in their apps. Additionally, concerns have been raised about the lack of insight into how code from code generators is produced and the potential for generating excessive amounts of code.
Another potential roadblock for some developers is the license under which StarCoder 2 operates. It is licensed under the BigCode Open RAIL-M 1.0, which imposes “light touch” restrictions on both model licensees and downstream users. While less constraining than many other licenses, some argue that the requirements of this license may be too vague to comply with and could conflict with AI-related regulations.
Despite these concerns, StarCoder 2 offers several advantages over other code generators. It can be deployed locally, allowing developers to maintain privacy and security by keeping their code within their own environment. It was also trained on data under license from the Software Heritage, ensuring that it does not recommend copyrighted code without proper labeling.
Transparency and accountability are key principles behind StarCoder 2. The training data used for the models is available for developers to fork, reproduce, or audit as they please. This level of transparency sets StarCoder 2 apart from other code generators, which often lack information about their training data and processes.
While StarCoder 2 is not without its flaws, such as susceptibility to bias and weaker performance in certain languages, it represents a step in the right direction. It showcases how fully open models can deliver competitive performance while addressing concerns about privacy, security, and copyright infringement.
For Hugging Face, ServiceNow, and Nvidia, investing in a project like StarCoder 2 is a strategic move. By releasing an open source code generator, they foster goodwill within the developer community and build paid services on top of the open source releases. ServiceNow has already used StarCoder to create Now LLM, a product tailored for its workflow patterns. Hugging Face and Nvidia offer hosted versions of the StarCoder 2 models on their platforms.
For developers interested in the no-cost offline experience, StarCoder 2 can be downloaded from the project’s GitHub page. It provides a powerful tool for efficient coding without compromising speed or quality. As the demand for code generators continues to grow, StarCoder 2 offers an ethical and high-performing solution for developers worldwide.