Recently, Cohere, a leading AI technology provider, announced the release of its updated Application Programming Interface (API) version, encompassing multiple models including Chat, Embed, Rerank, and Classify. This update, branded as API V2, is designed to better align with industry standards and provide developers with a seamless migration path to adopt Cohere's models in place of competitors such as OpenAI, Anthropic, Google, Mistral, and Meta.
According to a survey by AI API platform Kong, which polled 800 business leaders, OpenAI’s ChatGPT holds a dominant 27% market share, while Cohere trails with a 5% share. This highlights the significant challenges Cohere faces in attracting enterprise users.
Key Updates in API V2 Include:
- Explicit Model Versioning: API V2 requires developers to specify the model version when making calls, preventing inconsistent behaviors due to default model changes, especially critical for Embed model applications where results are sensitive.
- Chat API Enhancements: The Chat API has been refined by consolidating input parameters into a single array, simplifying the input process, and supporting more complex conversational scenarios, such as specifying message roles.
- Improved Tool Integration and Stream Support: API V2 utilizes JSON Schema for tool definitions, enhancing flexibility and broadening application compatibility. Each tool call now includes a unique ID to ensure accurate result matching. For streaming interactions, the Chat API has transitioned to using Server Sent Events (SSE), improving user experience stability and response times.
- Legacy API Support: Cohere will continue to support the V1 API and its SDK, ensuring that developers not ready to migrate can still use existing implementations. However, the company recommends upgrading to V2 to benefit from enhanced stability and new features.
- Developer Resources: Cohere has released new SDKs and OpenAPI specifications for API V2 and provided migration guides for the Chat API to facilitate a smooth transition. Additionally, developers are encouraged to offer feedback and suggestions through the Discord community.
The launch of API V2 signifies a major advancement for Cohere in improving platform usability and efficiency. By enhancing alignment with industry standards, Cohere aims to attract more developers and secure a larger share of the competitive AI market.
