Hello Learners…
Welcome to the blog…
Table Of Contents
- Introduction
- GPT-4o mini: Introducing Most Cost-Efficient Small Model By OpenAI
- Reasoning Tasks:
- Math And Coding Proficiency:
- Multimodel Reasoning:
- Availability Of GPT-4o mini:
- GPT-4o mini Pricing
- Summary
- References
Introduction
In this post, we discuss about GPT-4o mini: Introducing Most Cost-Efficient Small Model By OpenAI just got released.
GPT-4o mini: Introducing Most Cost-Efficient Small Model By OpenAI
GPT-4o mini has been evaluated across several key benchmarks2.
GPT-4o mini is our most cost-efficient small model that’s smarter and cheaper than GPT-3.5 Turbo, and has vision capabilities. The model has 128K context and an October 2023 knowledge cutoff.
Reasoning Tasks:
GPT-4o mini is better than other small models at reasoning tasks involving both text and vision, scoring 82.0% on MMLU, a textual intelligence and reasoning benchmark, as compared to 77.9% for Gemini Flash and 73.8% for Claude Haiku
Math And Coding Proficiency:
GPT-4o mini excels in mathematical reasoning and coding tasks, outperforming previous small models on the market. On MGSM, measuring math reasoning, GPT-4o mini scored 87.0%, compared to 75.5% for Gemini Flash and 71.7% for Claude Haiku. GPT-4o mini scored 87.2% on HumanEval, which measures coding performance, compared to 71.5% for Gemini Flash and 75.9% for Claude Haiku.
Multimodel Reasoning:
GPT-4o mini also shows strong performance on MMMU, a multimodal reasoning eval, scoring 59.4% compared to 56.1% for Gemini Flash and 50.2% for Claude Haiku.
Availability Of GPT-4o mini:
GPT-4o mini is now available as a text and vision model in the Assistants API, Chat Completions API, and Batch API.
Pricing Of GPT-4o mini:
Developers pay 15 cents per 1M input tokens and 60 cents per 1M output tokens (roughly the equivalent of 2500 pages in a standard book).
gpt-4o-mini model pricing:
- US$0.150 / 1M input tokens
- US$0.600 / 1M output tokens
They plan to roll out fine-tuning for GPT-4o mini in the coming days.
In ChatGPT, Free, Plus and Team users will be able to access GPT-4o mini starting today, in place of GPT-3.5. Enterprise users will also have access starting next week, in line with their mission to make the benefits of AI accessible to all.