MiniCPM-V2.6: MiniMax's Open-Sourced Multimodal Model for On-Device AI Gets an Upgrade
AD |
MiniCPM-V2.6: MiniMax's Open-Sourced Multimodal Model for On-Device AI Gets an UpgradeOn August 7th, MiniMax, an artificial intelligence company, officially open-sourced its latest on-device AI multimodal model MiniCPM-V2
MiniCPM-V2.6: MiniMax's Open-Sourced Multimodal Model for On-Device AI Gets an Upgrade
On August 7th, MiniMax, an artificial intelligence company, officially open-sourced its latest on-device AI multimodal model MiniCPM-V2.6. This model, with a mere 8 billion parameters, achieves the best performance (SOTA) among models with less than 20 billion parameters in tasks such as single-image, multi-image, and video understanding.
The launch of MiniCPM-V2.6 marks a new milestone in the evolution of on-device AI multimodal models. This model brings several breakthroughs:
I. Feature Expansion:
- Real-time Video Understanding: MiniCPM-V2.6 is the first to achieve real-time video understanding on edge devices. This means users can perceive and understand video content in real-time without relying on the cloud.
- Multi-Image Joint Understanding: The model can process multiple images simultaneously and perform joint understanding and analysis, which is significant for applications like image search and multi-image scene comprehension.
- Multi-Image ICL Visual Analogical Learning: MiniCPM-V2.6 enables cross-image analogical learning, transferring and sharing knowledge across multiple images. This equips the on-device model with stronger learning capabilities.
- Multi-Image OCR: The model possesses the ability to recognize text content in multiple images, opening new possibilities for applications like automatic text recognition and information extraction.
II. Performance Breakthrough:
- High Pixel Density: The pixel density of the MiniCPM-V2.6 model is twice that of GPT-4o, indicating it can process more information with the same memory footprint, thereby enhancing operational efficiency.
- Fast Inference Speed: The quantized model requires only 6GB of memory and achieves an inference speed of 18 tokens per second on edge devices, 33% faster than its predecessor, ensuring rapid responses on edge devices.
- Cross-Platform Support: The model supports multiple languages and inference frameworks, expanding its applicability and increasing its flexibility.
III. Upgraded OCR Capabilities:
- Enhanced OCR Performance: MiniCPM-V2.6 maintains its SOTA performance in OCR while extending it to various scenarios such as single-image, multi-image, and video understanding.
- Unified High-Definition Visual Architecture: The model utilizes a unified high-definition visual architecture to transfer and share OCR capabilities, enabling a smooth expansion from single-image to multi-image and video, significantly reducing the number of visual tokens and resource consumption.
Open Source and Accessibility:
MiniCPM-V2.6 is now open-sourced on GitHub and HuggingFace, allowing developers to freely access and utilize the model for further development and application.
The open-source release of MiniCPM-V2.6 not only invigorates the development of on-device AI multimodal models but also provides developers with more powerful and flexible tools, promoting the implementation of AI technology across diverse scenarios.
The release of this model will further fuel the advancement of on-device AI, delivering more convenient and intelligent experiences to users. As technology evolves, on-device AI will demonstrate its unique advantages in more domains, positively impacting humanity.
Disclaimer: The content of this article is sourced from the internet. The copyright of the text, images, and other materials belongs to the original author. The platform reprints the materials for the purpose of conveying more information. The content of the article is for reference and learning only, and should not be used for commercial purposes. If it infringes on your legitimate rights and interests, please contact us promptly and we will handle it as soon as possible! We respect copyright and are committed to protecting it. Thank you for sharing.(Email:[email protected])
Mobile advertising space rental |
Tag: MiniCPM-V2.6 MiniMax Open-Sourced Multimodal Model for On-Device AI Gets
Dong Mingzhu Steps Down as Chairman of Gree Xin Hui Medical, Li Gangfei Takes Over
NextApple is set to release iOS 17.6.1 update, further refining the user experience
Guess you like
-
Typhoon Live Stream, A Dangerous Game of Traffic: Streamers Risk Their Lives for Views, Platforms Emergency BanDetail
2024-09-12 07:54:28 1
-
French Legendary Photography Studio Agut Enters Chengdu Honor Flagship Store, Ushering in a New Chapter of Technology and Art FusionDetail
2024-09-11 23:06:00 1
-
A Time-Transcending Dialogue Between Technology and Art: HONOR and Studio Harcourt Join Hands to Usher in a New Era of Mobile Imaging in Kuanzhai AlleyDetail
2024-09-11 22:59:43 1
- Detail
-
Huawei MateXT Released: Triple-Folding Phone Leads the Folding Era, Starting Price of 19,999 Yuan Sparks DiscussionDetail
2024-09-11 13:49:07 1
-
In Deep Sorrow: Professor Li Guofeng, Professor of the School of Electrical Engineering, Dalian University of Technology, has Passed AwayDetail
2024-09-11 11:36:53 11
- Detail
-
Samsung SDI Sells Polarizer Film Business to China's Wuxi Hengxin Optoelectronic Materials to Enhance CompetitivenessDetail
2024-09-10 11:49:55 1
-
Douyin Introduces New Regulations for the Medical Field, Cracking Down on False Information and Fostering a Healthy Science Communication EnvironmentDetail
2024-09-09 16:38:15 1
-
IFA 2024: A Technological Feast for Chinese Companies, Leading the Global MarketDetail
2024-09-09 13:23:28 11
-
The "Rashomon" of Live Streaming: Uncovering the Truth Behind the Disappearance of a Female AnchorDetail
2024-09-08 17:09:38 1
-
Taobao and WeChat Pay Join Hands: A "Century Reconciliation" Between Internet Giants, What Does It Foreshadow?Detail
2024-09-08 09:32:55 11
-
13-Year-Old Boy Wins World Robotics Championship, Cai Guoqing and Son Make Joint Appearance Igniting DiscussionDetail
2024-09-07 19:57:01 11
- Detail
-
The Global Social Platform Gold Rush: Rise of the Chinese Four, Who Will Reign Supreme?Detail
2024-09-07 14:17:52 1
-
"Transitional Labor": Deciphering the Real-Life Stories of Food Delivery RidersDetail
2024-09-07 14:12:52 1
-
New Delhi Indira Gandhi International Airport VS Beijing Capital International Airport: Who is the Leader of the Asian Aviation Hub?Detail
2024-09-07 13:57:51 1
- Detail
-
Century Hengtong: Empowering Smart City Traffic Construction through "Technology + Scenarios" InnovationDetail
2024-09-06 17:15:15 1
- Detail