Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
MonoQwen2-VL-v0.1 represents the inaugural visual document reranker aimed at improving the quality of visual documents retrieved within Retrieval-Augmented Generation (RAG) systems. Conventional RAG methodologies typically involve transforming documents into text through Optical Character Recognition (OCR), a process that can be labor-intensive and often leads to the omission of critical information, particularly for non-text elements such as graphs and tables. To combat these challenges, MonoQwen2-VL-v0.1 utilizes Visual Language Models (VLMs) that can directly interpret images, thus bypassing the need for OCR and maintaining the fidelity of visual information. The reranking process unfolds in two stages: it first employs distinct encoding to create a selection of potential documents, and subsequently applies a cross-encoding model to reorder these options based on their relevance to the given query. By implementing Low-Rank Adaptation (LoRA) atop the Qwen2-VL-2B-Instruct model, MonoQwen2-VL-v0.1 not only achieves impressive results but does so while keeping memory usage to a minimum. This innovative approach signifies a substantial advancement in the handling of visual data within RAG frameworks, paving the way for more effective information retrieval strategies.
Description
Qwen-7B is the 7-billion parameter iteration of Alibaba Cloud's Qwen language model series, also known as Tongyi Qianwen. This large language model utilizes a Transformer architecture and has been pretrained on an extensive dataset comprising web texts, books, code, and more. Furthermore, we introduced Qwen-7B-Chat, an AI assistant that builds upon the pretrained Qwen-7B model and incorporates advanced alignment techniques. The Qwen-7B series boasts several notable features:
It has been trained on a premium dataset, with over 2.2 trillion tokens sourced from a self-assembled collection of high-quality texts and codes across various domains, encompassing both general and specialized knowledge. Additionally, our model demonstrates exceptional performance, surpassing competitors of similar size on numerous benchmark datasets that assess capabilities in natural language understanding, mathematics, and coding tasks. This positions Qwen-7B as a leading choice in the realm of AI language models. Overall, its sophisticated training and robust design contribute to its impressive versatility and effectiveness.
API Access
Has API
No
API Access
Has API
Yes
Integrations
Alibaba Cloud
No
C++
No
CSS
No
Clojure
No
Elixir
No
F#
No
GaiaNet
No
Go
No
HTML
No
Horay.ai
No
Integrations
Alibaba Cloud
Yes
C++
Yes
CSS
Yes
Clojure
Yes
Elixir
Yes
F#
Yes
GaiaNet
Yes
Go
Yes
HTML
Yes
Horay.ai
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
Free
Open source
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
LightOn
Founded
2016
Country
France
Website
www.lighton.ai/lighton-blogs/monoqwen-vision
Vendor Details
Company Name
Alibaba
Founded
1999
Country
China
Website
github.com/QwenLM/Qwen-7B