Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
CodeQwen serves as the coding counterpart to Qwen, which is a series of large language models created by the Qwen team at Alibaba Cloud. Built on a transformer architecture that functions solely as a decoder, this model has undergone extensive pre-training using a vast dataset of code. It showcases robust code generation abilities and demonstrates impressive results across various benchmarking tests. With the capacity to comprehend and generate long contexts of up to 64,000 tokens, CodeQwen accommodates 92 programming languages and excels in tasks such as text-to-SQL queries and debugging. Engaging with CodeQwen is straightforward—you can initiate a conversation with just a few lines of code utilizing transformers. The foundation of this interaction relies on constructing the tokenizer and model using pre-existing methods, employing the generate function to facilitate dialogue guided by the chat template provided by the tokenizer. In alignment with our established practices, we implement the ChatML template tailored for chat models. This model adeptly completes code snippets based on the prompts it receives, delivering responses without the need for any further formatting adjustments, thereby enhancing the user experience. The seamless integration of these elements underscores the efficiency and versatility of CodeQwen in handling diverse coding tasks.
Description
MonoQwen2-VL-v0.1 represents the inaugural visual document reranker aimed at improving the quality of visual documents retrieved within Retrieval-Augmented Generation (RAG) systems. Conventional RAG methodologies typically involve transforming documents into text through Optical Character Recognition (OCR), a process that can be labor-intensive and often leads to the omission of critical information, particularly for non-text elements such as graphs and tables. To combat these challenges, MonoQwen2-VL-v0.1 utilizes Visual Language Models (VLMs) that can directly interpret images, thus bypassing the need for OCR and maintaining the fidelity of visual information. The reranking process unfolds in two stages: it first employs distinct encoding to create a selection of potential documents, and subsequently applies a cross-encoding model to reorder these options based on their relevance to the given query. By implementing Low-Rank Adaptation (LoRA) atop the Qwen2-VL-2B-Instruct model, MonoQwen2-VL-v0.1 not only achieves impressive results but does so while keeping memory usage to a minimum. This innovative approach signifies a substantial advancement in the handling of visual data within RAG frameworks, paving the way for more effective information retrieval strategies.
API Access
Has API
Yes
API Access
Has API
No
Integrations
Alibaba Cloud
Yes
AtCoder
Yes
Code Llama
Yes
Codeforces
Yes
Conda
Yes
DeepSeek Coder
Yes
GPT-3.5
Yes
GPT-4
Yes
Hugging Face
Yes
LangChain
Yes
Integrations
Alibaba Cloud
No
AtCoder
No
Code Llama
No
Codeforces
No
Conda
No
DeepSeek Coder
No
GPT-3.5
No
GPT-4
No
Hugging Face
No
LangChain
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
No
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Vendor Details
Company Name
Alibaba
Founded
1999
Country
China
Website
github.com/QwenLM/CodeQwen1.5
Vendor Details
Company Name
LightOn
Founded
2016
Country
France
Website
www.lighton.ai/lighton-blogs/monoqwen-vision