Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
OpenCL, or Open Computing Language, is a free and open standard designed for parallel programming across various platforms, enabling developers to enhance computation tasks by utilizing a variety of processors like CPUs, GPUs, DSPs, and FPGAs on supercomputers, cloud infrastructures, personal computers, mobile gadgets, and embedded systems. It establishes a programming framework that comprises a C-like language for crafting compute kernels alongside a runtime API that facilitates device control, memory management, and execution of parallel code, thereby providing a portable and efficient means to access heterogeneous hardware resources. By enabling the delegation of compute-heavy tasks to specialized processors, OpenCL significantly accelerates performance and responsiveness across numerous applications, such as creative software, scientific research tools, medical applications, vision processing, and the training and inference of neural networks. This versatility makes it an invaluable asset in the evolving landscape of computing technology.
Description
PanGu-α has been created using the MindSpore framework and utilizes a powerful setup of 2048 Ascend 910 AI processors for its training. The training process employs an advanced parallelism strategy that leverages MindSpore Auto-parallel, which integrates five different parallelism dimensions—data parallelism, operation-level model parallelism, pipeline model parallelism, optimizer model parallelism, and rematerialization—to effectively distribute tasks across the 2048 processors. To improve the model's generalization, we gathered 1.1TB of high-quality Chinese language data from diverse fields for pretraining. We conduct extensive tests on PanGu-α's generation capabilities across multiple situations, such as text summarization, question answering, and dialogue generation. Additionally, we examine how varying model scales influence few-shot performance across a wide array of Chinese NLP tasks. The results from our experiments highlight the exceptional performance of PanGu-α, demonstrating its strengths in handling numerous tasks even in few-shot or zero-shot contexts, thus showcasing its versatility and robustness. This comprehensive evaluation reinforces the potential applications of PanGu-α in real-world scenarios.
API Access
Has API
No
API Access
Has API
No
Screenshots View All
No images available
Integrations
C
No
C++
No
GitHub
No
Google
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
The Khronos Group
Founded
2000
Country
United States
Website
www.khronos.org
Vendor Details
Company Name
Huawei
Founded
1987
Country
China
Website
arxiv.org/abs/2104.12369