Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Pre-trained language models have made significant strides, achieving top-tier performance across multiple Natural Language Processing (NLP) applications. The impressive capabilities of GPT-3 highlight how increasing the scale of these models can unlock their vast potential. Recently, a comprehensive framework known as ERNIE 3.0 was introduced to pre-train large-scale models enriched with knowledge, culminating in a model boasting 10 billion parameters. This iteration of ERNIE 3.0 has surpassed the performance of existing leading models in a variety of NLP tasks. To further assess the effects of scaling, we have developed an even larger model called ERNIE 3.0 Titan, which consists of up to 260 billion parameters and is built on the PaddlePaddle platform. Additionally, we have implemented a self-supervised adversarial loss alongside a controllable language modeling loss, enabling ERNIE 3.0 Titan to produce texts that are both reliable and modifiable, thus pushing the boundaries of what these models can achieve. This approach not only enhances the model's capabilities but also opens new avenues for research in text generation and control.
Description
PaddlePaddle, built on years of research and practical applications in deep learning by Baidu, combines a core framework, a fundamental model library, an end-to-end development kit, tool components, and a service platform into a robust offering. Officially released as open-source in 2016, it stands out as a well-rounded deep learning platform known for its advanced technology and extensive features. The platform, which has evolved from real-world industrial applications, remains dedicated to fostering close ties with various sectors. Currently, PaddlePaddle is utilized across multiple fields, including industry, agriculture, and services, supporting 3.2 million developers and collaborating with partners to facilitate AI integration in an increasing number of industries. This widespread adoption underscores its significance in driving innovation and efficiency across diverse applications.
API Access
Has API
No
API Access
Has API
No
Integrations
Cirrascale
No
ERNIE Bot
Yes
Graphcore
No
OpenVINO
No
Rosepetal AI
No
Integrations
Cirrascale
Yes
ERNIE Bot
No
Graphcore
Yes
OpenVINO
Yes
Rosepetal AI
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
No
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Baidu
Founded
2000
Country
China
Website
research.baidu.com/Public/uploads/61c4362c79ee8.pdf
Vendor Details
Company Name
PaddlePaddle
Website
www.paddlepaddle.org.cn/
Product Features
Product Features
Deep Learning
Convolutional Neural Networks
Yes
Document Classification
Yes
Image Segmentation
No
ML Algorithm Library
No
Model Training
No
Neural Network Modeling
No
Self-Learning
No
Visualization
No