Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
This repository showcases an implementation of model parallel autoregressive transformers utilizing GPUs, leveraging the capabilities of the DeepSpeed library. It serves as a record of EleutherAI's framework designed for training extensive language models on GPU architecture. Currently, it builds upon NVIDIA's Megatron Language Model, enhanced with advanced techniques from DeepSpeed alongside innovative optimizations. Our goal is to create a centralized hub for aggregating methodologies related to the training of large-scale autoregressive language models, thereby fostering accelerated research and development in the field of large-scale training. We believe that by providing these resources, we can significantly contribute to the progress of language model research.
Description
SafeCloud Technologies specializes in consulting services centered around data privacy, distributed architectures, and extensive infrastructures. Our mission is to tackle specific challenges by delivering expert guidance alongside practical assistance. Our team possesses in-depth knowledge across various platforms and programming languages, catering to needs from robust server systems to mobile applications. We provide focused consulting on distributed systems, large-scale infrastructure, and storage solutions. With a diverse range of programming expertise, we offer personalized development support to address any complex issue you encounter. Central to every system we create or assist in developing is a commitment to a privacy-by-design philosophy. Our work ensures that your processes are both private and compliant with GDPR regulations, empowering you to prioritize data protection seamlessly. By choosing us, you not only enhance your infrastructure but also reinforce your commitment to safeguarding user information.
API Access
Has API
No
API Access
Has API
No
Integrations
Forefront
No
ZBrain
No
Pricing Details
Free
Open source
Free Trial
No
Free Version
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
No
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
EleutherAI
Founded
2020
Website
github.com/EleutherAI/gpt-neox
Vendor Details
Company Name
SafeCloud Technologies
Founded
2017
Country
Portugal
Website
safecloudtech.com
Product Features
Product Features
Cloud Storage
Access Control
No
Archiving & Retention
No
Backup
No
Data Migration
No
Data Synchronization
No
Encryption
No
File Sharing
No
Version Control
No