Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

The latest Amazon EC2 Trn3 UltraServers represent AWS's state-of-the-art accelerated computing instances, featuring proprietary Trainium3 AI chips designed specifically for optimal performance in deep-learning training and inference tasks. These UltraServers come in two variants: the "Gen1," which is equipped with 64 Trainium3 chips, and the "Gen2," offering up to 144 Trainium3 chips per server. The Gen2 variant boasts an impressive capability of delivering 362 petaFLOPS of dense MXFP8 compute, along with 20 TB of HBM memory and an astonishing 706 TB/s of total memory bandwidth, positioning it among the most powerful AI computing platforms available. To facilitate seamless interconnectivity, a cutting-edge "NeuronSwitch-v1" fabric is employed, enabling all-to-all communication patterns that are crucial for large model training, mixture-of-experts frameworks, and extensive distributed training setups. This technological advancement in the architecture underscores AWS's commitment to pushing the boundaries of AI performance and efficiency.

Description

Tinker is an innovative training API tailored for researchers and developers, providing comprehensive control over model fine-tuning while simplifying the complexities of infrastructure management. It offers essential primitives that empower users to create bespoke training loops, supervision techniques, and reinforcement learning workflows. Currently, it facilitates LoRA fine-tuning on open-weight models from both the LLama and Qwen families, accommodating a range of model sizes from smaller variants to extensive mixture-of-experts configurations. Users can write Python scripts to manage data, loss functions, and algorithmic processes, while Tinker autonomously takes care of scheduling, resource distribution, distributed training, and recovery from failures. The platform allows users to download model weights at various checkpoints without the burden of managing the computational environment. Delivered as a managed service, Tinker executes training jobs on Thinking Machines’ proprietary GPU infrastructure, alleviating users from the challenges of cluster orchestration and enabling them to focus on building and optimizing their models. This seamless integration of capabilities makes Tinker a vital tool for advancing machine learning research and development.

API Access

Has API No 

API Access

Has API Yes 

Screenshots View All

Screenshots View All

Integrations

AWS Batch Yes 
AWS Inferentia Yes 
AWS ParallelCluster Yes 
AWS Trainium Yes 
Amazon EKS Yes 
Amazon Elastic Container Service (Amazon ECS) Yes 
Amazon SageMaker Yes 
Amazon SageMaker HyperPod Yes 
Amazon Web Services (AWS) Yes 
Hugging Face Yes 
Inkling No 
Inkling-Small No 
JAX Yes 
Llama 3 No 
Llama 3.2 No 
Llama 3.3 No 
PyTorch Yes 
Python No 
Qwen No 
Qwen3 No 

Integrations

AWS Batch No 
AWS Inferentia No 
AWS ParallelCluster No 
AWS Trainium No 
Amazon EKS No 
Amazon Elastic Container Service (Amazon ECS) No 
Amazon SageMaker No 
Amazon SageMaker HyperPod No 
Amazon Web Services (AWS) No 
Hugging Face No 
Inkling Yes 
Inkling-Small Yes 
JAX No 
Llama 3 Yes 
Llama 3.2 Yes 
Llama 3.3 Yes 
PyTorch No 
Python Yes 
Qwen Yes 
Qwen3 Yes 

Pricing Details

No price information available.
Free Trial No 
Free Version No 

Pricing Details

No price information available.
Free Trial No 
Free Version Yes 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Deployment

Web-Based Yes 
On-Premises No 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Customer Support

Business Hours Yes 
Live Rep (24/7) No 
Online Support Yes 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Types of Training

Training Docs Yes 
Webinars Yes 
Live Training (Online) Yes 
In Person No 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Vendor Details

Company Name

Amazon

Founded

1994

Country

United States

Website

aws.amazon.com/ec2/instance-types/trn3/

Vendor Details

Company Name

Thinking Machines Lab

Country

United States

Website

thinkingmachines.ai/tinker/

Product Features

Deep Learning

Convolutional Neural Networks No 
Document Classification No 
Image Segmentation No 
ML Algorithm Library No 
Model Training No 
Neural Network Modeling No 
Self-Learning No 
Visualization No 

Machine Learning

Deep Learning No 
ML Algorithm Library No 
Model Training No 
Natural Language Processing (NLP) No 
Predictive Modeling No 
Statistical / Mathematical Tools No 
Templates No 
Visualization No 

Alternatives

Alternatives

Inkling Reviews

Inkling

Thinking Machines Lab
AWS Neuron Reviews

AWS Neuron

Amazon Web Services