Private AI's container offering is now available on the AWS Marketplace. This guide is to help you subscribe to and run the Private AI Container on your AWS account.
Only English CPU models are available in self-serve. Customers need to contact Private AI for access to the multilinual and GPU images.
Click "Continue to Subscribe"
Once you're subscribed to the Private AI AWS Marketplace offering, you should be able to view it under your AWS Marketplace subscriptions.
Click 'Launch more software'
Choose the fulfillment option "ECS or EKS Deployment" and select the latest software version. When ready, click "Continue to Launch"
You also have the option to select a Helm chart to deploy into a quickstart EKS cluster:
Once you arrive on the "Launch Software" page, copy the Container Images command to download the container on an AWS CLI enabled terminal.
The container can now be run on either EKS or ECS. Whilst we support both to fit best into your existing cloud setup, the EKS option with Helm install is quicker to get running.
The AWS Marketplace Private AI container includes a pre-packaged license in the container. For any steps in the following ECS / EKS guides, note that you can disregard the steps that reference the
Note on requirements:
In order to run the Helm chart for the Private AI container, please ensure your EKS pods are running with IAM Roles for Service Accounts (IRSA) enabled.
You will also want to ensure your service account assumes an IAM role with the appropriate policies (if you are not using the account defined in the helm chart) and that the service account is the one configured to run the EKS pod(s).
If you would like to launch the helm chart in your own cluster, simply follow these steps with "Launch on existing cluster" selected:
If you would like to leverage the Quicklaunch cluster using AWS Cloudformation, select "Launch on a new EKS cluster with Quicklaunch":
Your EKS cluster, node groups and various roles will be created ready for you to use the container.
Follow the steps in the AWS Automated ECS Deployment Guide to continue the deployment.
- "The AWS Marketplace container says the license is invalid! what's wrong?"
If you encounter the error message while trying to start up the AWS marketplace container, please ensure that you have subscribed to the product in the marketplace under your logged in AWS account and that you are running the container on either ECS or EKS as they are the only platforms supported through the marketplace.
If you are running on ECS, please verify that you have followed the steps outlined in our AWS Automated ECS Deployment Guide as it is likely a role permission related issue.
- "My container in ECS starts up and then hangs at 'License Validated'. What's happening?"
This is an issue caused by improper permissions in your IAM roles for your ECS setup. Please verify that you have followed the steps outlined in our AWS Automated ECS Deployment Guide.
If you continue to have issues, please reach out to us at firstname.lastname@example.org