Skip to main content
The CPU container can be run with the following command:
Docker Command
The command to run the GPU container requires an additional --gpus flag to specify the GPU ID to use. The full GPU container also requires 4GB shared memory, which is set via the --shm-size flag. For the text-only GPU container the shared memory flag is not necessary:
Docker Command
It is recommended to deploy the container on single GPU machines. For multi-GPU machines, please launch a container instance for each GPU and specify the GPU_ID accordingly. You can get the GPU_ID using the nvidia-smi command if you have access to runner. You can find more information regarding using GPUs with docker here. For private or public cloud deployment, please see Deployment and the Kubernetes Setup Guide.
crprivateaiprod.azurecr.io is intended for image distribution only. For production use, it is strongly recommended to set up a container registry inside your own compute environment to host the image.

​
Enhanced Synthetic Container

(new in 4.5) The gpu-synthetic-enhanced image, which includes the enhanced synthetic entity generation system, is deployed exactly like the gpu-synthetic image. It uses the same --gpus and --shm-size flags, and only the image tag differs:
Docker Command
There are, however, three deployment considerations specific to this image:
  • It requires significantly more GPU VRAM than the other GPU flavours. Because of this, we recommend restricting gpu-synthetic-enhanced deployments to instances offering at least 24GB of VRAM on a single GPU. On AWS, we recommend g5.4xlarge (single Nvidia A10G GPU, 24GB VRAM) from the g5 family, or g6e.4xlarge (single Nvidia L40S GPU, 48GB VRAM) from the newer g6e family. On other cloud providers or in a private cloud, choose an equivalent instance or node with a single GPU offering at least 24GB of VRAM.
  • It takes longer to become healthy and start accepting requests than the other images. Allow for a longer startup time before the container is considered unhealthy — if you are deploying on Kubernetes, use the GPU Synthetic Enhanced Configuration manifest in the Kubernetes Setup Guide, which raises the initialDelaySeconds of the readiness and liveness probes accordingly.
  • Multi-GPU setups have not been tested with this image, and it may not be able to take advantage of more than one GPU. Do not rely on combining several smaller GPUs to reach the recommended VRAM; for example, two 16GB GPUs are not a substitute for a single 32GB GPU.

​
Apple Silicon

It is possible to run the Limina container on Apple Silicon-based Macs, such as the M1 Macbook Pro, even though it is not officially supported. To do this, please make sure you use Docker Desktop 4.25 or later and enable Rosetta2 support. During our testing we didn’t encounter issues with M1 Macs but did encounter some container startup issues on M2 Macs. If this occurs, please try disabling Rosetta2 support. Due to the need to emulate x86 instructions, performance is significantly lower than x86-based machines, let alone GPU-equipped machines. On a M1 Macbook Pro, our tests revealed a throughput of approximately 250 words per second.

​
Authentication and External Communications

The container makes external communications to Limina’s servers for authentication and usage reporting. To this end, please make sure that the following are reachable:
  • https://verify1.getlimina.ai:443/license-verification/license_status
  • https://verify2.getlimina.ai:443/license-verification/license_status
  • https://app.amberflo.io:443/ingest/
These communications do not contain any customer data - if training data is required, this must be given to Limina separately. Please see the FAQ for more details on what is sent. An authentication call is made upon the first API call after the Docker image is started, and again at pre-defined intervals based on your subscription.

​
URI-Based File Support

Running the container with the above commands allows for base64-encoded files to be processed with /process/files/base64. However, to utilize the /process/files/uri route, a volume where input files are stored and PAI_OUTPUT_FILE_DIR must be provided. Note that PAI_OUTPUT_FILE_DIR must reside inside the mounted volume.
Docker Command
For example, if your license file is in your home directory, the input directory you wish to mount is called inputfiles and the output directory is output:
Docker Command