Search…
Connectors (beta)
Local Execution
This walkthrough will teach you how to set up your environment so you can use the Gretel Console and CLI to create and run Gretel Models.
We highly recommend using Ubuntu 18.04 for creating your own local environment.
If you need to run Gretel Workers in your own environment, you must install Docker on your host(s). By default, Gretel Workers will be provisioned and run in Gretel Cloud.
The two commands are:
1
curl -fsSL https://get.docker.com -o get-docker.sh
2
sh get-docker.sh
Copied!
After Docker is installed, you should be able to access it via this command:
sudo dockerNext, enable Docker in privileged mode:
1
sudo groupadd docker
2
sudo usermod -aG docker $USER
Copied!
From here you may need to restart your shell session and now you should be able to access docker via this command:
docker psGPU + Docker Configuration (Synthetic Workers Only)
If you will be running synthetic workers in your own environment, we highly encourage you to configure a system with a GPU. Additionally, Docker and the Docker NVIDIA toolkit will need to be installed.
We have created a script that will configure an Ubuntu 18.04 machine with NVIDIA GPUs to work properly with Gretel’s CLI. Provided you have created a VM or setup a machine with Ubuntu and a GPU you can run:
1
curl https://raw.githubusercontent.com/gretelai/gretel-blueprints/main/utils/gpu_docker_setup.sh | bash
Copied!
When this script completes you should see output similar to the following:
1
+-----------------------------------------------------------------------------+
2
| NVIDIA-SMI 465.19.01 Driver Version: 465.19.01 CUDA Version: 11.3 |
3
|-------------------------------+----------------------+----------------------+
4
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
5
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
6
| | | MIG M. |
7
|===============================+======================+======================|
8
| 0 NVIDIA Tesla T4 On | 00000000:00:04.0 Off | 0 |
9
| N/A 59C P0 28W / 70W | 0MiB / 15109MiB | 6% Default |
10
| | | N/A |
11
+-------------------------------+----------------------+----------------------+
12
13
+-----------------------------------------------------------------------------+
14
| Processes: |
15
| GPU GI CI PID Type Process name GPU Memory |
16
| ID ID Usage |
17
|=============================================================================|
18
| No running processes found |
19
+-----------------------------------------------------------------------------+
Copied!
Finally, you will need to configure Docker to allow your current user to run commands, this can be done by running:
1
sudo groupadd docker
2
sudo usermod -aG docker $USER
Copied!
Now log out and back in.
At this point, your machine is now configured to launch Gretel Workers with GPU support.
Last modified 3d ago
Copy link