Quickstart
This quickstart covers:
- Downloading & running an LLM on your machine
- Downloading & intializing the node client
- CLI commands to use the client
Prerequisites
- Please see the requirements
Run the GPU node (CLI)
Sign up
- Create an account here
- Create an API key on the dashboard
- Create a node on the dashboard
Create a virtual environment
For example, using venv
Install galadriel
Setup the environment
Make sure to set the correct API key and node-id that you created on the dashboard.
Other values should be the default ones.
Run the node
Or run the node in a background process
If this is your first time running the GPU node, it will perform hardware validation and LLM benchmarking, to ensure your setup is working correctly and is fast enough.
Check node status
In another terminal tab:
If the status is online you’ve successfully started your GPU node and it’s serving LLM inference requests to the network.
Checking node stats
Available if the GPU node is initialized and its status is online.
Checking network stats
Available if the GPU node is initialized and its status is online.