For nodes
Quickstart
This quickstart covers:
- Downloading & running an LLM on your machine
- Downloading & intializing the node client
- CLI commands to use the client
Prerequisites
- Please see the requirements
Run the GPU node (CLI)
1
Sign up
- Create an account here
- Create an API key on the dashboard
- Create a node on the dashboard
2
Create a virtual environment
For example, using venv
python3 -m venv venv
source venv/bin/activate
3
Install galadriel
pip install galadriel-node
4
Setup the environment
Make sure to set the correct API key and node-id that you created on the dashboard.
Other values should be the default ones.
galadriel init
5
Run the node
galadriel node run
If this is your first time running the GPU node, it will perform hardware validation and LLM benchmarking, to ensure your setup is working correctly and is fast enough.
6
Check node status
In another terminal tab:
galadriel node status
If the status is online you’ve successfully started your GPU node and it’s serving LLM inference requests to the network.
Checking node stats
Available if the GPU node is initialized and its status is online.
galadriel node stats
Checking network stats
Available if the GPU node is initialized and its status is online.
galadriel network stats