Step-by-Step Instructions

1. System Update and Package Installation:
   • Update your system to ensure all packages are up to date.

sudo apt update && sudo apt upgrade -y
sudo apt install -y git python3 python3-pip python-is-python3 git-lfs

1. Clone the Repository:

git clone <https://github.com/NicheTensor/NicheImage>
cd NicheImage

1. Create and activate python virtual environment:

python -m venv main_env
source main_env/bin/activate

1. Install requirements:

pip install -e .
pip uninstall uvloop -y
git submodule update --init --recursive
. generation_models/custom_pipelines/scripts/download_antelopev2.sh

1. Huggingface Model Repo

1. Create python virtual environment, activate it and install vLLM packages

# Create a new Python environment for vLLM:
python -m venv vllm
source vllm/bin/activate
pip install vllm==0.4.1

1. Topology: Miner, Endpoint and vLLM API Server

1. Start the vLLM API Server