Step-by-Step Instructions
- System Update and Package Installation:
- Update your system to ensure all packages are up to date.
sudo apt update && sudo apt upgrade -y
sudo apt install -y git python3 python3-pip python-is-python3 git-lfs
- Clone the Repository:
git clone <https://github.com/NicheTensor/NicheImage>
cd NicheImage
- Create and activate python virtual environment:
python -m venv main_env
source main_env/bin/activate
- Install requirements:
pip install -e .
pip uninstall uvloop -y
git submodule update --init --recursive
. generation_models/custom_pipelines/scripts/download_antelopev2.sh
- Huggingface Model Repo
| Model name |
huggingface_repoid |
| Gemma7b |
google/gemma-7b-it |
- Create python virtual environment, activate it and install vLLM packages
# Create a new Python environment for vLLM:
python -m venv vllm
source vllm/bin/activate
pip install vllm==0.4.1
- Topology: Miner, Endpoint and vLLM API Server
- Start the vLLM API Server