Install Dependencies

  • Create a conda environment and install PyTorch:

    conda create -n ITRA python=3.10.0
    conda activate ITRA
    

    This repo requires PyTorch (1.12) and torchvision (0.13). Please install them via pytorch official website.

    conda install pytorch==1.12.0 torchvision==0.13.0 torchaudio==0.12.0 cudatoolkit=10.2 -c pytorch
    
  • Clone this repo:

    # TODO: update repo name
    git clone https://github.com/ChenDelong1999/ITRA
    cd ITRA
    export PYTHONPATH="$PYTHONPATH:$PWD/itra"
    

    Note: If import error is occurred later, run export PYTHONPATH="$PYTHONPATH:$PWD/itra" again.

  • Install additional dependencies:

    conda install pillow pandas scikit-learn ftfy tqdm matplotlib 
    conda install -c huggingface transformers 
    conda install -c conda-forge sentence-transformers
    pip install adapter-transformers open_clip_torch pycocotools wandb timm clip-benchmark pyyaml
    
    # TODO: faiss-gpu does not support windows OS, maybe use pip install faiss instead?
    pip install faiss-gpu
    
    # ELEVATOR requirements  
    pip install yacs git+https://github.com/haotian-liu/CLIP_vlp.git vision-evaluation
    
    # TODO: remove nori dependency
    pip install nori2