I have been using HT Condor (through UW Madison’s CHTC) a lot. They are really amazing resources.
Conda #
I just realized we can install conda for python enviroments management.
# Download Miniconda installer
wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh
# Install Miniconda in your home directory
bash Miniconda3-latest-Linux-x86_64.sh -b -p $HOME/miniconda
# Initialize Conda
source $HOME/miniconda/bin/activate
conda init
Then we can create a new virtual environment:
conda create -n kde_ebm_env python=3.9
conda activate kde_ebm_env
conda install -c conda-forge pip setuptools wheel
pip install git+https://github.com/ucl-pond/kde_ebm
We can also use mamba within the conda system:
mamba create -n mlhc_sub python=3.9 pip pybind11 -c conda-forge
conda activate mlhc_sub
pip install git+https://github.com/ucl-pond/kde_ebm pyebm
conda install -c conda-forge conda-pack
conda-pack -n mlhc_sub --output env.tar.gz
Condor_q #
If you see some jobs were held and you want to know why:
condor_q -hold -af:h HoldReason
Last modified on 2025-04-18