Install VirtualEnv using the following (optional):
$ [sudo] pip install virtualenvCreate and activate your virtual environment (optional):
$ virtualenv -p python3 renv
$ source renv/bin/activateDepending on your machine, you may have to do:
$ python3 -m venv renv
$ source renv/bin/activate- compatible with python 3
- dependencies can be installed using
r1_hackathon/requirements.txt - Works best with CUDA 12.5 (otherwise you may have to struggle with installation of individual libraries)
Install all the required packages:
at r1_hackathon/:
$ pip install -r requirements.txtPlease set environment variables (in your ~/.bashrc file) for OPENAI_API_KEY, TOGETHER_API_KEY, HYPERBOLIC_API_KEY.
At r1_hackathon/:
$ python single_inference.py -prompt_type basic -model_type hyperbolic -model deepseek-ai/DeepSeek-R1 -max_tokens 4096 -temperature 0.6 -reasoning_effort low -run_name r1_basic_1This will create a new directory within r1_hackathon/outputs with the name r1_basic_1 which will store the model generated output in a output.txt file.
If you have a dataset of prompts, please implement the appropriate logic as required by simply running a loop in the main function.