The script provided above is for the GPT-2 model but we can also train ConditionalGPT2 and StyleGPT2 using the same script by replacing models/gpt2_model.py with models/conditional_gpt2_model.py or models/style_tokens_model/run_styleGPT2.py respectively.
We need to make sure that the **--mode** argument is set to 'train'. The **--ckpt_name** argument is not mandatory, but it allows an already trained model to be loaded for further fine-tuning.
## At inference
## At inference time
To use the three models at inference time, the script to run is quite similar to the training script but with more arguments.
Some arguments are common to three models, such as:
***--mode** which is equal to 'inference' at inference time