Commit f4c56f6c authored by JunqiJiang's avatar JunqiJiang
Browse files

update references

parent 7e56e69b
......@@ -13,7 +13,7 @@ pip install -r requirements.txt
## Running the web app
### Installing MMF
### Installing [MMF](https://github.com/facebookresearch/mmf)
In the web app, we use several pretrained models from MMF, who does not provice interfaces with these models. The /mmf directory contains the extended and modified files for this purpose. These are integrated in a fork of [MMF](https://github.com/junqi-jiang/mmf). We recommend install from this fork rather than install from MMF and manually replace the files.
```
......@@ -23,7 +23,7 @@ pip install --editable .
```
#### Fixing checkpoints config file
We use MMBT, late_fusion, vilbert, visual_bert models from MMF. Due to a [known issue in MMF](https://github.com/facebookresearch/mmf/issues/784), some downloaded pretrained models have curious config files which will cause error, some extra steps are needed to solve it.
We use [MMBT](https://arxiv.org/abs/1909.02950), late_fusion, [vilbert](https://arxiv.org/abs/1908.02265), [visual bert](https://arxiv.org/abs/1908.03557) models from MMF. Due to a [known issue in MMF](https://github.com/facebookresearch/mmf/issues/784), some downloaded pretrained models have curious config files which will cause error, some extra steps are needed to solve it.
when first [loading each pretrained model](https://gitlab.doc.ic.ac.uk/g207004202/explainable-multimodal-classification/-/tree/master/examples), the files are downloaded automatically to your default torch cache directory.
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment