README.md

Animals

In this part, the FMPose3D model is trained on Animal3D dataset and Control_Animal3D dataset.

Demo

Testing on in-the-wild images (animals)

This visualization script is designed for single-frame based model, allowing you to easily run 3D animal pose estimation on any single image.

Before testing, make sure you have the pre-trained model ready. You may either use the model trained by your own or download ours from here and place it in the ./pre_trained_models directory.

Next, put your test images into folder demo/images. Then run the visualization script:

sh vis_animals.sh

The predictions will be saved to folder demo/predictions.

Datasets

Download the Animal3D dataset from here

Download the control_animal3D dataset from here

Place the downloaded files in the dataset/ folder of this project:

<project_root>/
├── dataset/
│   ├── animal3d
│       ├── images
│       ├── train.json
│       ├── test.json
│   ├── control_animal3d
│       ├── images
│       ├── train.json
│       ├── test.json

Training

The training logs, checkpoints, and related files of each training time will be saved in the './checkpoint' folder.

For trainig on the two datasets:

cd animals
bash ./scripts/train_animal3d.sh

Inference

Download the pretrained model from here and place it in the ./pre_trained_models directory.

cd animals # the current path is: ./animals
bash ./scripts/test_animal3d.sh