dress_up_python

正面全身人物画像から試着

正面向きの全身人物画像から背景を切り抜き、人物の部位ごとの分類と骨格情報を取得を行います。 そして、その背景削除人物画像、人物部位セグメンテーション画像、骨格情報、用意された衣類画像,衣類Jsonから 衣類を背景削除人物画像に重ね、試着を行います。 試着処理自体は機械学習は使わず、画像処理だけで実現しています。

利用したリポジトリ

A simple and minimal bodypix inference in python

poppinace / indexnet_matting
https://github.com/poppinace/indexnet_matting

indexnet_matting

ajaichemmanam / simple_bodypix_python
https://github.com/ajaichemmanam/simple_bodypix_python

Body and Hand Pose Estimation

Hzzone / pytorch-openpose
https://github.com/Hzzone/pytorch-openpose

動作環境

言語/ライブラリ	Version
Python	3.7.2
torch	1.10.0
torchvision	0.11.1
opencv-python	4.5.3.56
numpy	1.21.3
Pillow	8.4.0
matplotlib	3.4.3
scipy	1.7.1
scikit-image	0.18.3
tensorflow	2.7.0
tensorflowjs	3.11.0
tqdm	4.19.9

使い方

1. simple_bodypix_pythonとpytorch-openposeで使う学習モデルをダウンロードする。　※ダウンロード方法は該当リポジトリ参照
2. 試着したい正面全身人物画像(png or jpg)を images/input_images に入れる。
3. main.pyのclothes_nameへの代入記述をclothes_datas/clothes_on_topを見て試着したい衣類の名前にする
4. main.pyのif __name__ == "__main__":内のsegm_dressの引数を左からfilename,inputするfileへのパス,人物の身長にする
5. main.pyを実行 ※一番最初の試着はsemantic_segmentation/haikei.pyで使う学習モデルをダウンロード処理が入るので処理時間が長くなる

他のリポジトリのライセンス / 引用

indexnet_matting licence

IndexNet Matting for non-commercial purposes Copyright (c) 2019 Hao Lu All rights reserved.

Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:

• Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.

• Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

pytorch-openpose citation

@inproceedings{cao2017realtime,
  author = {Zhe Cao and Tomas Simon and Shih-En Wei and Yaser Sheikh},
  booktitle = {CVPR},
  title = {Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields},
  year = {2017}
}

@inproceedings{simon2017hand,
  author = {Tomas Simon and Hanbyul Joo and Iain Matthews and Yaser Sheikh},
  booktitle = {CVPR},
  title = {Hand Keypoint Detection in Single Images using Multiview Bootstrapping},
  year = {2017}
}

@inproceedings{wei2016cpm,
  author = {Shih-En Wei and Varun Ramakrishna and Takeo Kanade and Yaser Sheikh},
  booktitle = {CVPR},
  title = {Convolutional pose machines},
  year = {2016}
}

License ライセンス

GNU General Public License v3.0

supplement　補足

Since this repository uses other repositories, the license is subject to the restrictions of the license of the repository used.
Therefore, use is limited to non-commercial purposes only.

現状

現状、試着ができるのは上の服のみであり、かつ正面を向いた全身が写った人物画像に限定される。
下の服の試着は現在進行中である。