Gender Classifier - Low Colors & Multiple Face Remover - Stable Diffusion Training Images Preprocessor (Patreon)

Patreon exclusive posts index

Join discord and tell me your discord username to get a special rank : SECourses Discord

This script uses Retina Face and a fine tuned gender-classification model from Hugging Face. Both are state of the art very high accuracy.

12 November 2023 whole post updated. Huge improvements. Now supports Retina Face GPU

Requirements:

Make sure that you have git and Python 3.10.x installed. I used Python 3.10.11.

May work with other Pythons too but I haven't tested

Here a tutorial video : https://youtu.be/B5U7LJOvH6g

How To Use:

Download gender_classifier.zip into any folder where you want to install

Extract it. This file contains all 7 attached files so same.

First run install.bat file. You need to double click and run only 1 time.

It will generate a new VENV and install all necessary libraries.

This will not break or affect your other Python apps and installations.

Edit classify_and_process.py and change below folder paths.

source_folder = r'G:\gender_classifier\blur_test'

no_face_folder = r'G:\man dataset\no_face_detected'

multi_face_folder = r'G:\man dataset\multi_faces_detected'

blurry_folder = r'G:\man dataset\blurry_faces_detected'

low_color_folder = r'G:\man dataset\low_colored_images'

male_folder = r'G:\man dataset\male_new_images'

female_folder = r'G:\man dataset\female_new_images'

unknown_folder = r'G:\man dataset\unknown_images'

log_file_path = 'logs.txt'

DEBUG_IMAGES = True

ENABLE_BLURRY_DETECTION = False

DEBUG_FOLDER = 'debug_folder_path'

sort_sharp

This script will sort images based on their sharpness / blurness. Can be used to sort

Edit sort_sharp.py and set below paths

images_folder_path = r"G:\gender_classifier\blur_test"

log_file_path_sharpness = r"G:\gender_classifier\sharpness_logs.txt"

log_file_path = r"G:\gender_classifier\processing_log.txt"

sorting_image_prefix="man"

You can change prefix to like woman, img, etc.

Also it will start with 10000 but if you have over 90000 images start from 100000

Hopefully a tutorial video coming soon.