How would you personalize an image generation model?


Hello Reader,

Welcome to another edition of the AIFEE newsletter!

AIFEE stands for Artificial Intelligence For Everyone and Everything!

Another week, another Machine Learning topic!

How to personalize image generation models?

We’ve all seen the incredible results lately for image generation using deep learning.

Models such as DALL-E, DALL-E 2, Imagen and Stable Diffusion all show tremendous potential of understanding users text input.

I’ve also seen these models being used to modify images but there was something lacking. Personalization.

Imagine that you have some specific subject in an image and you want to generate new images using contexts around that subject.

For example, imagine that you have a specific t-shirt image and you want to see how it would look if worn by somebody else. These scenarios are hard to achieve using pure image generation models mentioned above.

Introducing DreamBooth.

This is an approach that can help with personalization. It takes a few images (3 to 5) of your personal subject and it also takes an image-generation model as input.

The output is :

  • A unique identifier for your subject, let’s call it V.
  • A fine-tuned/“personalized” text-to-image model that encodes V.

This is shown in the figure below ↓

Pytorch tip!

Sometimes you might need to extract only a part of a deep learning model.
​
For example, you might want to extract only convolutional layers of a pretrained model such as InceptionV3 or ResNet50.
​
How would you achieve that using Pytorch?
​
Below is a code snippet showcasing exactly how ↓

​

So you've trained, evaluated and deployed your ML model. Are you done?

The answer is no! Training, evaluation and deployment of your ML models is not enough.

There are actually more tests that need to continuously be run to ensure the validity of your AI system.

These tests need to be done for both your models as well as your data.

Some of these tests are :

  • Continuously testing your model performance.
  • Continuously testing data integrity.
  • Continuously testing data distribution mismatches.

Implementing all of these tests by yourself could be time consuming.

Introducing Deepchecks.

It’s a Python open source library that you can use to run all of the tests mentioned above as well as other types of tests.

Currently you can use it for both computer vision tasks as well as tabular data tasks.


That's it for this week's newsletter! See you next time!

​

​

Machine Learning for Medical Imaging

👉 Learn how to build AI systems for medical imaging domain by leveraging tools and techniques that I share with you! | 💡 The newsletter is read by people from: Nvidia, Baker Hughes, Harvard, NYU, Columbia University, University of Toronto and more!

Read more from Machine Learning for Medical Imaging

Hello Reader, Welcome to another edition of PYCAD newsletter where we cover interesting topics in Machine Learning and Computer Vision applied to Medical Imaging. The goal of this newsletter is to help you stay up-to-date and learn important concepts in this amazing field! I've got some cool insights for you below ↓ AI Scribes: Transforming Medical Documentation Web Application for Medical Note Generation AI-powered medical scribes are revolutionizing clinical workflows by automating...

Hello Reader, Welcome to another edition of PYCAD newsletter where we cover interesting topics in Machine Learning and Computer Vision applied to Medical Imaging. The goal of this newsletter is to help you stay up-to-date and learn important concepts in this amazing field! I've got some cool insights for you below ↓ DeepSeek: A New Player in AI for Healthcare The new open-source LLM, DeepSeek, is creating buzz for its potential to transform AI in medicine and healthcare. Designed for...

Hello Reader, Welcome to another edition of PYCAD newsletter where we cover interesting topics in Machine Learning and Computer Vision applied to Medical Imaging. The goal of this newsletter is to help you stay up-to-date and learn important concepts in this amazing field! I've got some cool insights for you below ↓ Now You Can Use Large Language Models that are HIPAA Compliant People are finding ways to use large language models in all fields. MedTech is no exception. The amount of work...