How would you personalize an image generation model?


Hello Reader,

Welcome to another edition of the AIFEE newsletter!

AIFEE stands for Artificial Intelligence For Everyone and Everything!

Another week, another Machine Learning topic!

How to personalize image generation models?

We’ve all seen the incredible results lately for image generation using deep learning.

Models such as DALL-E, DALL-E 2, Imagen and Stable Diffusion all show tremendous potential of understanding users text input.

I’ve also seen these models being used to modify images but there was something lacking. Personalization.

Imagine that you have some specific subject in an image and you want to generate new images using contexts around that subject.

For example, imagine that you have a specific t-shirt image and you want to see how it would look if worn by somebody else. These scenarios are hard to achieve using pure image generation models mentioned above.

Introducing DreamBooth.

This is an approach that can help with personalization. It takes a few images (3 to 5) of your personal subject and it also takes an image-generation model as input.

The output is :

  • A unique identifier for your subject, let’s call it V.
  • A fine-tuned/“personalized” text-to-image model that encodes V.

This is shown in the figure below ↓

Pytorch tip!

Sometimes you might need to extract only a part of a deep learning model.
​
For example, you might want to extract only convolutional layers of a pretrained model such as InceptionV3 or ResNet50.
​
How would you achieve that using Pytorch?
​
Below is a code snippet showcasing exactly how ↓

​

So you've trained, evaluated and deployed your ML model. Are you done?

The answer is no! Training, evaluation and deployment of your ML models is not enough.

There are actually more tests that need to continuously be run to ensure the validity of your AI system.

These tests need to be done for both your models as well as your data.

Some of these tests are :

  • Continuously testing your model performance.
  • Continuously testing data integrity.
  • Continuously testing data distribution mismatches.

Implementing all of these tests by yourself could be time consuming.

Introducing Deepchecks.

It’s a Python open source library that you can use to run all of the tests mentioned above as well as other types of tests.

Currently you can use it for both computer vision tasks as well as tabular data tasks.


That's it for this week's newsletter! See you next time!

​

​

Machine Learning for Medical Imaging

👉 Learn how to build AI systems for medical imaging domain by leveraging tools and techniques that I share with you! | 💡 The newsletter is read by people from: Nvidia, Baker Hughes, Harvard, NYU, Columbia University, University of Toronto and more!

Read more from Machine Learning for Medical Imaging

Hi Reader! I hope you're doing well in this fine weekend! In the past weeks I've been working on implementing basic image segmentation models for 2D and 3D from scratch. While doing so, I found a few things that were delightfully surprising while other things were painfully irritating. I tell you all about it in this edition of the newsletter! What Building AI Models from Scratch has Thought me One of the reasons why I did these experimentations was to understand some of the nitty gritty...

Hi Reader, I haven't sent you a newsletter email for some time now. This is because there are major events happening in my personal life. We just had our first kid, so I'm still trying to adapt to the new routine set by this cute little creature! I also changed my office! I used to work from home, but now I am working in a coworking space. I'm hoping that this will help me deliver more value to the newsletter subscribers as well as our clients at PYCAD. Now, back to the newsletter! I've got...

Dental implant - Wikipedia

Hello Reader, Welcome to another edition of PYCAD newsletter where we cover interesting topics in Machine Learning and Computer Vision applied to Medical Imaging. The goal of this newsletter is to help you stay up-to-date and learn important concepts in this amazing field! I've got some cool insights for you below ↓ Applications of Machine Learning for Dentistry At PYCAD, we have worked a lot on the applications of AI to the dentistry domain. Here are 3 incredible ones. 1 - Diagnosis and...