October DealsAmazon USOctober deal check: compare before you payAmazon US: current deals, useful picks and tech finds.Check DealsWindows FixRecommendedWindows errors stealing your time? Find the fix fastScan stability, cleanup and performance issues.Fix NowOctober DealsAmazon USDeal season is back - check today's better picksAmazon US: current deals, useful picks and tech finds.See Picks×
Skip to content
ThatPainter
AI photo restoration

Stable Diffusion Project: Reviving Old Photos Without Losing the Original

Stable Diffusion can revive damaged photographs, but sharper does not mean more accurate. This guide covers scanning, cleanup, upscaling, CodeFormer, txt2img, ControlNet, colorization, troubleshooting, and archival labeling.

By ThatPainter Team 10 min read
Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

ThatPainter is reader-supported. When you buy through links on our site, we may earn an affiliate commission. Learn More

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Stable Diffusion can make an old photograph clearer, larger, cleaner, and plausibly colorized—but it cannot recover every missing fact. When detail is damaged or absent, the model reconstructs it from visual patterns it has learned. That makes diffusion useful for presentation and creative reconstruction, but risky for genealogy, journalism, museums, and any project where identity or historical evidence matters.

The safest approach is to preserve the untouched scan, create a conservative restoration first, and only then make a clearly labeled generative version. The workflow below follows the Stable Diffusion process described in the Machine Learning Mastery tutorial published July 18, 2024, while qualifying its example settings for current WebUI installations.

Restoration or reconstruction?

Before opening AUTOMATIC1111, decide what you are trying to produce. These are different jobs:

Goal Best first approach Main risk
Remove dust, scratches, and color casts Conventional editing or a restoration filter Removing genuine photographic detail
Enlarge a reasonably clean scan Real-ESRGAN or another dedicated upscaler Estimated texture being mistaken for real detail
Repair a recognizable face Low-strength face restoration or local inpainting Identity drift
Colorize a monochrome image Restrained colorization with documented colors where possible Historically incorrect colors
Reconstruct severely damaged regions Masked inpainting or ControlNet-guided generation Fabricated people, objects, or architecture
Create a polished reinterpretation Diffusion-heavy reconstruction The result may no longer represent the original photograph

A sharp image is not necessarily an accurate image. Keep “restored,” “colorized,” and “artistically reconstructed” as separate labels.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

What Stable Diffusion can and cannot restore

Diffusion tools can clean surface defects, estimate high-resolution texture, rebuild missing areas, enhance faces, and assign plausible colors to grayscale regions. They are most dependable when the original structure remains visible: the outline of a person, the position of a building, the shape of a garment, or the broad arrangement of a group.

They become unreliable when a face is tiny or fully obscured, motion blur has erased features, people overlap, or the image contains damaged text, insignia, uniforms, jewelry, or tools. They cannot reliably identify a real person or prove what a garment originally looked like. A reconstructed letter, medal, button, or facial feature should be treated as an estimate unless it is readable in the source or independently documented.

Prepare the scan before diffusion

  1. Scan at the highest practical optical resolution. Enlarging a low-resolution scan does not recover lost information; it only gives later models more pixels to process.
  2. Preserve a read-only master. Keep the original scan unchanged, preferably in a lossless format. Work on a duplicate.
  3. Avoid JPEG recompression. Repeatedly saving a JPEG can create artifacts that the model interprets as photographic detail.
  4. Record provenance. Note the scanner, resolution, date, crop, rotation, and manual edits.
  5. Clean conservatively. Correct levels, contrast, exposure, and color casts. Remove obvious dust and scratches, and mask tears where possible before sending the image to diffusion.
  6. Keep comparisons. Save an original-versus-working-copy view so that real detail is not accidentally erased.

Severe scratches and folds can become edges that Stable Diffusion preserves or exaggerates. Conventional cleanup before generation is often safer than asking txt2img to solve every problem at once. If the physical photograph is fragile or valuable, use an archival scanning service or consult a conservator.

The original AUTOMATIC1111 workflow

The reference workflow assumes an AUTOMATIC1111 Stable Diffusion WebUI installation with an upscaler, optional face restoration, and ControlNet. Interface labels, extension behavior, model names, and compatibility can change, so treat the following as a reproducible example rather than a universal current preset.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

1. Upscale once

Open the working image in the WebUI’s Extra tab and enlarge it by roughly 2×. The tutorial uses R-ESRGAN 4x+ as one possible upscaler, although the available choices depend on the installation. AUTOMATIC1111 documents support for upscalers including RealESRGAN and face-restoration methods including CodeFormer and GFPGAN in its feature documentation.

A larger scale factor increases processing cost and apparent detail, but it also increases the amount of estimated texture. Do not assume that a 4× result is more truthful than a 2× result. Save the intermediate upscale and compare it with the scan at 100%.

2. Use CodeFormer selectively

CodeFormer can make a damaged face look more complete. Its weight controls the balance between fidelity and reconstruction: in the reference tutorial, a lower weight gives the model more freedom to alter a damaged face, while a higher weight tends to preserve more of the original expression and structure.

Do not apply face restoration automatically to every face. A cleaner face may be a different face. Generate and retain:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • a version without face restoration;
  • a version with restrained face restoration;
  • a comparison showing each changed face.

When a face is unrecognizable, label the result as interpretive. The original scan remains the authoritative reference.

3. Interrogate the image, but distrust the result

The tutorial temporarily uploads the upscale to img2img and uses a CLIP interrogator to draft a description. This is useful for getting started, not for discovering historical facts. Interrogation may misidentify age, occupation, location, clothing, or objects; describe scratches as objects; and add fashionable terms that make the output less faithful.

Edit the draft down to visible, defensible facts. A practical starting prompt is:

group portrait of [number] people, standing [location or arrangement], preserve original pose and facial expressions, period clothing, historical documentary photograph, natural lighting, faithful restoration, subtle colorization

Replace the brackets with information actually visible in the image. If a color is documented by family records, uniforms, captions, or another photograph, state it. Otherwise, avoid specifying one.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Avoid relying on “8k,” “masterpiece,” “ultra detailed,” “cinematic,” famous photographers, or artistic movements. Such terms can increase polish while changing the historical character of the image.

4. Choose txt2img, img2img, or inpainting

The original tutorial favors txt2img for the main reconstruction. It uses the upscaled photograph as structural guidance but avoids allowing img2img to follow every defect too closely. That is a deliberate trade-off, not a universal rule:

  • txt2img plus ControlNet: more freedom to redraw scratches and missing areas, but greater risk of identity and object changes.
  • img2img with low denoising: stronger source adherence, but stains, blur, and scratches may survive.
  • Inpainting: best for localized repairs to a face, garment, torn area, or background.
  • Conventional editing plus selective diffusion: usually the safest preservation-first workflow.

For archival or genealogical work, begin with low-denoise img2img or masked inpainting. Use full txt2img reconstruction for a second, clearly labeled presentation version.

5. Configure ControlNet

ControlNet adds spatial conditioning to a text-to-image model. The underlying research describes controls such as edge maps that guide generation while retaining the flexibility of diffusion; see the ControlNet paper.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

ControlNet unit 1: Canny

  1. Upload the upscaled image.
  2. Enable the unit and select Canny.
  3. Enable Pixel Perfect if available.
  4. Start with a control weight near 0.8.

Canny can preserve silhouettes, outlines, and hard object boundaries. Too much control can produce rigid, harsh, outline-heavy results; too little can change poses and object shapes. It is less effective at soft facial detail.

ControlNet unit 2: Recolor

  1. Upload the same image.
  2. Enable Pixel Perfect if available.
  3. Select the recolor control and recolor_luminance where that option exists.
  4. Start with a control weight near 0.2.
  5. Adjust gamma only when the luminance needs correction.

These values—Canny around 0.8 and recolor around 0.2—come from the reference tutorial. They depend on the checkpoint, input dimensions, degradation, VRAM, WebUI build, and ControlNet implementation. Test each control by itself before combining them. Recolor guidance preserves luminance relationships; it does not recover the original historical colors.

6. Set dimensions and generate alternatives

Match the source aspect ratio. The tutorial’s example uses 760×600 pixels, chosen to approximate its source and remain near the selected model’s operating range. A larger canvas is not automatically more accurate and may require tiled processing, which can introduce seams or inconsistent textures.

Use a photorealistic SD 1.5 checkpoint such as the tutorial’s example, Realistic Vision v6, only if it is compatible with your installation and licensing needs. Generate multiple candidates with controlled seeds. Compare:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • facial landmarks, expressions, hairlines, and apparent ages;
  • the number of people, hands, fingers, and objects;
  • clothing edges, buttons, tools, jewelry, and insignia;
  • background architecture and shadows;
  • color changes between seeds.

Choose the version that best preserves the evidence, not necessarily the one that looks most attractive.

Negative prompts: useful, not protective

The reference workflow uses a negative prompt aimed at drawing-like output, blur, low resolution, anatomy errors, monochrome output, watermarks, and similar defects. Negative prompts can suppress tendencies, but they cannot guarantee correct identity, historical color, lettering, finger counts, or missing information.

Use them to describe unwanted visual qualities, not as a substitute for masks, structural controls, inspection, or historical research. “No watermark” cannot make a generated insignia accurate, and “perfect face” may encourage a beauty-standard redesign.

Face repair and local inpainting

Use ADetailer or another face-focused tool only when a face is genuinely damaged or unrecognizable. Unnecessary automatic face reconstruction can replace a person’s expression, age, ethnicity, hairline, or identity.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

For a localized repair, crop the face, use a tight mask, reduce denoising, and compare the output against the original landmarks. Repair one region at a time rather than regenerating the entire photograph. Avoid prompts such as “beautiful,” “perfect,” or “young,” which encourage the model to improve the subject instead of preserve it.

Colorizing a black-and-white photograph

Colorization is an interpretation unless the original colors are documented. The same grayscale value can correspond to many colors, and film response, lighting, dyes, uniforms, and aging further complicate the guess. Skin tones and historically specific clothing colors deserve particular caution.

Generate several plausible variants when the color is unknown. If a documented color exists, include it in the prompt and keep the evidence with the project. Preserve the monochrome original and caption the result, for example:

AI-restored and colorized from an original monochrome scan. Colors and reconstructed details are interpretive and may not represent the original photograph.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Do not present the most attractive color scheme as the recovered original. Recolor control supplies luminance structure, not historical proof.

Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

Hires. fix and final enlargement

Perform the main structural restoration before the final enlargement. The reference tutorial suggests Hires. fix with relatively low denoising, approximately 0.2, to reduce additional distortion. A conventional upscaler can then prepare the image for printing.

Inspect both at 100% and at the intended print size. Look for changed faces, repeated textures, halos, seams, invented text, and over-sharpened edges. Every additional diffusion pass can compound hallucinated detail, so stop when the result meets its purpose.

Troubleshooting common failures

Faces become different people

Reduce denoising, remove CodeFormer or ADetailer, and try a tight inpainting mask. Compare expression, eye spacing, nose shape, hairline, and clothing. Keep the non-face-restored version.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Hands and small objects change

Crop and repair locally. Use a tight mask and avoid prompts promising “perfect hands.” Check fingers, buttons, tools, accessories, and object counts.

Clothing colors vary

The grayscale source does not identify the original color. Generate alternatives, consult independent evidence, and label uncertain colors rather than selecting the prettiest result.

Scratches are preserved or amplified

Clean the worst defects conventionally first. Lower Canny influence, try a separate cleanup pass, or mask the damaged region instead of regenerating the whole image.

Backgrounds drift

Lower denoising and describe only visible facts. If available, test depth, line-art, or segmentation control. Process the subject and background separately when they require different treatment.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The image looks modern

Remove “cinematic,” “DSLR,” “8k raw photo,” and modern lens language. Use “documentary photograph” or “period photographic appearance” sparingly, and apply final grain and tonal adjustments conventionally.

Text becomes nonsense

Diffusion models are poor at recovering exact lettering from damaged sources. Treat generated text, insignia, and labels as unverified unless readable in the scan or independently documented.

Preservation-first versus appearance-first workflow

Preservation-first

  1. Archive the original scan.
  2. Clean dust, scratches, exposure, and color casts with conventional tools.
  3. Upscale once at a restrained factor.
  4. Use face restoration only on demonstrably damaged faces.
  5. Prefer low-denoise img2img or localized inpainting.
  6. Keep the monochrome version and disclose every generative change.

Appearance-first

  1. Upscale the scan.
  2. Use CLIP interrogation only as a prompt draft.
  3. Run txt2img with Canny and recolor ControlNet guidance.
  4. Generate multiple candidates and select the most compositionally faithful.
  5. Use ADetailer or inpainting selectively.
  6. Colorize and enlarge only after checking for identity and object drift.

The first path is appropriate for evidence and family records. The second is appropriate for a visually improved or creative presentation, provided it is labeled honestly.

Reproducibility and archival notes

Save the original scan, intermediate upscale, final output, and lossless working file. Record:

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • checkpoint name and hash, if available;
  • seed, sampler, steps, resolution, and denoising strength;
  • positive and negative prompts;
  • ControlNet models, preprocessors, weights, and pixel-perfect setting;
  • CodeFormer or GFPGAN settings and ADetailer use;
  • conventional editing and post-processing;
  • date, software build, and source image provenance.

For museums, journalism, scholarship, or genealogy, never overwrite the original scan. Export separate files named and captioned as restored, colorized, or reconstructed.

Should you use Stable Diffusion or a dedicated tool?

Local AUTOMATIC1111 is the strongest choice when privacy, experimentation, parameter control, and repeatability matter. The WebUI is open source, but the real cost includes a suitable GPU, storage, model downloads, electricity, and setup time. Its relevant capabilities include upscaling, CodeFormer, GFPGAN, img2img, and Stable Diffusion upscaling; consult the official feature documentation.

Topaz Image and related Topaz products are better suited to readers who want dedicated enhancement and restoration without managing a diffusion stack. Check the official pricing page for current plans and promotions.

Adobe Firefly and Photoshop are convenient for users already in the Adobe ecosystem, especially when AI restoration must be combined with manual retouching. Adobe’s restoration pages describe free-account generative credits, but allowances and plan terms can change.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

The Stability AI Developer Platform is most relevant to developers building automated or batch workflows. Check current model availability, per-generation prices, limits, retention, and data-handling terms before sending private family photographs to a hosted service.

There is no universally best tool. Choose based on the priority: identity preservation, visual polish, speed, privacy, cost, historical accuracy, or creative freedom.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

More from the Paint Desk

Recommended PC Tool
Recommended PC Tool
Crashes, No Sound, or Screen Glitches?Free driver scan
Windows Errors? Fix Them Before They SpreadFree repair scan

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.