Skip to content

npm package for finding an image as part of another image. In other words, picture-in-picture search.

Notifications You must be signed in to change notification settings

aarnas/image-in-image

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🔍 Search for image in image

With this package you can find an image as part of another image. In other words, picture-in-picture search returning position coordinates.

Image search is done while matching image pixels color and it has to be pixel perfect match. This solution is suitable for search in screenshot while looking for some part of the screen. It is not suitable for hand written digit recognition or searchng for something not exactly the same, so keep that in mind.

For a result you get x and y as a position by pixels in image from top left. Result gives you center point of found inner image in outer image.

For errors, you get { error: code, message: description }

Possible error codes and descriptions:

  • 500 - "Something went wrong, might be that images path not right"
  • 400 - "Inner bigger than outer"
  • 404 - "Image not found"

Usage

npm i image-in-image

Functions


findImage

findImage(
  outerImagePath, // your main image inside which you search
  innerImagePath, // your inner,smaller image you looking for
  outerImageMimeType // outer image type
  innerImageMimeType, // inner image type, e.g. "image/png" if .png
  //optionals
  aspectRatio, // aspect ratio, default 1, required when screenshot and screen size not the same
);

e.g.

import { findImage } from "image-in-image";

const main = async () => {
  const test = await findImage(
    "outer.png",
    "inner.png",
    "image/png",
    "image/png",
    1 // optional aspect ratio, default 1
  );
  console.log(test);
};

main();

Should return something similar:

{ "x": 268.5, "y": 161 }

findImages

import { findImages } from "image-in-image";

const main = async () => {
  const test2 = await findImages(
    "dots.png",
    "dot.png",
    "image/png",
    "image/png",
    2, // optional amount of max found, default 99
    1 // optional aspect ratio, default 1
  );
  console.log(test2);
};

main();

if findMaxAmount set to >2, returns always in array:

[
  { "x": 53, "y": 80.5 },
  { "x": 162, "y": 80.5 }
]

use Buffers instead images

import { findImages } from "image-in-image";

const main = async () => {
  const test2 = await findImages(
    BufferOfDots,
    BufferOfDot,
    "image/png",
    "image/png",
    2, // optional amount of max found, default 99
    1 // optional aspect ratio, default 1
  );
  console.log(test2);
};

main();

use Similarity option for not exact match

import { findImages } from "image-in-image";

const main = async () => {
  const test3 = await findImages(
    BufferOfDotsNotExact,
    BufferOfDot,
    "image/png",
    "image/png",
    1, // optional amount of max found, default 99
    1, // optional aspect ratio, default 1
    0.88 // optional similarity, default 1
  );
  console.log(test3);
};

main();