Determination of what is shown in the photo. How to determine who or what is in a photo. What is the difference between the uploaded images search and the usual search

What technology has come to.

If a person looks at a photo where a woman with a book in her hands next to a dog is watching a UFO from the window, then he will most likely determine the age and mood of the lady, the breed of animal, what is written in the book and in what font.

In 2016, a computer can do the same! And unlike a person, he will also determine the shooting location and point to the traces of the "sticker" of the flying saucer.

And you can try all this online, for free and right now!

1. We are looking for traces of photomontage

Go to 29a.ch/photo-forensics and use the button Open File upload a photo.

And we begin to explore it with the tools on the right panel. Using a magnifying glass, we are trying to find poorly disguised traces of processing:

Analysis of layers allows you to detect "patches":

Have you worked with a clone brush here:

You can learn more about how to find traces of editing in the photo in the training video from the creators of the service:

2. Reading metadata

Go to Jeffry's Exif Viewer and upload a picture (raw, taken with a digital camera or phone). In a second, we know on what device and at what time it was taken, and we also see the shooting location on the map:

3. Recognize the celebrity in the photo

On beface.com you can find out what kind of celebrity is shown in the photo. Download the file and wait a little less than a minute:

Click on the button Search Wikipedia... A list of faces that look like the downloaded one will appear shortly:

To find out the name of the person in the photo, you need to hover over it with the mouse. My experience has shown that the service very accurately identifies famous people.

4. Determine the font of the inscription

In a special section myfonts.com you can upload a picture with an inscription and define the font with which it is made. The result page displays five sample labels of the maximum similar fonts (with the same text as the loaded one):

5. Recognizing text

Newocr.com is for those who want high-quality text recognition, but don't want to pay for FineReader. We load the scan, wait a while and enjoy the result:

The finished text can be downloaded, copied to the clipboard or translated using Google Translate.

The service has many analogues, but in my experience newocr.com is the best at recognizing the Russian language.

You can use Google to find similar photos. But he is not yet perfect enough in solving this problem:

Not bad though!

7. What is shown in the photo?

Clarifai.com knows how to determine what is shown in a photo. It is easy to recognize that in this picture there is an adult man with glasses and a beard:

Defines the breed of the dog:

But I have not yet learned how to distinguish mulberry from other fruits:

8. Gemini or not?

The entertainment service from Microsoft is able to determine whether different people in the photos or the same person.

Despite the years and glasses, he recognizes Steve Jobs:

And distinguishes him from Tim Cook:

9. Human emotions

And here is a joint project between Microsoft and Oxford University to analyze the emotions of a person in a photo.

Service easily determined that with almost 100% probability a woman experiences fear ("fear"):

And knows what it looks like happy man ("Happiness"):

10. Determination of age

All and sundry wrote about the last item on our list. But suddenly someone doesn't know ;-) On

I have a fairly good memory for faces. When I see someone for the first time, I usually remember him (her). If I am attentive enough at this moment, then I will also remember the circumstances under which I met this person. This all happens against my will.

But usually I am quite absent-minded and in the clouds. And if I see the faces of passers-by, then they are "remembered", but the circumstances are not quite. And if I meet a person whose face I remember, but did not remember the circumstances (mainly where and when), then it will torment me very much until I remember. :)

Yesterday on the Internet I came across a photograph of a person whom I have already seen somewhere. And since I could not remember where or when, it began to torment me. But then I remembered that Google has a service that ultimately helped me.

This service is an image search by image. Earlier when I ran into it, it could find an image that you can only have a piece of. (I even drove my acquaintances' autarks through it to find out where what picture "came from.")

And yesterday I learned that Google, in addition to finding the whole in part, can also express an opinion about who or what is depicted in a photograph, for example, a person, a car or a building.

It goes without saying that we are talking about digital photography.

And Google will show you its options, if it has any.

(No, of course, you can click "Browse" and get through the folders on your disk to the desired photo. But why unnecessary gestures? Moreover, you can just throw a photo from the disk directly into the Google image search window - and you don't need to click any icons. )

Hello dear readers of the blog site. Until recently, search engines could only search by words. No, of course, there were such, but until a certain period they operated only with the words that the user entered in the search bar.

What is the difference between the uploaded images search and the usual search

The search engine did not understand what exactly was shown in the photo, which it displayed in the results, but only focused on the words that were found in the text next to this image (on those pages of the sites where it found them) or that were spelled out in its attributes. In fact, for the search engine, the picture was a "black box", which he could judge only by indirect signs (its description).

As a result, upon request "blue hen", "pink elephants" could be shown. Of course, such flaws in photo search were corrected manually (so-called), but this was done only for the most frequently entered queries. And this is not the main thing.

What is important is that it was impossible show the image to the search engine poor quality so that he finds you the original in high resolution or shows him a photo of a person (read), and he would tell you that this is such and such an artist, poet, musician or just a person described at least on one page on the Internet ...

Sometimes a photo can be one of many in a series (photo essay, photo instruction, different angles) and you may want to find all the other images from the same series to understand the essence. How to do it? What words to drive into the search bar? Here's another example. You saw the sofa in the photo and wanted to know where exactly the same is sold and at what price.

A difficult task, or even insoluble (in the first approximation), if the query is entered in words. Here you need to somehow upload a picture to search engine and the latter should understand what exactly is depicted on it, and try to give you answers to all the questions posed just above.

Until recently, image search could not do this, but now it can. Search by sample picture (photos or any other image) are now supported by both - Google and Yandex. Moreover, the latter learned to do this only quite recently, but, nevertheless, he learned.

If you try to dive into the full depth of the principles of this action, then most of us are unlikely to find it interesting. In this regard, I really liked the explanation of the Yandex representative.

The picture is broken into small fragments that can be called virtual words. And then the process follows the same logic as a regular search. The search is for the same set of visual words, and the closer it gets to the user-uploaded image, the higher it will appear in the search results.

How Google Photo Search works

Let's see all this with examples from Yandex and Google. Let's start with the largest search engine in the world. In order to get to the holy of holies, you can click on the "Pictures" button on the regular search page, or you can immediately:

Click on the camera icon located in the right area of \u200b\u200bthe Google search bar. You are given two options to load in the search for the desired picture or photo - indicate its address (it can be copied by right-clicking on the photo and choosing the option "copy image URL", or similar in meaning) on \u200b\u200bthe Internet or download it from your computer.

In the example shown, I simply indicated the URL of the image that I found on the official Wikipedia website ().

In the search results, I got the following picture:

Google told me that the photo depicts Albert Einstein in his youth, and also offered to see the same image, but larger or smaller. You can also see similar pictures, and below them you can see the web pages where this graphic file takes place.

In the search box, you can enter qualifying words, for example, if you want to know about all the twists and turns of the fate of this person, then enter the word "biography". As a result, pages will be found on which the search found the picture you uploaded and on which there is a biography of the one who is depicted on it.

I mentioned two main ways to upload an image to Google search - link to a graphic file or upload it from your computer. But there is also a third way to activate this action.

If you are in google chrome, then just move the mouse to the picture or photo on the page that interests you for one reason or another (for example, you want to find out whether your virtual friend posted a true photo on Vkontakte or is it some famous person captured).

As a result, a context menu will appear and you will need to select the item "Find this image in Google" from it. After that, you will find yourself in the already familiar Google image search window with all the information collected about your friend's photo.

Search by image files in Yandex

Quite recently, the leader of the Russian Internet search market has acquired a similar tool. New technology they called it "Computer Vision" and gave it the code name "Siberia". In this case, the picture is divided into visual words (areas of contrast change, borders, etc.), and the presence of this set of visual words in other images is searched for throughout the database available in Yandex.

And only then from them are selected those in which these visual words are in the same order as in the original uploaded picture. In practice, this action looks very similar to Google - in the right search area using a photo from Yandex there is a camera icon, which you will need to click to download the graphic file.

Although, if you have the URL of the desired picture, you can insert it directly into the graphical search line and click on the "Find" button, as shown in the previous screenshot.

You can find out the URL of an image on a web page by right-clicking on it and selecting the "Copy image address" context menu item or similar (different names are used in different browsers).

If you need to upload a picture to the search from your computer, then click on the camera icon.

The search results will look something like this:

As you can see, from them it is also quite easy to understand that the photo shows the great Einstein, but in Google I somehow liked the design of the issue more. It is possible that Yandex will still need to work on this. Found can also be sorted by size and type.

In general, in most cases, the described services should be enough for you, but it is possible that Tinai will come in handy someday. Here, again, you are offered a choice of two ways to download a sample picture - by entering the URL address or directly from the computer.

This service is well suited for finding similar photos or individual components from which it was edited. As you can see from the screenshot below, Tinai found the sources of the original images that the sample consisted of.

Chinese search engine Taobao has the ability to search for products by your uploaded photo. As a result, you will not only receive the addresses of those online stores where you can buy it, but you will also be able to choose the most favorable offer for you.

However, to work with him you need to know Chinese. However, there are several sites that allow you to search for goods by photo through a database in Taobao, but at the same time have a Russian-language interface and the search results are also translated into Russian.

Product search results by photo look like this:

Good luck to you! See you soon on the pages of the blog site