Software Combines Thousands of Online Images Into One That Represents Them All

Zothecula writes If you're trying to find out what the common features of tabby cats are, a Google image search will likely yield more results than you'd ever have the time or inclination to look over. New software created at the University of California, Berkeley, however, is designed to make such quests considerably easier. Known as AverageExplorer, it searches out thousands of images of a given subject, then amalgamates them into one composite "average" image.

First post

[KamikazeSquid]

Can we use it to create an amalgamation of the "average" first post on a /. article?

Re:Frist psot

[Zero__Kelvin]

Yes. That looks about correct.

Re:

[NotInHere]

In soviet russia, joke averages you!

Re:

[alphatel]

Can we use it to create an amalgamation of the "average" first post on a /. article?

The Average Image for your first post would look something like this:
>Frist Post (Score: -1)
...

My fear

[Anonymous Coward]

I dread that the average of all internet photos will be a pornographic picture of a woman with a penis.

Scientific justification

[sinij]

So this is how a bunch of scientists justified browsing for pron and cat videos all day long? Yes, we heard this before - they are working on average algorithm for images.

Re:

[ArcadeMan]

Or Xbox 360 USB ports [macrumors.com].

Re:

[PopeRatzo]

I've been burned by a goatse link too many times to click on that.

Which by the way, turns out to be what you get when you combine every image on the internet together. Weird, huh?

Oh goodie

[smooth wombat]

I can see the searches now:

"What does a black person look like?"

"What does an Asian person look like?"

"What does someone from Mississippi look like?"

Re:

[PopeRatzo]

You forgot, "What does a man bending over and spreading his butthole look like?"

Re:

[Tablizer]

No, there's nothing average about goat-se

You'll be impressed

[i kan reed]

With this complex algorithm that takes a fuck-ton of image data and produces for you: something that is almost impossible to tell apart from applying the blur filter on the original image.

Re:

[turp182]

I was also going to point that out. Any graphics program can blur and image with very similar results.

I could see a benefit to this for pattern recognition, such as determining people's ancestral makeup or what breeds a particular dog is composed of.

The key would be well defined inputs. A large sample of each possible output value would be needed, along with details about a particular value. This would be the training (200 Labradors, 200 Beagles, etc.).

But the next step, testing/usage, requires different

Yay! Average!

[Tree131]

Suddently there's a surge in searches for "Average Penis"

Re:

[kwbauer]

At least average is better than the half that are undersized.

One image...

[Deadstick]

...to rule them all?

Re:

[Andurian]

I would've gone with "One png to replace them all."

Re:

[plover]

Came for this:

One .png to rule them all
one wavelet to find them
one .jpeg to compress them all
and with the imagemagick library bind them.

Left satisfied.

Re:

[Deadstick]

OK, I know when I'm outclassed...

Actual article

[Anonymous Coward]

Here's a link to the actual article, rather than the useless link provided:

http://newscenter.berkeley.edu/2014/08/14/average-image-for-big-visual-data/ [berkeley.edu]

The video was pretty interesting!

The Average Cat

[sfsp]

So...what the software demonstrates is that if you line up all the pictures of cats by centering them on their noses, you will CLEARLY see...

...that the average cat has a nose.

The rest is blurry and remarkably uninformative.

There needs to be a LOT more intelligence, either machine or human, applied to this before it is remarkable.

Re:The Average Cat

[The Raven]

You may have read the article (dubitable), but you didn't watch the video or read the SIGGRAPH paper. They demonstrate a browsing tool that enables you to, for example, find an average nose nearly instantly. You can then filter the thousands or millions of images to find specific cat breeds, poses, situations, or colors in seconds.

The tool is called average explorer, and it allows a user to interactively explore a vast set of image data quickly and efficiently. The one picture you describe was a single click in the explorer.

You did the equivalent of saying "Wow, I can make a black dot on a white canvas. That's not very exciting." when presented a single click with a single tool in Photoshop.

Re:

[timeOday]

How does it compare to eigenfaces [wikipedia.org]?

Re:

[Kjella]

Somehow, I still fail to see the point... I can search for "cat" in Google Images, then if I'm not happy then "siamese cat" and finally "siamese cat jumping" because I'm probably looking for one useful picture, not a blurred mess as I'd expect trying to average what a "jump" looks like. And if you ask what an average face looks like, they mean the average feature size and location not a mathematical average. I'm trying to think of one single purpose where the results of this "average browser" is what I'm lo

Re:

[Alsee]

a black dot on a white canvas

$360,000

-

Re:

[sfsp]

Well, I did read the article. I did not immediately watch the video, and now that I have, I'm still not impressed.

The strength of the tool is NOT the averaging of multitudes of shapes, which is what is essentially advertised. Instead, it is in finding images in the set that conform to what the user selects: filtering, not combining.

So, the "average" of blue butterfly wings with this shape is that they are blue and have this shape. You're not AVERAGING, you're FILTERING.

Or, given this "average" nose, find th

Re:

[Wandering Idiot]

So, it's basically a recreation of what Google's already using for their Reverse Image Search with the parameters set a bit looser?

Automatically means no control

[techno-vampire]

If this software searches out all images of a subject and averages them automatically, that means that there's no human control over which images to use and which to reject. Imagine what would happen if you were to let this program loose to create an average image of Shirley Temple. [wikipedia.org] She started in films at the age of three and reached the age of 85, and the software would create an "average image" by mixing images of her as a small child with ones of her as an elderly woman. Even worse, there's a non-alcoholic cocktail [wikipedia.org] named after her, and pictures of it would almost certainly get included.

Re:

[ArcadeMan]

I think the result of such automated image merging will probably result in something like this [joblo.com].

Re:

[Triklyn]

best Ima-drink-agen EVER. combines the vivacity of youth, the wisdom decades, the trials and tribulations, loves and losses of an entire lifetime, with a splash of grenadine. Would definitely drink that in, as it were.

i'd be more afraid of image searches for rick santorum or prince albert.

Re:

[hythlodayr]

Not necessarily. Machine learning algorithms like K-means clustering are designed for exactly this sort of problem. In principle, it can figure out that there are two different shirley temple images: Shirley Temple the human; and shirley temple the bright-red drink. Of course, depending on *how* you wash the image data into something that can be analyzed, it could make unexpected categories like "Shirley Temple black & white" vs "Shirley Temple mostly red" vs "everything else".

What you combine all online images...

[TheNastyInThePasty]

Hint: It's porn.

So, where is it?

[ArcadeMan]

It's not online for people to play with? I wanted to see if searching for "penis" will result in screen captures of Spore [cad-comic.com].

What did you expect?

[Opportunist]

Great. Just what we needed. A program that will help us find the common features of the average pussy.

Selfie engine.

[geekmux]

"Known as AverageExplorer, it searches out thousands of images of a given subject, then amalgamates them into one composite "average" image...

Suddenly the Kim Kardashian selfie book makes total sense.

She's not a narcissist, she's just helping test the beta.

it works!

[nblender]

I typed in "douchebag" and it showed me a picture of some guy driving an Audi A4.

Re:

[turp182]

True douchebaggery doesn't start until the Audi A5 in my opinion. One should also consider BMW 5 or higher and anything Mercedes in the 500/600 classes.

Re:

[Tablizer]

Odd, I typed in "current location of nblender's girlfriend" and got the same thing.

Re:

[nblender]

Hope my wife doesn't type that in.

dissapointed

[PopeRatzo]

How is it that on a story like this I'm the only one making goatse jokes?

What happened to you, Slashdot?

I tried it

[Solandri]

Here's what I got when I gave it every pic in my photo library [amazonaws.com].

But seriously, I've seen the same technique used to discredit a movie of a UFO shot on 8 mm film. If you just watch the movie, you see an elliptical blob flying. Someone scanned the blob from each frame, aligned them, and averaged them. The increased contrast (bit-depth and resolution basically) let you see that the elliptical blob was more a diagonal prism, and that there were dark features underneath it. Basically it was a Cessna with the sun reflecting off the top of the wing.

Fantastic

[kuzb]

They've created an algorithm for producing fuzzy blobs!

Three Dee

[Tablizer]

I'd like to see one that constructs a 3D model. Perhaps it could use a genetic algorithm (GA) to breed a 3D model that can best represent the most actual specimens of the target object type.

It may be a lot of computations, however, because one is not just running genetic algorithms, but also rotating all the candidate 3D models and lighting conditions to see which best fits the actual specimen images PER GA candidate PER specimen. Perhaps a 3D thumbnail version can be used to for initial placement estimations to be fine-tuned with a fuller model.

Then you got spot and texture variations within specimens. You have to model varying textures, not average them out. But even if it ignores texture & spots to simplify things, a 3D shape model result would be cool.