Apple Granted Patent for Deepfakes Based on Reference Images

Apple Granted Patent for Deepfakes Based on Reference Images

According to patent documents first spotted by Patently Apple, Apple’s technology uses machine learning to create synthetic images of human faces based on a reference image provided by the user. Once the tech has generated a synthetic face, it can manipulate that face to create changes in expression. Given a reference image or “target shape” depicting a whole person (not just a face), the image generator can also create synthetic images in which the reference person is posed differently.

The generator’s neural network is trained to constrain generation enough that the synthetic image can convincingly look like the reference person, not an entirely new—or simply “inspired—creation. These constraints are incorporated using a generative adversarial network (GAN) in which multiple synthetic images are generated, after which a discriminator attempts to determine which images are real or synthetic. The discriminator’s findings are then used to further train both the generator and the discriminator.

Apple is well aware that its technology is plainly associated with deepfakes (though maybe not as comical as the one above). “The generated image is a simulated image that appears to depict the subject of the reference image, but it is not actually a real image,” the patent reads. So much for working together to get rid of photos and videos of people doing things they haven’t actually done.

Some believe Apple’s motivation for the patent comes from a desire to squash facial motion capture and related technologies—not out of the goodness of its heart, of course, but to ensure it doesn’t have any competitors when it comes to things like Memoji. (Apple supposedly spent years buying up Faceshift, PrimeSense, Perceptio, and Metaio for this exact reason.) If that’s the case, Apple may never use the patent; after all, the company patents new technology all the time without ever actually using it.

Others think Apple could be working towards an app or feature that puts a “fun” or “convenient” twist on deepfakes. If that ends up happening, at which point does the Biden Administration’s proposed AI Bill of Rights get involved?

Continue reading

OpenAI’s ‘DALL-E’ Generates Images From Text Descriptions
OpenAI’s ‘DALL-E’ Generates Images From Text Descriptions

All you need to do is give DALL-E some instructions, and it can draw an image for you. Sometimes the renderings are little better than fingerpainting, but other times they're startlingly accurate portrayals.

NASA’s Super-Fast Solar Probe Returns Amazing Image of Venus
NASA’s Super-Fast Solar Probe Returns Amazing Image of Venus

According to NASA, Parker spotted a previously unseen glow that could be a product of oxygen in the inhospitable planet's atmosphere. The unexpected clarity of surface features also has scientists reassessing how sensitive Parker's cameras are.

NASA Probe Returns Amazing Image of Venus
NASA Probe Returns Amazing Image of Venus

According to NASA, Parker spotted a previously unseen glow that could be a product of oxygen in the inhospitable planet's atmosphere. The unexpected clarity of surface features also has scientists reassessing how sensitive Parker's cameras are.

New Image of Supermassive Black Hole Reveals Swirling Magnetic Fields
New Image of Supermassive Black Hole Reveals Swirling Magnetic Fields

The Event Horizon Telescope gave us the iconic 2019 image of a black hole, the first one ever produced. Now, the team has conducted new observations of the supermassive black hole at the center of galaxy M87, revealing magnetic field lines around the void.