top of page

Semantic See-through Goggles (2023-) 

Semantic See-through Goggles are a kind of glasses through which the view is once fully verbalized and re-visualized.

Participants wear original goggles with a camera and HMD. First, a single image from the camera is converted by the AI into a single line of text. Next, an image is generated from that line of text, also by the AI. Finally, this image is presented on the display in both eyes. Both input and output are concrete images, but only the information contained in one line of text is stored, all the rest is creative. The view, in which much of the spatial positioning and material has been reworked, however, does indeed convey the meaning of the scene in front of it. These processes take place in real-time, allowing the user to perceive and act on the real physical world through this redrawn view.

Every view in the goggles is a 'stereotype' of some kind, which is constructed on the basis of the specific cultural knowledge learned by the model. (For example, the view of a person looking at a 'long-haired Asian man', or me, oscillates between a standard Anglo-Saxon, standard-bodied man and an equally Anglo-Saxon, standard-bodied woman.) This experience provides a subjective understanding of what it is like to divide the task of perceiving the world with an AI, while at the same time incorporating back into that problem the basic and inescapable fact of human perception that 'we see the world under meaning'.

Semantic See-through Goggles は、一種のメガネであり、それを通して景色は一度完全に言語化され、再度視覚化される。







Concept, Direction: Goki Muramoto
Engineering: Yuri Yasui, Hirosuke Asahi, Goki Muramoto

bottom of page