Samsung unveiled the first Galaxy AI-powered smartphones Galaxy S24, Galaxy S24+ and Galaxy S24 Ultra a few days ago. But what is Galaxy AI? It's Samsung branding its AI and Generative AI-powered suite of features that help users with creative, lifestyle and productivity tasks.
What is Galaxy AI? Check it out in our detailed video below
In our new video, we showcased all the AI features that are part of the Galaxy AI suite. Those features include real-time language translation during messaging and voice calls, translator mode for language translation during face-to-face scenes, and writing style suggestions (via the Samsung keyboard). These features are powered by Google's or Samsung's own LLM models and are powered by Exynos 2400 or Snapdragon 8 Gen 3 for Galaxy processors, depending on the model. Some of these features require an internet connection, but most of them can run completely on the device (without internet).
Circle to search
Circle is another neat feature for searching with Google. It's an improved version of Google Lens that lets you hover over any part of the screen to search for information about the content you've hovered over. If you see a book, product or brand you want to know more about, circle it. The search circle in the Google pop-up window finds relevant information across the web. It also works by pressing and holding the Home button or a dedicated area on the screen to invoke Circle to search with Google.
AI-powered image and video editing
Galaxy AI also has various image and video editing features. If you have an image that is out of scale (horizontally or vertically) with respect to the subject, scene, or theme, you can adjust its angle without losing the rest of the image. Empty areas of that angle-adjusted image are filled with AI-powered content. The image editor tries to fill the empty parts of the image with AI-generated content. You can erase objects or objects in an image. Another feature lets you select an object/object in an image and change its position, angle or size.
It converts normal videos into slow-motion videos. When a video is playing, you have to hold the screen for the duration of the video you want to slow-motion, and the AI creates frames and inserts them between the actual frames to create a slow-motion effect.
Samsung keyboard
Samsung keyboard now has AI. It can correct your language and grammar, suggest multiple styles for texts, and translate language in real time. It can summarize text messages and suggest replies on your behalf. Text message compression is also possible (and it even works in Android Auto mode).
Samsung Notes get text compression and other features
Samsung has also developed a feature called Samsung Notes on Samsung Web or a feature that summarizes notes on webpage/article content. In Samsung Notes, your handwritten notes are converted into text and summarized in elegant-looking templates (bullet points or meeting styles) with attractive-looking text design styles. Galaxy AI can be used independently of the auto-format, language correction, summarization and translation features.
Web page summary on Samsung Internet
Samsung Web can condense entire articles or web pages and present that information in a condensed and easily digestible form. Language translation on web pages also works well with AI.
Voice to text transcribing, language translation and summarizing in voice recorder
Built-in voice recorder uses AI to transcribe text to voice. Apart from that, the text can also be translated into another language. It can identify ten people in a voice recording and tag their voices/sentences. Text can also be used to condense the contents of a voice recording into easy-to-understand blocks of text.
Wallpaper generator
One UI 6.1 has a wallpaper generator, and it lets you select some wallpaper templates and create new wallpapers based on your inputs and suggestions. You can name the background, color and subject for the wallpaper, and Galaxy AI will create the wallpaper based on your taste. It can also create weather effects for lock screen wallpaper.
Some of these features may come to existing high-end Galaxy smartphones with the One UI 6.1 update, but Samsung hasn't revealed which features will be compatible with its existing smartphones and tablets.