What is Galaxy AI, what can it do, and how do I use it?

 What is Galaxy AI, what can it do, and how do I use it?



Some of the biggest news at the January 2024 Galaxy Unpacked event was the arrival of Samsung's Galaxy AI. This exciting new technology puts artificial intelligence capabilities in the palm of your hand. The feature initially launched on the Samsung Galaxy S24 series, but has made its way to older phones.

Samsung is no stranger to AI, having added AI-enabled voice control and interaction to its Bixby service. But Galaxy AI goes further, using more advanced capabilities that are only possible with generative AI to create and process text and images.

The questions remain. What is Galaxy AI, what can it do, and how can it be used?

First, a short Galaxy AI introduction

Galaxy AI can respond to text prompts with helpful answers like Google Gemini, OpenAI's GPT-4, Meta AI, and other generative AI models. These language skills make computers and phones easier to use and unlock abilities that were once out of reach. Galaxy AI can write messages for you, launch quick image searches, translate foreign languages, and more.

One of the latest additions to AI models is multimodal input, which means information to and from the model can be in shared in several different ways. For example, you could ask a multimodal AI to create a table from an image you upload. Since Galaxy AI can "see" photos, understand type-written commands, and use speech prompts to generate a response.

Samsung partnered with Google to add advanced capabilities to Galaxy AI using Google's Gemini Pro and Imagen 2, the latest and best AI models available.

Galaxy AI is actually a collection of different-sized models, with the smallest being able to run on your phone. However, some tasks require larger models for the best results, and those run in Google Cloud on a service called Vertex AI and require an internet connection.

The result is the same. Relatively quick AI assistance that helps you create more content and get more done with less effort.

What can Galaxy AI do?

Galaxy AI has many capabilities, and Samsung makes it available in several apps to enhance your experience.

Samsung Keyboard brings translation features to every app. Your Samsung Galaxy phone can even handle live translation of phone calls and messages. To use the live translation feature, the interpreter splits the screen with one side flipped, so your phone can translate for a person who speaks a different language.

Several photo editing features let you quickly fix problems like shadows and reflections. You can also change the position of objects in a photo or remove them as if they were never there.

Notes can be summarized with a tap, and Magic Compose helps you write messages with generative AI assistance. Photomoji makes messages fun and personalized with custom emojis created from your photos.

How to use Galaxy AI on your Samsung Galaxy phone

For the most part, Galaxy AI works with little-to-no effort. Photos automatically benefit from generative AI enhancement of 2x and 10x zoom levels and improved low-light pictures.

Other features are just a tap away, like Edit Suggestion, which offers quick fixes for common photo issues. Galaxy AI's Instant Slow-Mo, one of the few features limited to the Samsung Galaxy S24 and S23 lineup, lets you press and hold any video you record to generate more frames. With Generative Edit, tap or draw around a subject in a photo to delete it from the picture or move it to a new location.

After long pressing the home button, tap, circle, or scribble over anything on your screen to search Google for that image. If you see a Galaxy AI button near the bottom of the screen, tap it to access special features like creating a custom wallpaper, reformatting notes, and summarizing web pages.

What phones have Galaxy AI?

When Samsung first released Galaxy AI in early 2024, it was limited to the Samsung Galaxy 24 series phones. Fortunately, Samsung wasted no time releasing Galaxy AI on some of its other phones, tablets, and earbuds. Galaxy AI is available on:

  • Samsung Galaxy S24 series
  • Samsung Galaxy S23 series*
  • Samsung Galaxy S23 FE
  • Samsung Galaxy Z Fold 5
  • Samsung Galaxy Z Flip 5
  • Samsung Galaxy Tab S9 series
  • Samsung Galaxy Buds 2 and Buds 2 Pro
  • Samsung Galaxy Buds FE

Comments

Popular posts from this blog

Apple is launching new iPads May 7

Ray-Ban Meta smart glasses just got a huge AI boost and video calling support

New AirPods Point to a Hearing Aid Mode, Even More Health Tracking