What is Galaxy AI, what can it do, and how do I use it?

 What is Galaxy AI, what can it do, and how do I use it?



Some of the biggest news at the January 2024 Galaxy Unpacked event was the arrival of Samsung's Galaxy AI. This exciting new technology puts artificial intelligence capabilities in the palm of your hand. The feature initially launched on the Samsung Galaxy S24 series, but has made its way to older phones.

Samsung is no stranger to AI, having added AI-enabled voice control and interaction to its Bixby service. But Galaxy AI goes further, using more advanced capabilities that are only possible with generative AI to create and process text and images.

The questions remain. What is Galaxy AI, what can it do, and how can it be used?

First, a short Galaxy AI introduction

Galaxy AI can respond to text prompts with helpful answers like Google Gemini, OpenAI's GPT-4, Meta AI, and other generative AI models. These language skills make computers and phones easier to use and unlock abilities that were once out of reach. Galaxy AI can write messages for you, launch quick image searches, translate foreign languages, and more.

One of the latest additions to AI models is multimodal input, which means information to and from the model can be in shared in several different ways. For example, you could ask a multimodal AI to create a table from an image you upload. Since Galaxy AI can "see" photos, understand type-written commands, and use speech prompts to generate a response.

Samsung partnered with Google to add advanced capabilities to Galaxy AI using Google's Gemini Pro and Imagen 2, the latest and best AI models available.

Galaxy AI is actually a collection of different-sized models, with the smallest being able to run on your phone. However, some tasks require larger models for the best results, and those run in Google Cloud on a service called Vertex AI and require an internet connection.

The result is the same. Relatively quick AI assistance that helps you create more content and get more done with less effort.

What can Galaxy AI do?

Galaxy AI has many capabilities, and Samsung makes it available in several apps to enhance your experience.

Samsung Keyboard brings translation features to every app. Your Samsung Galaxy phone can even handle live translation of phone calls and messages. To use the live translation feature, the interpreter splits the screen with one side flipped, so your phone can translate for a person who speaks a different language.

Several photo editing features let you quickly fix problems like shadows and reflections. You can also change the position of objects in a photo or remove them as if they were never there.

Notes can be summarized with a tap, and Magic Compose helps you write messages with generative AI assistance. Photomoji makes messages fun and personalized with custom emojis created from your photos.

How to use Galaxy AI on your Samsung Galaxy phone

For the most part, Galaxy AI works with little-to-no effort. Photos automatically benefit from generative AI enhancement of 2x and 10x zoom levels and improved low-light pictures.

Other features are just a tap away, like Edit Suggestion, which offers quick fixes for common photo issues. Galaxy AI's Instant Slow-Mo, one of the few features limited to the Samsung Galaxy S24 and S23 lineup, lets you press and hold any video you record to generate more frames. With Generative Edit, tap or draw around a subject in a photo to delete it from the picture or move it to a new location.

After long pressing the home button, tap, circle, or scribble over anything on your screen to search Google for that image. If you see a Galaxy AI button near the bottom of the screen, tap it to access special features like creating a custom wallpaper, reformatting notes, and summarizing web pages.

What phones have Galaxy AI?

When Samsung first released Galaxy AI in early 2024, it was limited to the Samsung Galaxy 24 series phones. Fortunately, Samsung wasted no time releasing Galaxy AI on some of its other phones, tablets, and earbuds. Galaxy AI is available on:

  • Samsung Galaxy S24 series
  • Samsung Galaxy S23 series*
  • Samsung Galaxy S23 FE
  • Samsung Galaxy Z Fold 5
  • Samsung Galaxy Z Flip 5
  • Samsung Galaxy Tab S9 series
  • Samsung Galaxy Buds 2 and Buds 2 Pro
  • Samsung Galaxy Buds FE

Comments

Post a Comment

Popular posts from this blog

Apple is launching new iPads May 7

Image
  Apple is launching new iPads May 7: Here's what to expect from the 'Let Loose' event We're likely to see an OLED iPad Pro and new iPad Air, as well as updated peripherals. Apple has scheduled its next product showcase for May 7, a few weeks before the Worldwide Developers Conference  gets under way . While the company is, as usual, being a bit coy about what's on deck, the signs are all there. It had been rumored for months that Apple would refresh its iPad lineup in May. Sure enough, the image on the announcement for this "Let Loose" event includes an illustration of a hand holding an Apple Pencil. Various reports over recent months have offered some insight as to what Apple has up its sleeves. So, with that in mind, here's what to expect from the upcoming iPad event: It's been about 18 months since Apple updated any of its iPads, so its tablet lineup is due for a refresh. It won't exactly come as a surprise to see Apple slot M3 chips into ...
Read more

Ray-Ban Meta smart glasses just got a huge AI boost and video calling support

Image
  Ray-Ban Meta smart glasses just got a huge AI boost and video calling support What you need to know In an expansive update, Meta rolled out multimodal AI support and video call capabilities to Ray-Ban Meta smart glasses users. Multimodal AI is in beta for all U.S. and Canadian users, while video call support is rolling out gradually. Earlier, Meta quietly added Apple Music as a supported service in the Meta View app, allowing for hands-free control. Meta is also adding a new frame option called Skyler and a low-bridge option for Headliner frames. x yz Meta spent the last week reminding everyone in the tech industry that it is a force to be reckoned with when it comes to AI. The company recently launched a new Llama 3 AI model and integrated Meta AI into its core apps. Now, the Meta AI experience on its Ray-Ban smart glasses is getting upgraded to multimodal AI, putting it in the same league as new AI hardware products like the Humane AI Pin and Rabbit R1.  The com...
Read more

New AirPods Point to a Hearing Aid Mode, Even More Health Tracking

Image
 New AirPods Point to a Hearing Aid Mode, Even More Health Tracking Commentary: With iOS 18 around the corner, will AirPods get another hearing health option? Apple's AirPods  have always received useful features with software updates and with  iOS 18 expected to be announced at WWDC  on June 10, AirPods could get even more health options. Apple has  heart health  features with the  Apple Watch , mobility with  walking steadiness-detection  on the iPhone and safety with fall detection and  emergency SOS  to name a few. But I think the AirPods could be another way Apple inches even further into health.  New AirPods Point to a Hearing Aid Mode, Even More Health Tracking. In this week's episode of One More Thing (embedded above), I take a look at all the rumors about the upcoming AirPods, including a potential hearing aid mode that may launch with iOS 18. In the future, maybe AirPods could integrate even more sensors such as an E...
Read more