Samsung Brings Multimodal Generative AI to Galaxy ✨

PLUS: AI-powered Galaxy Ring, Use Artifacts with GPT-4o, Gemini 1.5 Pro, Llama 3

Today’s top AI Highlights:

1. Samsung releases new generative AI features powered by Google’s Gemini

2. Generate, test, and evaluate prompts in Anthropic’s Developer Console

3. Microsoft and Apple drop their observer from OpenAI’s board

4. First-ever opensource LLM designed for the semiconductor industry

5. Use Claude’s Artifacts with GPT-4o, Gemini 1.5 Pro, Llama 3 and other AI models

& so much more!

Read time: 3 mins

Latest Developments 🌍

Samsung Brings New Generative AI Features to its Device 🪄

Samsung wrapped its Unpacked Event 2024 yesterday, revealing the next generations of Z Fold and Flip phones, Galaxy buds, watch, and the highly-anticipated Samsung Ring. Throughout the event, AI took centre stage integrating into every product through Galaxy AI powered by Google’s Gemini AI model. Here’s a bite of everything AI that was announced:

1. Samsung Health app is now powered by Galaxy AI to not just track vitals like sleep, heart rate, and activity levels but also interpret them to give you meaningful and actionable insights. For eg., a new index called Energy Score will give you a personalized snapshot of your body’s readiness for the day when you wake up, and suggests if you’re well rested, should balance, or need to take it easy.

2. Galaxy Ring: Call it the AI wearable for health. Priced at $399, it is designed to be worn 24/7 to track your health and vitals throughout day and night and feed the information to Samsung Health to give you personalized insights.

3. Galaxy Watch Ultra: Designed for athletes and fitness enthusiasts, it is powered by WatchOS in partnership with Google to integrate AI. It can help plan your workouts and trainings strategically. It also has the first-of-its-kind sensors for detecting signs of sleep apnea, approved by the US FDA.

4. Galaxy Buds3 Pro: Besides the better sound clarity, these buds understand if you’re wearing the buds loosely or tightly, and adjust the sound waves accordingly to give clear and immersive audio.

5. New Generative AI features in Galaxy AI in the new Galaxy Z6 series phones:

   1. It enables multimodal interactions, powered by Google’s Gemini AI model. Be it Circle to Search, translating text in an image, solving math problems, or asking questions about YouTube videos.

   2. Composer is your AI writing assistant with contextual relevance. Give it a text or a voice prompt and it’ll draft your email or message replies.

   3. Samsung Notes now has a voice recorder. You can record, and Galaxy AI can transcribe and summarize it. Transcription can separate up to 10 individual speakers.

   4. Sketch-to-Image - When you sketch on a blank canvas, Galaxy AI understands what you want to sketch and it’ll generate images in different styles. This also works in Photos where you can sketch within images and embed real-life objects in it.

   5. Photo Assist in your gallery can identify portraits and recommend how you can imagine them in different styles.

   6. Live Translate designed primarily for phone calls, can now translate 16 languages on-device, without internet. It will also be available in popular messaging and calling third-party apps. Interpreter designed for real-time face-to-face translation will also power live voice-to-voice translation with Galaxy Buds.

   7. Hybrid approach - Some features like Live Translate and Interpreter are handled on-device. On-device AI builds a knowledge graph for each user, learning from your usage over time to provide tailored services. Other generative AI features that require intensive processing are done on the cloud. Galaxy AI also gives you the option to choose which features you want to be processed on-device only.

6. New AI features for Camera and Wallpaper in Galaxy Z Flip 6:

   1. Camera in the phone uses AI to detect objects, identify lighting conditions, isolate delicate facial features to enhance and sharpen them, and make the image more natural.

   2. When capturing images hands-free, Auto-Zoom finds the best scene for your shot by detecting the subject and making necessary adjustments to capture the perfect picture without your involvement.

   3. AI makes wallpapers interactive and even adaptive. The wallpapers automatically change the brightness and background according to the lighting conditions around you and even the weather.

Evaluate Prompts in Anthropic’s Developer Console 📝

Prompt quality significantly impacts the results of your AI applications. To help you craft the perfect prompts and speed the development process, Anthropic Console now offers features to generate, test, and evaluate prompts within a streamlined workflow. This eliminates manual testing and comparison across different platforms.

Key Highlights:

1. Prompt Generation and Testing -

   1. Simply describe the task you want your AI application to perform (e.g., “Summarize customer feedback”).

   2. The Console leverages Claude 3.5 Sonnet to generate an effective prompt and automatically creates test cases with relevant input data to evaluate its performance.

2. Test Suite -

   1. Create and manage extensive test suites in the Console. You can manually input test cases, import them in bulk, or ask Claude to auto-generate test cases for you with the ‘Generate Test Case’ feature.

   2. You can even view and adjust Claude’s understanding of the generation requirements for each variable.

3. Compare and Iterate Prompts -

   1. Create multiple prompt versions, execute the entire test suite with a single click, and directly compare outputs side-by-side to see the impact.

   2. You can also have subject matter experts grade response quality on a 5-point scale to see whether the changes you’ve made have improved response quality.

Quick Bites 🤌

1. Microsoft has relinquished its observer seat on OpenAI’s board, a position it held for less than eight months. Apple too was initially slated to appoint an observer on OpenAI’s board, but has also opted out. OpenAI will now engage with Microsoft and Apple through regular stakeholder meetings. (Source)

2. OpenAI has partnered with one of the United States’ leading national laboratories, Los Alamos National Laboratory, to study how AI can be used safely by scientists conducting bioscience research. The focus is to evaluate how AI models with multimodal capabilities can assist scientists with laboratory tasks. (Source)

3. US-based company Aitomatic which builds autonomous AI agents for industries, has introduced SemiKong, the first-ever opensource LLM specifically designed for the semiconductor industry. It has greater accuracy and relevance than generic LLMs like GPT and Llama 3 on industry-specific tasks. It is available for download on HuggingFace and GitHub. (Source)

😍 Enjoying so far, share it with your friends!

Tools of the Trade ⚒️

1. Artifacts with other LLMs: Claude Sonnet 3.5 Artifacts is now available to use with GPT-4o, Gemini, and Llama-3. Abacus AI’s ChatLLM playground gives access to all leading AI models in one place for just $10 a month, with no usage cap and artifacts with them.

2. Julius AI Workflows: Execute complex, multi-step data analyses using pre-built AI-powered templates to automate the entire flow. Streamline data analysis tasks like visualization, statistical testing, forecasting, and more without any coding.

3. Reworkd AI: A web scraping tool that automatically extracts and structures data from websites according to your specifications. You can use it to collect large amounts of data from multiple websites without writing code.

4. Awesome LLM Apps: Build awesome LLM apps using RAG for interacting with data sources like GitHub, Gmail, PDFs, and YouTube videos through simple texts. These apps will let you retrieve information, engage in chat, and extract insights directly from content on these platforms.

---

Hot Takes 🔥

1. I know it's become fashionable to go "gen AI is a bubble" and "where's the revenue" with Goldman Sachs and Sequoia and more, but like GPT-4 came out barely a year ago and we've barely unwrapped the new data centers, so can y'all just give it a minute!? ~
   Rohit Krishnan

2. You don't imprison a baby because he might grow into a criminal, but that's what lawmakers are trying to do with AI. ~
   Pedro Domingos

---

Meme of the Day 🤡

Source

That’s all for today! See you tomorrow with more such AI-filled content.

Real-time AI Updates 🚨

⚡️ Follow me on Twitter @Saboo_Shubham for lightning-fast AI updates and never miss what’s trending!

PS: I curate this AI newsletter every day for FREE, your support is what keeps me going. If you find value in what you read, share it with your friends by clicking the share button below!