Language Models with Unlimited Context 🧠
PLUS: Real AI Assistant for Browsing, AI-powered Recruiting on LinkedIn
Before we get started, we want to thank our sponsor Shortwave.
Meet your AI executive assistant: Shortwave AI Assistant that transforms your email experience with 24/7 availability, language versatility, and a range of productivity-enhancing capabilities.
With AI-enhanced search, get hidden insights buried in your email history, streamlining research and transforming data into actionable insights.
Craft perfect emails effortlessly with the AI, from composing replies to fine-tuning drafts, and even scheduling meetings, with style adaptation.
Streamline email management by easily querying email threads, translating content, and integrating various features for seamless multitasking.
Today’s top AI Highlights:
Streaming LLMs for Infinite Sequence Lengths
Most Comprehensive Robotic-learning Dataset by Google DeepMind
The Real AI Assistant for Browsing
New AI Features in LinkedIn
& so much more!
Read time: 3 mins
Latest Developments 🌍
LLMs for Endless Conversations 💬
Deploying LLMs in streaming applications, like multi-round dialogues, is challenging due to memory consumption and the inability to handle longer texts than their training sequence length. Researchers introduce an attention sink phenomenon to address this.
Key Highlights:
StreamingLLM is an efficient framework to enable LLMs trained with a finite attention window to handle infinite sequence lengths without the need for fine-tuning.
The context window of LLMs remains unchanged with StreamingLLM, and only the most recent tokens and attention sinks are retained, allowing the model to process the latest tokens based on its initial pre-training.
It enables models like Llama-2, MPT, Falcon, and Pythia to efficiently perform language modeling with up to 4 million tokens or more. In streaming settings, it achieves up to a 22.2x speedup compared to the sliding window recomputation baseline.
Biggest, Most Comprehensive Robotics Dataset 🤖
Google DeepMind, in collaboration with 33 academic labs, has created the Open X-Embodiment dataset and RT-X model, aiming to train general-purpose robots that can adapt to various robot types and tasks.
Key Highlights:
This most comprehensive robotics dataset includes data from 22 different robot types, encompassing over 500 skills and 150,000 tasks from more than 1 million episodes.
RT-X models derived from RT-1 and RT-2, trained on the Open X-Embodiment dataset, achieve a remarkable 50% improvement in performance and the ability to acquire new skills not present in their original datasets.
The RT-2 model showcases an extraordinary threefold performance boost on real-world robotic tasks, stemming from knowledge transfer facilitated by diverse training data from multiple robot embodiments.
How Should AI Browse the Internet? 🕸️
In a bid to transform web browsing using AI, The Browser Company introduces Arc Max, a suite of AI-powered features powered by a combination of GPT-3.5 and Anthropic.
Key Highlights:
Arc Max includes features such as automatic tab title and download renaming, making web navigation more efficient and user-friendly.
Users can now ask ChatGPT questions directly from the Arc Command Line, get short summaries and previews of web pages on hover, and also query AI when the standard page search doesn't yield results.
Smarter Recruiting and Learning with AI on LinkedIn 🙋♀️
LinkedIn has unveiled a series of AI-powered enhancements across its platform leaning on OpenAI and Microsoft’s technology, ranging from recruitment to marketing and sales.
Key Highlights:
Recruiter 2024 is a generative AI to assist recruitment professionals in refining candidate searches using conversational language and providing unexpected suggestions.
AI-driven LinkedIn Learning Coach will offer personalized advice and course recommendations, initially focusing on soft skills while leveraging LinkedIn's extensive learning catalog.
Accelerate is an AI-powered marketing tool to simplify campaign management within the LinkedIn ecosystem, though with limitations beyond the platform's borders.
Tools of the Trade ⚒️
Visily: AI-powered wireframing and design tool for easy creation of stunning software wireframes and prototypes from hand-drawn sketches, app & website screenshots, text prompts or built-in templates.
Rewind Pendant: A wearable AI device that captures what you say and hear in the real world and then transcribes, encrypts, and stores it entirely locally on your phone.
Nara: AI-driven sales assistant that helps SMBs automate sales and support, providing personalized recommendations and 24/7 customer assistance.
PresetAI: AI-powered private knowledge base chatbot for intelligent developer support, documentation search, and developer activity analysis.
Layerbrain: Human language interface for software. Execute tasks with any software, data, or API using only natural language without any coding.
😍 Enjoying so far, TWEET NOW to share with your friends!
Hot Takes 🔥
I'm trying to raise $20mill to put a H100 on a necklace so you can run your AI models from anywhere ~ anton
people who want to start a company have almost nothing in common with people who want to run a company ~ anu
When you actually look at LLM training code you realise that banning open source AI is basically banning math smh ~ Emad Mostaque
Meme of the Day 🤡
That’s all for today!
See you tomorrow with more such AI-filled content. Don’t forget to subscribe and give your feedback below 👇
Real-time AI Updates 🚨
⚡️ Follow me on Twitter @Saboo_Shubham for lightning-fast AI updates and never miss what’s trending!!
PS: I curate this AI newsletter every day for FREE, your support is what keeps me going. If you find value in what you read, share it with your friends by clicking the share button below!