Enhanced AI Assistant on Android with PDF and Video Search Capabilities, Audio Analysis for Scam Call Alerts

The AI assistant on Android will now have the capability to search through PDFs and videos, among other functions. This enhancement makes it more convenient for users to inquire about information contained within those files. Additionally, there will be audio analysis to alert users of potential scam calls.

Accessing and browsing large PDFs and YouTube videos seems to be features that will require a Gemini Advanced subscription in part. These features also necessitate an active internet connection. The AI assistant operates based on context and recommends asking questions related to the video being viewed on YouTube. Similarly, when viewing a PDF, users can ask questions about the content of the file.

Furthermore, there will be a new feature that allows the AI assistant to listen to phone conversations directly on the device and provide real-time warnings if a call is suspected to be a scam. This functionality is available with the Gemini 1.0 Nano on Android devices. Both of these features will be integrated into Android 15, set to be launched in the upcoming fall season. Google is scheduled to share more information about the release of Android 15 on Wednesday.