CES 2025: Qualcomm Launches AI On-Prem Appliance and Inference Suite

Qualcomm Technologies, Inc. announced the next evolution of the Qualcomm Aware™ Platform. This cloud-based services platform is set to revolutionize the development of IoT solutions by adding observability, monitoring, and location capabilities to intelligently connected devices across various industries, including logistics, retail, energy, smart home, robotics, and more.

  • Enhanced IoT Solutions: Qualcomm Aware adds observability, monitoring, and location services to enable the development of IoT solutions that meet specific needs and challenges of consumers and enterprises across a wide range of industries and use cases.
  • Pre-Integrated Software: By pre-integrating Qualcomm Aware software across select Qualcomm Technologies and third-party processors, Qualcomm Technologies will provide a simple, fast, and cost-effective mechanism for developers and enterprises to access data on the state, health, status, and location of device deployments.

As a key component of the broader IoT Solutions Framework, Qualcomm Aware will eventually be pre-integrated across select Qualcomm Technologies chipsets and third-party hardware. This integration adds significant value for OEMs and ODMs, enterprise users, distributors, retailers, and consumers.

Qualcomm Aware serves as a horizontal enablement platform, offering a highly integrated way to add cloud-based observability and insights, geolocation, fine indoor positioning, firmware updates, and device management services to connected devices. This means that device manufacturers can unlock new insights on the connected devices they sell and take preventative actions to fix and troubleshoot devices.

The platform’s capabilities extend to various industries:

  • Retailers: Understand how often high-value inventory turns over and receive alerts if items are stolen.
  • Distributors: View delivery efficiency and accuracy metrics for their fleets.
  • Consumers: Extend the longevity of devices by ensuring they are always equipped with the latest software, operating system, and features.

Qualcomm also announced the Qualcomm® AI On-Prem Appliance Solution, an on-premises desktop or wall-mounted hardware solution, and the Qualcomm® AI Inference Suite, a set of software and services for AI inferencing spanning from near-edge to cloud. These new offerings allow small and medium businesses, enterprises, and industrial organizations to run custom and off-the-shelf AI applications on their premises, including generative workloads. Running AI inference on premises can deliver significant savings in operational costs and overall total cost of ownership (TCO), compared to renting third-party AI infrastructure.

  • Qualcomm AI On-Prem Appliance Solution: A dedicated on-premises hardware solution that enables generative AI inference and computer vision workloads, allowing sensitive customer data, fine-tuned models, and inference loads to remain on premises.
  • Qualcomm AI Inference Suite: Provides ready-to-use AI applications and agents, tools, and libraries for operationalizing AI from computer vision to generative AI, spanning across on-premises solutions and cloud deployments.
  • Industry Support: Aetina, Honeywell, and IBM are among the first wave of industry leaders supporting the AI On-Prem Appliance and AI Inference Suite.

Using the AI On-Prem Appliance Solution in concert with the AI Inference Suite, customers can now leverage generative AI with their proprietary data, fine-tuned models, and technology infrastructure to automate human and machine processes in various environments, such as retail stores, quick service restaurants, shopping outlets, dealerships, hospitals, factories, and shop floors.

Our new AI On-Prem Appliance Solution and AI Inference Suite change the TCO economics of AI deployment by enabling processing of generative AI workloads from cloud-only to a local, on-premises deployment. For a wide variety of AI automation use cases such as in-store assistants, worker coaching, site-specific information, safety compliance, and sales and service enablement at stores, dealerships, or factory floors, our AI On-Prem Appliance Solution significantly reduces AI operational costs for enterprise and industrial needs.
Enterprises can now accelerate deployment of generative AI applications leveraging their own models, with privacy, personalization, and customization while remaining in full control, with confidence that their data will not leave their premises.

Nakul Duggal, Group General Manager for Automotive, Industrial IoT, and Cloud Computing, Qualcomm Technologies, Inc.

The Qualcomm AI On-Prem Appliance Solution is powered by the Qualcomm® Cloud AI roadmap of accelerators. It combines the accessibility and performance of a datacenter inference server with the power efficiency, weight, form factor, data privacy, personalization, and control of an on-premises AI solution. The AI On-Prem Appliance Solution supports a wide range of capabilities:

Camera AI: Includes image, video, and streaming processing for computer vision applications focused on security, safety, and site monitoring.

Scalability: From a standalone desktop product to a wall-mounted appliance cluster providing local AI services like voice agents in-a-box, offload of small language models (SLM), large language models (LLM), and large multimodal models (LMM), and retrieval augmented generation (RAG) functions for intelligent indexed search and summarization, agentic AI, AI workflow automation, image generation, code generation, computer vision, and camera processing.

Model Support: Supports a wide range of generative AI, natural language processing, and computer vision models, both open-source and proprietary, to enable workflow automation for many enterprise applications such as intelligent multi-lingual search, custom AI assistants and agents, code generation, automated drafting and note-taking, and more.

With these groundbreaking advancements, Qualcomm is poised to lead the next wave of innovation in AI and IoT, transforming industries and enhancing the way we live and work.

Subscribe

Related articles

Microsoft Steps Back as OpenAI Takes Control of CoreWeave Agreement

Microsoft's decision to pass on the $12 billion CoreWeave agreement and allow OpenAI to take the reins has sparked significant discussion in the tech world. This move, while surprising to some, reflects a strategic shift in how Microsoft is managing its AI investments and partnerships.

Plex fans might not be happy with the latest updates

Plex has announced it will have much to say...

Go fishing this weekend with Free Play Days

This weekend's Free Play Days offers you a chance...

Microsoft Teams Up with Musk, BlackRock, and MGX for a $30B Data Center Gamble

Microsoft’s latest venture—a $30 billion data center project in partnership with Elon Musk’s xAI, BlackRock, and UAE-based MGX—feels like a plot twist straight out of a dystopian novel. On paper, it’s a bold move to dominate the AI infrastructure race. In reality, it’s a tangled web of questionable alliances and potential PR disasters waiting to happen.

The EU Calls Out Apple and Google’s Half-Hearted Compliance with its Digital Markets Act

The European Union has once again donned its superhero cape, swooping in to rescue us from the clutches of Big Tech's monopolistic tendencies. This time, the EU has outlined specific steps for Apple and Google to comply with the Digital Markets Act (DMA), a regulation that was supposed to make digital markets fairer and more competitive. But let’s be honest—Apple and Google have been dragging their feet since the DMA was established, and the EU is finally calling them out.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

WP Twitter Auto Publish Powered By : XYZScripts.com