Intel Integrates AI and Arc Graphics: Cornerstones of Its Latest Laptop CPUs

The unveiling of Intel’s recent iteration of the Meteor Lake mobile chip architecture has been a long-anticipated journey, making the announcement of the actual chips somewhat underwhelming. Particularly for the average consumer, this release doesn’t present compelling reasons to actively engage with AI, although the primary objective remains centered around enticing software developers and vendors.

My colleague Stephen Shankland and I have already covered the new low-power E-core, which is intended to run light sustained workloads (think video streaming) without hitting the battery as much as the regular old E-cores. We understand why this AI push is so important to Intel’s business. We know how Intel rebranded the Meteor Lake chips as Core Ultra. The chips are made using the company’s latest Intel 4 process. And Intel is last to the announcement party; AMD and Qualcomm have already planted their flags.

While the new chips have a small, two-core neural processing unit, or NPU, for AI acceleration, Intel’s AI Boost uses the CPU and GPU as well, depending upon the type of workload: The CPU is used when speed is needed and the GPU for help with generative AI workloads.

That’s why you’ll hear Intel and AMD talk about AI performance metrics — TOPS, sometimes referred to as TeraOPS, or trillion operations per second — for the combined system rather than just the NPU. For the Ultra 7 165H chip, you get roughly up to 34 TOPS with 11 TOPS for the NPU, 18 TOPS for the GPU and the rest for the CPU.

In comparison, AMD says its XDNA in the new Ryzen 8040 series performs at 39 TOPS, attributing 16 TOPS to the NPU and the remainder to the CPU and GPU. So even though NPUs are getting big buzz, they actually only carry a small part of the AI workload in these chips.

But these numbers also only paint a part of the performance picture for AI, because AI there’s no “typical” AI workload and at the moment no consistent methods of implementing it  — there’s still a lot of shakin’ going on in the software.

 

 

The Ultra chips inside

Today’s chips will be shipping in a lot of laptops by the end of the month, with preorders starting today. Their specs and positioning will make way for a different class of chip and laptop announcements at CES.

The usual cavalcade of companies are on board, so be ready for new and refreshed laptops from Intel’s partners including the Swift Go 14 (starting at $800 with a Core Ultra 5 and up to an Ultra 7) and the Predator Triton Neo 16 gaming laptop (with up to a Core Ultra 9 and GeForce RTX 4070, starting at $1,500). The top end of each line of the Ultra 9, Ultra 7 and Ultra 5 will ship a little later: Laptops with those chips should be available around March.

Intel continues its recent tradition of planting the H series flag in the middle of the road. It’s for when you need a little more power than you can get with the U series, which is built for the thinnest designs. H series chips are for systems where you want discrete-ish graphics and are willing to trade off power for a little more weight.

To attain the coveted Evo Edition branding, denoting systems equipped with a plethora of cutting-edge technologies, the prerequisite for inclusion will revolve around the utilization of a Core Ultra processor.

Intel has maintained a rather subdued stance regarding battery life discussions. However, indications suggest a potential increase of up to 25%. While any boost in battery life is commendable, it’s likely that Intel-based laptops might still fall behind the standards set by MacBooks, perpetuating a familiar sentiment of disappointment.

One of the more compelling reasons to look for one of the new Core Ultra H or U series in your next laptop, is the updated integrated graphics engine. The H series will incorporate Intel’s latest generation of Arc graphics, which finally brings the company’s integrated graphics into the 2020s, and means it might be able to take on AMD’s Radeon integrated graphics. (They’ll hopefully get faster thanks to the new 700M used in the just-announced Ryzen 8040 series laptop processors.)

Both the Arc graphics and the updated (but even more generically dubbed) “Intel Graphics” based on the next generation of Xe GPU cores — LPG — improve support for the Endurance Gaming mode. That’s Intel’s way of making you think the performance is better by using AI-augmented upscaling (XeSS, similar to Nvidia’s DLSS) to reduce the amount of power gaming takes at the expense of quality. It upscales starting at a particularly low resolution.

The new iGPUs also add support for DirectX 12 Ultimate, which means they support modern technologies like raytracing and mesh shaders — in other words, higher-quality graphics. The Xe cores also have a faster version of its DP4A engine, which helps with GPU acceleration of AI for certain types of calculation.

 

Mobile H- and U-series processors

The more powerful Arc GPUs require systems with a minimum of 16GB memory, which may put a lower limit on prices. Intel makes a big deal about how much better the Arc performance is than its older GPU, but really, there’s no way it couldn’t improve on the previous generation.

Every generation brings new related capabilities. Not all laptops will support all the new features in this case, but they change the specs you should be looking for.

Core Ultra laptops are set to incorporate Wi-Fi 6E support as a standard feature integrated into the silicon. However, while a select few will debut with Wi-Fi 7 capabilities, this offering remains scarce at launch. Wi-Fi 7, being a nascent technology, pledges enhanced stability, increased bandwidth, and reduced channel congestion by leveraging the 5 and 6MHz bands characteristic of 6E. While I’ve encountered some hiccups in 6E signal detection, its operational speed surpasses that of Wi-Fi 6/5, heightening my anticipation for Wi-Fi 7.

The revamped networking functionalities also encompass support for Bluetooth 5.4, introducing novel features over its predecessor, Bluetooth 5.3. Notably, bidirectional communications constitute a significant addition, potentially elevating the spectrum of device-to-device interactions offered by Bluetooth.

We’re currently engaged in reviewing the Acer Swift Go, aiming to provide insights into how this year’s offerings stack up against their predecessors. Stay tuned for more in-depth comparisons and evaluations in our upcoming review.