Honestly, Intel just has to build a GPU with insane amount of VRAM. It doesn't even have to be the fastest to compete... just a ton of vram for dirt cheap
Fair... Hopefully it's consumer friendly. AI absolutely allows new companies to compete in the GPU context, but it's a surprise that no one has made an expansion card for AI usage. Computers have the PCIE slots for that purpose.
It’s gonna be what, 273GB/sec vram bandwidth at most? Might as well as buy an AND 395+ 128GB right now for the same inference performance and slightly less VRAM.
If its fast LPDDR5x (9600 MT/s) with 512 bit bus width (8 64bit channels (actually multiples of quad 16 bit subchannel nonsense)) it could be upwards of 600 GB/s. Lots of bandwidth like the beefy macs have.
1. 600GB/sec is still slow as hell. You might as well as use regular DDR5 RAM then if you're so slow, you can spec regular system DDR5 RAM faster than 600GB/sec. The half decade old consumer 3090 is 1.5x that speed. The current 5090 is 1,792 GB/s. The current nvidia datacenter cards are 8 TB/s. What's the point of having lots of VRAM if your system RAM is faster?
For context: if you have a 160GB dense ML model in VRAM and you're just running 600GB/sec, you can do... roughly 4 tokens per second AT BEST. That massive amount of VRAM is unusable if it's slow.
2. 512 bit LPDDR5x is most likely just 512GB/sec with typical LPDDR5x that's not overly expensive. I would be HIGHLY surprised if they gave it the more expensive RAM that'd break 600GB/sec. The Intel B60 is at 456 GB/s and that's using GDDR6.
Honestly, you're better off waiting for regular DDR6 to come out in a year and just build a system using that.
Slow is better than nothing. A card with this much VRAM in a "prosumer" price range would be really interesting right now for workstation, to work with big models.
What's the point of this card that's going to be released around the same time as DDR6, and DDR6 will be faster? Might as well as use cheaper system RAM if you system RAM is slower than VRAM.
