Open Weight Models Are Turning Inference Into A Control Point

Fireworks, Baseten and Together AI raised $3.8B in four weeks. The funding proves inference is a control point, not that ...

Why the first GPU financiers are turning to inference chips in a $400 million deal

A $400 million chip-backed loan points to the next wave of AI infrastructure deals.

Tokenmaxxing And The Future Of AI Inference: The New Cost Curve

Companies should have a strong understanding of cost, reliability and latency before pushing billions of tokens.

Infinity Raises $15 Million in Seed Funding to Build the Software Layer That Makes Any AI Chip Inference-Ready

Infinity.inc (Infinity Artificial Intelligence Institute), an early-stage AI infrastructure research company building the software layer that makes any AI chip inference-ready, today announced it has ...
eWeek

Groq Raises $650M to Expand AI Inference Cloud After Nvidia Deal

Groq raised $650 million to expand its AI inference cloud after a Nvidia licensing deal, as demand for production AI compute grows.

Infinity raises $15M to run AI inference on any chipset

Early-stage AI infrastructure research company Infinity Inc. said it raised $15 million in seed funding to develop software ...

OpenAI and Broadcom announce chip designed for LLM inference at scale

OpenAI, the company behind ChatGPT and Codex and the models those tools use, and Broadcom, an established silicon supplier, have announced a new chip, called Jalapeño, designed specifically for large ...

OpenAI reportedly reduced inference costs by more than half

According to a media report, OpenAI engineers have found optimizations that reduce the cost of operating existing AI models by more than 50 percent.