A year ago at London Tech Week, NVIDIA founder and CEO Jensen Huang and U.K. Prime Minister Keir Starmer made a declaration: the U.K. would be an AI maker, not an AI taker. At this year’s event, NVIDIA and its partners are showcasing how that commitment is producing real momentum across the nation’s infrastructure, startups […]
A Deep Dive into Calibration of Language Models: Platt Scaling, Isotonic Regression, Temperature Scaling
# Introduction A model that says it is 90% confident should be right 90% of the time. When that relationship breaks down, you get a miscalibration problem. The model’s scores stop telling you anything useful about reliability. For large language models (LLMs), miscalibration is widespread. A 2024 NAACL survey found that confidence scores diverge […]
We Should Train AI to Betray Its Users
The dilemma employee at an engineering company but have uncovered a deadly secret. Your company is performing ill-advised engineering activities that have already killed six contractors in a landslide. Despite this the company is pressing ahead, creating risks of further landslides, a catastrophic dam breach and/ or groundwater contamination. Instead of dealing with the problem, […]
Is this the dawn of the Tokenpocalypse?
Microsoft recently announced major pricing changes for GitHub Copilot — changes that were drastic enough that a Reddit user said their company has started calling it the Tokenpocalypse. On the latest episode of TechCrunch’s Equity podcast, Kirsten Korosec, Sean O’Kane, and I discussed what those changes might mean for the larger AI ecosystem. After all, […]
