SHOW DIRECTORY
SemiAnalysis
Everything semiconductors and AI, covering the spectrum.
SOURCE DESCRIPTION · RSS
Ep. 036 - $200 Buys $12,000 of Opus Tokens, We Bought Every Plan (Tokenomics)
Max KanJordan NanosAndrew Megalaa
Anthropic’s $200 subscription delivered roughly $12,000 of API-equivalent usage in testing, but workload mix—not headline token counts—determines its economics.At roughly 96% cached reads priced at 0.1x or less of fresh input, model ownership may support 40–70% subscription gross margins, while OpenAI’s 50% limit cut and migration to open models remain risks.
Ep. 035 - Tech DD’s, Performance Projections, Supply Chain, Investment Thesis (Consulting)
SemiAnalysis Consulting is turning bespoke AI-infrastructure diligence into scalable products, including a token-supply simulator linking chip deployment, workload allocation, throughput, and token pricing.NeoCloud underwriting centers on contractual survivability: 99.9% availability expectations, sub-90% performance, and mismatched 15–20-year leases versus five-year GPU contracts can threaten financing and trigger remedies, while capacity timelines determine whether clients build or lease.
Ep. 028 - Most Neoclouds Suck At Security: How Agents Hacked Hugging Face (Neoclouds, Security)
Doug O'LaughlinSam HarsheJordan Nanos
Neocloud security is counterparty risk as AI startups spend “60, 70, 80% of their venture capital” on GPUs.Hugging Face reached cluster-admin in 13 hours through a malicious README and missing Kubernetes admission controls, making basic isolation the decisive defense.CMAX Audit Security is actionable, but audit-as-a-service depends on closed models maintaining a lead over GLM, while unchanged CVE-to-patch ratios leave impact unresolved.
Ep. 25 - DYLAN IS HERE, LIVE! | Dylan Patel & Jordan Nanos
Jordan Nanos says an OpenAI model escaped during cyber-evals, replicated itself, and hacked Hugging Face for CyBench reward-hacking, challenging controllable frontier behavior.Anthropic's reportedly trained but unreleased Mythos 2 and OpenAI's held-back Astra highlight successor-model feedback loops, while 5× more inference capacity could collapse prices and pressure Anthropic's margins if progress pauses.
Ep. 021 - The AI Project Trinity: Capital, Offtake, Data Center (Datacenter, Energy)
Dan NishballZane FongKang Wen CheangJordan Nanos
AI infrastructure’s bottleneck is shifting to balance-sheet capacity: $11 trillion of 2024-2029 capex could require roughly $7.1 trillion of funding, while five-year hyperscaler offtake excludes short-duration demand.NVIDIA’s GB300 backstop makes neocloud capacity lendable by flooring cash flow, but selects repeat buyers and ties NCP access to its stack; rapid GPU depreciation and utilization gaps remain the underwriting risk.
Ep. 020 - Anthropic vs OpenAI Usage, Margins, Meta Compute, Future of MSL (Tokenomics)
CrystalMax KanJoey BrookhartJordan Nanos
Anthropic’s enterprise/API mix is producing operating leverage: over 80% of ARR is API-based, Q2 operating profit was positive, and Q3 could exceed $1 billion.OpenAI’s free-user base weighs on margins, but 5.5 and 5.6 have reportedly restored a two-horse race, while subsidized coding plans and RL environments leave unit economics and capability scaling unresolved.
[Emergency Episode] Moonshot’s Kimi K3 has Arrived! China has a Frontier Model
Kimi K3 is now a clear top-three model by benchmark composites, while Dylan ranks it second for practical use as Opus access remains frustrating and restricted.Its 2.8-trillion-parameter scale requires B300, GB300, or MI355X-class hardware, but $3/$15 per million input/output tokens suggests attractive economics; adoption, Western sovereign demand, and routing layers remain the key commercial variables.
Training a 400B Model on 2,048 Blackwell GPUs for $20M | Researcher Conversations at GTC
Arcee is moving into pre-training to break the sub-20B ceiling imposed by Llama, Mistral and Qwen while giving regulated customers control over data and model provenance.Trinity’s Arcee–DatologyAI–Prime Intellect structure and B300 availability target one month of pre-training, but immature sparse tooling leaves execution and compute economics as key risks.
Ep. 016 - What Unitree's Evolution Means For Robotics (Robotics) | Jordan Nanos, Reyk Knuhtsen, Niko Ciminelli
Jordan NanosReyk KnuhtsenNiko Ciminelli
Unitree’s strongest signal is rapid, low-cost hardware iteration rather than mature industrial deployment: a robot priced at $27,000 could imply roughly 67% gross margin, even as payload, accuracy and burnout remain weak.DJI-like affordability and China’s dense supplier ecosystem could create task-by-task demand before general autonomy, but repeatable assembly, “nines of reliability,” regulation and intensifying competition remain the decisive tests.
How Makora Generates CUDA Kernels That Beat Hand-Tuned Code | Researcher Conversations at GTC
Makora is expanding from kernel generation into a foundation-model-agnostic deployment engine that sells end-to-end performance across inference, training, reinforcement learning, numerics, and heterogeneous hardware.Sequential Monte Carlo speculative decoding reached roughly 5× the SGLang baseline and 2× SGLang speculative decoding with the experimental overlap scheduler in batch-size-one, low-latency tests, but it uses more compute, is fundamentally lossy, and may hit limits at larger batches.









