Test what others assume.

Alpha Experimental is an independent research lab for multimodal intelligence, accelerated computing, and open data systems. We run the tests ourselves and publish the code, methods, and raw numbers.

$376K
Google TPU Research Cloud compute grant
4
accelerator platforms benchmarked
2,000+
labeled video clips published
66
public repositories

On-device inference, measured

Methodology and raw logs: snapdragon-vs-m5, snapdragon-vs-mediatek

Gemma 3 1B Q4_0, prompt processing, llama.cpp GPU (tok/s)
Apple M55,604
Snapdragon X2 Elite1,921
Gemma 3 1B Q4_0, token generation, llama.cpp GPU (tok/s)
Apple M5144
Snapdragon X2 Elite75
Laptop NPU dense compute (GFLOP/s)
M5 ANE, int815,593
X2 HTP, fp1615,205
Phone NPU int8, 8-layer FC (GOPS)
Snapdragon 8 Elite4,307
Dimensity 9500s1,470

Research

01

Multimodality

Vision-language systems that judge content, not just caption it.

  • Visual-Qwen · CLIP + Q-Former + Qwen3 4B, 92% eval accuracy, trained on an H200
  • MicroMARC · vision-language model that flags cognitively degrading short-form video
02

Accelerated computing

One PyTorch workload, profiled across GPUs, TPUs, NPUs, and phones.

  • De-mystifying PyTorch for ASICs · accepted talk, PyTorch Conference Europe 2026
  • Edge silicon benchmarks · Apple M5, Snapdragon X2 Elite, Dimensity 9500s, head to head
  • will-it-asic · model compatibility across TPU, Trainium, Inferentia, and Gaudi
03

Data engineering

Datasets and pipelines built to be rerun, not just cited.

  • Multimodal Sludge Dataset · 2,000+ labeled video clips, published on Kaggle
  • ts-jobspy · job market scraper for LinkedIn, Indeed, Glassdoor, and ZipRecruiter
  • chorus-searxng · self-hosted private search with AI answer synthesis

Independent.

No vendor allegiance. We buy or rent the hardware we test.

Open.

Methods, code, and raw logs ship with every result.

Measured.

Claims come from benchmarks we ran, not spec sheets.

People

Alpha Romer Coma
Founder
LinkedIn ↗
Marc Olata
Founding Member
LinkedIn ↗

Contact

Have a claim worth testing?

alpha@alphaexperimental.org