AI ​

• AI Prompts
• The bfloat16 numerical format
• Independent analysis of AI language models and API providers
• What is 1 petaFLOPS equal to?

Google Gemini ​

• How Many Countries is Gemini Available in?
• What is Vertex AI and Gemini AI?
• What is Google colab?

Apple Intelligence ​

• What devices support Apple Intelligence?

SemiAnalysis ​

• TSMC’s 3nm Conundrum, Does It Even Make Sense? – N3 & N3E Process Technology & Cost Detailed

• How Nvidia’s CUDA Monopoly In Machine Learning Is Breaking - OpenAI Triton And PyTorch 2.0

• The AI Brick Wall – A Practical Limit For Scaling Dense Transformer Models, and How GPT 4 Will Break Past It

• Google AI Infrastructure Supremacy: Systems Matter More Than Microarchitecture

• Google "We Have No Moat, And Neither Does OpenAI"

• On Device AI – Double-Edged Sword

• Inference Race To The Bottom - Make It Up On Volume?

• Groq Inference Tokenomics: Speed, But At What Cost?

• Nvidia Blackwell Perf TCO Analysis - B100 vs B200 vs GB200NVL72

• Apple’s AI Strategy: Apple Datacenters, On-device, Cloud, And More

AI Playground ​

• grop playground
• openai playground
• Vertex AI Studio

karpathy ​

• llm.c
• llm.metal
• Reproducing GPT-2 (124M) in llm.c in 90 minutes for $20

CUDA ​

The NVIDIA® CUDA® Toolkit provides a development environment for creating high-performance, GPU-accelerated applications.

The toolkit includes GPU-accelerated libraries, debugging and optimization tools, a C/C++ compiler, and a runtime library.

cuDNN ​

The NVIDIA CUDA® Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks.

cuDNN provides highly tuned implementations for standard routines such as forward and backward convolution, attention, matmul, pooling, and normalization.

OpenMPI ​

The Open MPI Project is an open source Message Passing Interface implementation that is developed and maintained by a consortium of academic, research, and industry partners.

Metal ​

Metal powers hardware-accelerated graphics on Apple platforms by providing a low-overhead API, rich shading language, tight integration between graphics and compute, and an unparalleled suite of GPU profiling and debugging tools.

GPU Clouds ​

Google Cloud GPUs ​

Lambda ​

On-demand & reserved cloud NVIDIA GPUs for AI training & inference