GPU

9 items tagged with "gpu"

Filter by type:

Stacks2

vLLM + Ray Serve

A high-throughput LLM serving stack combining vLLM's optimized inference engine with Ray Serve for scalable, multi-replica deployment.

Stack

Triton Inference Server

A high-performance model-serving stack using NVIDIA Triton to serve models from any framework with GPU optimization on Kubernetes.

Comparisons1

Comparison

CPU vs GPU Inference

CPUs and GPUs both run ML inference. GPUs excel at parallel, large-model workloads; CPUs are cheaper and simpler for small models and low concurrency.

Benchmarks6

Benchmark

Geekbench

Cross-platform benchmark measuring single-core and multi-core CPU performance plus GPU compute, widely used to compare phones, laptops, and servers.

Benchmark

MLPerf Training

Industry-standard benchmark suite measuring how fast hardware and software systems train machine-learning models to a fixed target quality.

Benchmark

MLPerf Inference

Benchmark suite measuring how fast and efficiently systems serve trained ML models under realistic latency and throughput constraints.

Benchmark

SPECviewperf

Standard benchmark measuring professional graphics-workstation performance running real CAD, visualization, and content-creation application viewsets.

Benchmark

3DMark

Cross-platform graphics benchmark suite measuring GPU and gaming performance through standardized rendering tests and synthetic feature tests.

Benchmark

Unigine Superposition

GPU stress and benchmark tool using a detailed real-time scene to measure graphics performance, stability, and thermal behavior.