Cost Optimization
26 items tagged with "cost-optimization"
Best Practices7
AWS Well-Architected Framework
A set of cloud design principles and check-lists for building secure, high-performing, resilient, and efficient workloads on AWS.
Azure Well-Architected Framework
Microsoft’s five-pillar guidance (reliability, security, cost, performance, ops) for designing and operating workloads on Azure.
Capacity Planning
Forecasting future demand and provisioning resources ahead of need, combining organic growth, launches, and headroom to avoid both outages and waste.
AWS Well-Architected Sustainability Pillar
AWS guidance for reducing the environmental impact of cloud workloads by maximizing utilization, right-sizing, and choosing efficient regions, services, and hardware.
LLM Cost Optimization
LLM cost optimization reduces the spend of running language model applications through model selection, caching, prompt efficiency, and token-aware design without sacrificing quality.
Cloud Cost Allocation and Tagging
Cloud cost allocation and tagging is the FinOps practice of labeling cloud resources with consistent metadata so spend can be attributed accurately to teams, products, and environments.
Green Software Engineering
Green software engineering is the practice of building applications that are carbon-efficient, energy-efficient, and carbon-aware, reducing the environmental impact of software at every layer.
Anti-Patterns3
Over-Provisioning
Allocating far more compute, memory, or capacity than workloads need, wasting money for headroom that is rarely used.
Cloud Bill Shock
An unexpectedly huge cloud invoice arriving because spend was never tracked, attributed, or governed until the bill landed.
Log Everything (Logging Noise)
Logging indiscriminately at high verbosity, burying useful signal in a flood of low-value messages while driving up storage cost and slowing search.
Blueprints3
Oracle to PostgreSQL Migration Blueprint
Migrate an Oracle Database workload to PostgreSQL, converting PL/SQL, data types, and schema while preserving data integrity.
SQL Server to PostgreSQL Migration Blueprint
Migrate Microsoft SQL Server to PostgreSQL, converting T-SQL, data types, and schema to remove licensing cost.
Self-Hosted LLM to Managed Inference Blueprint
Migrate self-hosted GPU LLM serving to a managed inference API to cut operational burden while controlling cost, latency, and data governance.
Reference Architectures5
Batch and HPC on Azure
A scalable batch and high-performance computing platform on Azure Batch with spot compute, parallel storage, and a job scheduler.
Hybrid Cloud Bursting Platform
A hybrid platform that runs steady workloads on-premises and bursts peak demand to public cloud Kubernetes for elastic capacity.
LLM Gateway and Proxy on Kubernetes
A reference design for a self-hosted LLM gateway on Kubernetes that centralizes routing, rate limiting, cost tracking, and guardrails across multiple model providers.
LLM Observability Stack on Kubernetes
A reference design for an LLM observability platform on Kubernetes that captures traces, evaluations, cost, and quality signals across AI applications.
Self-Hosted Open LLM Inference on Kubernetes
A reference design for serving open-weight LLMs on Kubernetes with GPU autoscaling, continuous batching, and an OpenAI-compatible API.
Playbooks2
FinOps Cost Optimization Program Playbook
A phased program to establish FinOps practice, gain cloud cost visibility, and drive sustained savings through accountability and automation.
Cloud Cost and FinOps Program Playbook
A program to bring financial accountability to cloud spend through cost visibility, allocation, optimization, and continuous governance.
Checklists2
Cloud Cost Optimization Checklist
Systematically reduce cloud spend through visibility, rightsizing, commitments, and architectural changes without harming reliability.
LLM Cost Optimization Review Checklist
Review items for reducing the cost of an LLM application without degrading quality, covering prompts, caching, and model choice.
Benchmarks2
Cost-per-Request Benchmark
Measures the fully loaded cloud cost of serving a single unit of work, attributing compute, memory, network, and storage spend to throughput.
Cloud Egress Cost Efficiency Benchmark
Measures the cost and volume of data leaving cloud environments, attributing egress spend to flows, regions, and services to surface optimization targets.
Glossaries2
Spot Instance
A spot instance is spare cloud compute capacity offered at a deep discount that the provider can reclaim with little notice, suited to fault-tolerant and interruptible workloads.
Reserved Instance
A reserved instance is a cloud pricing model in which a customer commits to using compute capacity for a one- or three-year term in exchange for a significant discount over on-demand rates.