Instance name,GPU Type,GPU Cost,GPU Total Cost,GPU number,GPU TDP,GPU Year,vCPU,CPU Type,CPU TDP,Total TDP (W),$/Hour,Memory
p6-b200.48xlarge,B200,"$50,000.00",400000,8,1000,2024,192,NVIDIA Grace CPU,666.6666667,1666.666667,113.93,2048 GiB
p5.4xlarge,H100,25000,25000,1,350,2022,16,AMD EPYC 7R13 Processor,75,425,6.88,256 GiB
p5.48xlarge,H100,25000,200000,8,2800,2022,192,AMD EPYC 7R13 Processor,900,3700,55.04,2048 GiB
p4d.24xlarge,A100,15000,120000,8,2400,2021,96,Intel Xeon Platinum 8275L,565.7142857,2965.714286,21.96,1152 GiB
p3.2xlarge,V100,"$11,000.00",11000,1,250,2018,8,Intel Xeon E5-2686 v4 (Broadwell),64.44444444,314.4444444,3.06,61 GiB
p3.8xlarge,V100,"$11,000.00",44000,4,1000,2018,32,Intel Xeon E5-2686 v4 (Broadwell),257.7777778,1257.777778,12.24,244 GiB
p3.16xlarge,V100,"$11,000.00",88000,8,2000,2018,64,Intel Xeon E5-2686 v4 (Broadwell),515.5555556,2515.555556,24.48,488 GiB
p2.xlarge,K80,"$4,000.00",4000,1,300,2014,4,Intel Xeon E5-2686 v4 (Broadwell),32.22222222,332.2222222,0.9,61 GiB
p2.8xlarge,K80,"$4,000.00",16000,4,1200,2014,32,Intel Xeon E5-2686 v4 (Broadwell),257.7777778,1457.777778,7.2,488 GiB
p2.16xlarge,K80,"$4,000.00",32000,8,2400,2014,64,Intel Xeon E5-2686 v4 (Broadwell),515.5555556,2915.555556,14.4,732 GiB
g6.xlarge,L4,"$5,000.00",5000,1,72,2023,4,AMD EPYC 7R13 Processor,18.75,90.75,0.8,16 GiB
g6.12xlarge,L4,"$5,000.00",20000,4,288,2023,48,AMD EPYC 7R13 Processor,225,513,4.6,192 GiB
g6.48xlarge,L4,"$5,000.00",40000,8,576,2023,192,AMD EPYC 7R13 Processor,900,1476,13.35,768 GiB
g6e.xlarge,L40S,"$2,500.00",2500,1,300,2022,4,AMD EPYC 7R13 Processor,18.75,318.75,1.86,32 GiB
,,,,,,,,,,,,
Price source: https://aws.amazon.com/ec2/pricing/on-demand/,,,,,,,,,,,,
GPU details: https://instances.vantage.sh/aws/ec2/,,,,,,,,,,,,