News for hackers. Stuff that matters.
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by kbolino on Wednesday August 20, 2025 @01:15PM (#44963844)
The problem is that VPC endpoints aren't free.

They should be, of course, at least when the destination is an AWS service in the same region.

[edit: I'm speaking about interface endpoints, but S3 and DynamoDB can use gateway endpoints, which are free to the same region]

Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by otterley on Wednesday August 20, 2025 @01:21PM (#44963905)
Gateway endpoints are free. Network endpoints (which are basically AWS-managed ENIs that can tunnel through VPC boundaries) are not free.

S3 can use either, and we recommend establishing VPC Gateway endpoints by default whenever you need S3 access.

(Disclaimer: I work for AWS, opinions are my own.)

Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by JoshTriplett on Wednesday August 20, 2025 @03:29PM (#44965436)
That's fascinating! I hadn't found that in the documentation; everything seems to steer people towards PrivateLink, not gateway endpoints.

Would you recommend using VPC Gateway even on a public VPC that has an Internet gateway (note: not a NAT gateway)? Or only on a private VPC or one with a NAT gateway?

Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by otterley on Wednesday August 20, 2025 @03:36PM (#44965508)
I recommend S3 Gateways for all VPCs that need to access S3, even those that already have routes to the Internet. Plus they eliminate the need for NAT Gateway traversal for requests that originate from private subnets.
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by JoshTriplett on Wednesday August 20, 2025 @09:02PM (#44968071)
> I recommend S3 Gateways for all VPCs that need to access S3, even those that already have routes to the Internet.

Fascinating. What's the advantage of doing that?

Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by donavanm on Thursday August 21, 2025 @03:22AM (#44970021)
It's a much more direct/efficient connection from the EC2 instance to the S3 storage servers through the virtual network layer. It reduces the network path/length through the AWS network _and_ removes the number of virtual network functions/servers (ala "LB") that your connections will traverse.
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by JoshTriplett on Thursday August 21, 2025 @01:51PM (#44975869)
That's helpful to know, thank you! I'll take a look at that and see if it improves S3 performance.
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by paulddraper on Wednesday August 20, 2025 @05:14PM (#44966547)
> everything seems to steer people towards PrivateLink, not gateway endpoints

Gateway endpoints only work for some things.

Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by Hikikomori on Wednesday August 20, 2025 @05:38PM (#44966783)
Privatelink endpoints can be of type gateway or interface. Only gateway is free and only S3 and dynamodb supports it.
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by kbolino on Wednesday August 20, 2025 @01:34PM (#44964055)
Fair point, and valid for S3 (the topic at hand) and DynamoDB.

Other AWS services, though, don't support gateway endpoints.

Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by mdaniel on Wednesday August 20, 2025 @05:37PM (#44966770)
https://docs.aws.amazon.com/AmazonECR/latest/userguide/vpc-e...

~~I get the impression there are several others, too, but that one is of especial interest to me~~ Wowzers, they really are much better now:

  aws --region us-east-1 ec2 describe-vpc-endpoint-services | jq '.ServiceNames|length'
  459
If you're saying "other services should offer VPC Endpoints," I am 100% on-board. One should never have to traverse the Internet to contact any AWS control plane
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by watermelon0 on Thursday August 21, 2025 @01:08AM (#44969224)
Those are VPC endpoints, not gateway endpoints.
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by kbolino on Thursday August 21, 2025 @08:52AM (#44972139)
Both interface endpoints and gateway endpoints are also called VPC endpoints. The former get distinct IP addresses in your VPC subnets while the latter get distinct entries in your VPC routing tables. They are even created with the same API call: https://docs.aws.amazon.com/AWSEC2/latest/APIReference/API_C...
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by paulddraper on Wednesday August 20, 2025 @01:17PM (#44963868)
Well yeah that's the point....why route through the public internet.
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by kbolino on Wednesday August 20, 2025 @01:22PM (#44963923)
I doubt the traffic ever actually leaves AWS. Assuming it does make it all the way out to their edge routers, the destination ASN will still be one of their own. Not that the pricing will reflect this, of course.

The other problem with (interface) VPC endpoints is that they eat up IP addresses. Every service/region permutation needs a separate IP address drawn from your subnets. Immaterial if you're using IPv6, but can be quite limiting if you're using IPv4.

Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by immibis on Wednesday August 20, 2025 @06:12PM (#44967076)
Sounds like a good reason to use IPv6.
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by kbolino on Wednesday August 20, 2025 @08:13PM (#44967817)
There were still a couple of services/features that choked on IPv6 last time I looked (1.5-2 years ago) but it works with most things and they do seem to be making progress on the others.
Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by paulddraper on Thursday August 21, 2025 @12:09AM (#44968952)
I don’t know any software that doesn’t work with IPv6 as of 2021.

Just some internet services that haven’t upgraded. (But fixed by NAT.)

Re:AWS in 2025: The Stuff You Think You Know That's Now Wrong by kbolino on Thursday August 21, 2025 @09:37AM (#44972638)
There's a matrix provided by Amazon themselves listing the level of IPv6 support in their various services: https://docs.aws.amazon.com/vpc/latest/userguide/aws-ipv6-su...