Strong Consistency in S3 and Cloud Block Store

From my armchair in the past few weeks, I have been watching the myriad of announcements at re:Invent by AWS and a few things caught my eye (well a lot of things did, but a few in particular to storage).

The first thing to note was the change in the consistency model in S3. Up until now, consistency was “eventual” within S3 for certain operations like changes to a file, and there are a ton of posts that do a great job of explaining this. One is below:

https://dhruvsharma-50981.medium.com/s3-eventual-data-consistency-model-issues-and-tackling-them-47093365a595

Google “S3 eventual consistency” and you will find tons of examples.

At a high level, when modifying or deleting objects the change may not be immediately reflected. So on an immediate subsequent read, you may not get what you wrote. For busy environments with high change rates/modifications this could lead to corruption. So you needed to understand the behavior and build to or around it.

At re:Invent, AWS announced that strong consistency is now supported for S3 operations:

https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-read-after-write-consistency/

https://aws.amazon.com/s3/consistency/

What you write is what you get. Fantastic!

So what does this have to do with Cloud Block Store? Read on.

Continue reading “Strong Consistency in S3 and Cloud Block Store”

Can Pure make cloud storage better?

Cloud Block Store is now GA! About a year ago, we announced our intentions–to bring Purity (the OS for the FlashArray) to AWS. I wrote a post about it here:

https://www.codyhosterman.com/2018/11/announcing-pure-storage-cloud-block-store-for-aws/

In the past 10 months I have been pretty focused on learning AWS. Not just how to use it, but more importantly, how others are using it. It has been a fun ride–definitely already incorporated some of my learnings into my solution work for on-premises integration and have some cool stuff coming. A lot of my work has been of course on using it, how to deploy EC2, how to deploy VMware Cloud on AWS, managing S3, CloudFormations, IAM, SSM, using the billions of other services in AWS. But much of my focus has been on listening to what people have seen, learned, and want to do with public cloud. AWS and the like have had a decent amount of runway now, so there have certainly been some lessons learned.

Continue reading “Can Pure make cloud storage better?”

Pure Storage at VMworld 2014

A lot of activity coming up this year at VMworld 2014 and Pure Storage has a large part in it. Between our booth, staffing presence, tons of sessions and 1:1 meetings there aren’t any steps we are missing. This will be my 7th VMworld and from a storage perspective I have never been more excited! A lot in store by VMware (notably vVols) and Pure has some great demo we are working on as well.

ps_vmworld14_header_landing_04.2

Continue reading “Pure Storage at VMworld 2014”

The EMC Enterprise Private Cloud 2.0

Increasingly, organizations, small and large, are attempting to or at least considering to implement some type of cloud-based architecture into their IT infrastructure. The benefits of tight integration, intelligent abstraction of resources, seamless automation and orchestration are becoming quite apparent. These benefits and the desire to obtain them are causing customers and partners to look at vendors such as EMC for such a solution. Importantly, a solution that doesn’t require re-invention of the wheel or painstaking initial setup.

cloud

Continue reading “The EMC Enterprise Private Cloud 2.0”