Skip to content

aws-forks/amazon-efs-workshop

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

132 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Amazon Elastic File System (Amazon EFS)

Workshop

Version 2018.11

efs.wrkshp.2018.11


© 2018 Amazon Web Services, Inc. and its affiliates. All rights reserved. This work may not be reproduced or redistributed, in whole or in part, without prior written permission from Amazon Web Services, Inc. Commercial copying, lending, or selling is prohibited.

Errors or corrections? Email us at [email protected].


Table of Contents

Prerequisites

1. Create

2. Monitor

3. Performance

4. Accessible

5. Scale-out


Workshop

This workshop designed to help you better understand the performance characteristics of Amazon Elastic File System (Amazon EFS) and how parallelism, I/O size, and Amazon EC2 instance types affects file system IOPS and throughput. You will also gain an understanding of the different performance and throughput modes a file system can be using.

Prerequisites [optional]

This section is an AWS Cloudformation template that will create two Amazon VPCs with Internet gateways, security groups, and routing tables to create isolate networks for this workshop. It is highly recommended to setup these prerequisites. If you decide to use your own VPCs, make sure they don't have overlapping CIDR blocks, allow traffic within the default security group, and allow SSH access from your laptop.

Click on the link below to go to the Pre-requisites section. Once you've finished that section, move on to Create.

Prerequisites

1. Create

This section is a guide to create two Amazon EFS file systems using default performance and throughput modes.

Click on the link below to go to the Create workshop. Once you've finished that workshop move on to Monitor.

Create

2. Monitor

This section is a guide to setup an AWS CloudWatch dashboard with widgets to help monitor how your workload is driving an Amazon EFS file system. Once you've finished that workshop, move on to Performance.

Click on the link below to go to the Monitor section.

Monitor

3. Performance

This section is a set of scripts that will demonstrate:

  • different instance types provide different levels of network performance when accessing a file system
  • different I/O sizes (block sizes) and sync() freqencies (the rate data is persisted to disk) effects file system throughput
  • increasing the number of threads accessing a file system will increase IOPS and throughput

Click on the link below to go to the Performance workshop. Once you've finished that workshop move on to Accessible.

Performance

4. Accessible

This section is a set of steps to test accessibility over a VPC-peering connection and from Amazon Workspaces.

Click on the link below to go to the Accessible workshop. Once you've finished that workshop move on to Scale-out.

Accessible

5. Scale-out

This section is a Cloudformation template that will create an Amazon EC2 spot fleet and download objects in parallel from an Amazon S3 bucket.

Click on the link below to go to the Scale-out workshop.

Scale-out

6. Tear-down

This section will remind you to delete all the AWS resources you created for this workshop.

Click on the link below to go to the Tear-down workshop.

Tear-down

Troubleshooting

For feedback, suggestions, or corrections, please email me at [email protected].

License

This library is licensed under the Amazon Software License.

About

This workshop will show solutions architects how to take advantage of a petabyte scale distributed file system for various application workloads like analytics, web serving & content management, enterprise applications, and Docker containers.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors