AWS Official Blog

Last week I spoke to a technically-oriented audience at the Pacific Northwest PHP Conference. As part of my talk, I described cloud computing as a mix of technology and business, and made my point by talking about Spot instances. The audience looked somewhat puzzled at first, but as I explained further I could see their eyes light up as they started to think about the ways that they could save money for their companies by way of creative coding!

Earlier this year I wrote about the Spot Fleet API, and showed you how to use it to manage thousands of Spot instances with a single call to the RequestSpotFleet function. Today we are introducing a new “allocation strategy” option for that API. This option will allow you to create a Spot fleet that contains instances drawn from multiple capacity pools (a set of instances of a given type, within a particular region and Availability Zone).

As part of your call to RequestSpotFleet, you can include up to 20 launch specifications. If you make an untargeted request (by not specifying an Availability Zone or a subnet), you can target multiple capacity pools within an AWS region. This gives you access to a lot of EC2 capacity, and allows you to set up fleets that are a good match for your application.

You can set the allocation strategy to either of the following values:

• lowestPrice – This is the default strategy. It will result in a Spot fleet that contains instances drawn from the lowest priced pool(s) specified in your request.
• diversified – This is the new strategy, and it must be specified as part of your request. It will result in a Spot fleet that contains instances drawn from all of the pools specified in your request, with the exception of those where the current Spot price is above the On-Demand price.

This option allows you to choose the strategy that most closely matches your goals for each Spot fleet. The following table can be used as a guide:

If you create a fleet using the diversified strategy and use it to host your web servers, it is a good idea to select multiple pools and to have a fallback option in case all of them become unavailable.

Diversified allocation works really well in conjunction with the new resource-oriented bidding feature that we launched last month. When you use resource-oriented bidding and specify diversified allocation, each of the capacity pools in your launch specification will include the same number of capacity units.

To make use of this new strategy, simply include it in your CLI or API-driven request. If you are using the CLI, simply add the following entry to your configuration file:

"AllocationStrategy": "diversified"

If you are using the API, specify the same value in your SpotFleetRequestConfigData.

This option is available now and you can start using it today.

— Jeff;

Many AWS applications use Elastic Load Balancing to distribute traffic to a farm of EC2 instances. An architecture of this type is highly scalable since instances can be added, removed, or replaced in a non-disruptive way. Using a load balancer also gives the application the ability to keep on running if an instance encounters an application or system problem of some sort.

Today we are making Elastic Load Balancing even more useful with the addition of two new features: support for all ports and additional fields in access logs.

Support for All Ports
When you create a new load balancer, you need to configure one or more listeners for it. Each listener accepts connection requests on a specific port. Until now, you had the ability to configure listeners for a small set of low-numbered, well-known ports (25, 80, 443, 465, and 687) and to a much larger set of ephemeral ports (1024-65535).

Effective today, load balancers that run within a Virtual Private Cloud (VPC) can have listeners for any port (1-65535). This will give you the flexibility to create load balancers in front of services that must run on a specific, low-numbered port.

You can set this up in all of the usual ways: the ELB API, AWS Command Line Interface (CLI) / AWS Tools for Windows PowerShell, a CloudFormation template, or the AWS Management Console. Here’s how you would define a load balancer for port 143 (the IMAP protocol):

To learn more, read about Listeners for Your Load Balancer in the Elastic Load Balancing Documentation.

Additional Fields in Access Logs
You already have the ability to log the traffic flowing through your load balancers to a location in S3:

In order to allow you to know more about this traffic, and to give you some information that will be helpful as you contemplate possible configuration changes, the access logs now include some additional information that is specific to a particular protocol. Here’s the scoop:

• User Agent – This value is logged for TCP requests that arrive via the HTTP and HTTPS ports.
• SSL Cipher and Protocol – These values are logged for TCP requests that arrive via the HTTPS and SSL ports.

You can use this information to make informed decisions when you think about adding or removing support for particular web browsers, ciphers, or SSL protocols. Here’s a sample log entry:

2015-05-13T23:39:43.945958Z my-loadbalancer 192.168.131.39:2817 10.0.0.1:80 0.000086 0.001048 0.001337 200 200 0 57 "GET https://www.example.com:443/ HTTP/1.1" "curl/7.38.0" DHE-RSA-AES128-SHA TLSv1.2

You can also use tools from AWS Partners to view and analyze this information. For example, Splunk shows it like this:

And Sumo Logic shows it like this:

To learn more about access logging, read Monitor Your Load Balancer Using Elastic Load Balancing Access Logs.

Both of these features are available now and you can start using them today!

— Jeff;

Amazon Route 53 is a highly available and scalable Domain Name System (DNS) web service. Route 53 connects user requests to infrastructure running in AWS (EC2 instances, load balancers, and S3 buckets), and can also be used to route users to infrastructure outside of AWS. You can configure Route 53 to perform periodic health checks, and to fail over to alternate endpoints should a check fail. You can also create a monitoring & alerting system for your websites and applications using the health checks.

Today we are adding two new types of health checks: calculated and latency measurement.

Calculated Health Checks
You can now combine the results of multiple Route 53 health checks into a single value using Boolean operations (AND, OR, and NOT). This allows you to create a single health check that combines the results of other checks in a useful way. For example, I have three web sites on the same EC2 instance. I’ll start by creating health checks for each one:

Next I’ll create a calculated health check that represents the overall health of the instance:

As you can see from the screen shot, I could also choose to create a health check that would report as healthy as long as a certain number (perhaps 2 out of 3) of the other health checks were also healthy. This would avoid false alarms and would allow me to take one site down for maintenance without causing this health check to fail.

While my example checked three different domains that happened to be running on the same instance, this is not a constraint. You could check multiple website components that happened to be on the same domain but managed by different administrative groups within your organization. Or, you could check multiple domains that supply web services to your app, and then roll up the results into a single check that represents the state of your dependencies.

Latency Measurement Health Checks
You can also configure Route 53 to measure and report on metrics that affect latency: TCP connection time, time to first byte, and (for SSL connections) the time to complete the SSL handshake. The first one indicates how long it takes Route 53 to establish a connection to the endpoint; the second one indicates the overall time until the first byte of data is returned. The third measures the time it takes to set up an SSL connection, an operation which involves 2 round-trips.

The latency measurement is performed as a part of the health check, and (if you check on Latency graphs) reported to CloudWatch.

Here’s how you configure latency measurement when you are setting up a health check:

The results are visible in the Console:

You can view the results with respect a single AWS region by selecting it from menu (a blended result is shown by default). You can also see the individual metrics (currently 32 per endpoint) in the CloudWatch console:

Available Now
The new health checks are available now and you can start using them today. Take a look at the Route 53 Pricing page to learn more about pricing for health checks.

— Jeff;

In the guest post below, my colleagues Bryan Nairn and Niko Pamboukas list some options for those of you who are still running your applications on Windows Server 2003.

— Jeff;

As many of you may already know, on July 14th 2015 Microsoft ended its extended support for Windows Server 2003. Microsoft has published and maintains a support lifecycle for their operating systems to provide clarity on the availability of support for their products.  Once an operating system gets to a certain age, and extended support comes to an end, Microsoft stops issuing security and other updates.

Twelve years have passed since the original release of Windows 2003 and there are still a large number of businesses running critical applications and workloads on the Windows Server 2003 family of products.  If you are one of these organizations still running Windows 2003 based workloads, you are not alone.  Some industry experts estimate that there are more than 10 million servers running 2003 today.  Some of these workloads are virtualized, however many of them are installed on bare metal.  In many cases these workloads are running on the original hardware and the underlying physical servers are close to the end of their useful life.

The latest hardware currently available in the market may not necessarily be compatible with Windows Server 2003, thus making your purchasing decisions complex.  Likewise, migration to a newer operating system version will likely require the purchase of new hardware, as the newer system will not necessarily contain all the drivers for the existing hardware.

This can present challenges for you, and many other organizations like yours, when considering what to do with your Windows Server 2003 infrastructure.  We understand that it takes time to plan and execute a migration, and we are here to help.  Whether you are maintaining 32-bit applications in the cloud, moving to a modern Microsoft Windows Server operating system or rewriting legacy applications, AWS can provide you with production-ready options for migration planning.

Here are some ideas and resources to help you to assess, plan and execute on your migration strategy for Windows Server 2003.

Move Your 32-bit Apps to the Cloud
It’s a common misconception that you cannot run 32-bit applications in the cloud. Amazon Elastic Compute Cloud (EC2) offers 32-bit instances that you can leverage today. You can start with our 32-bit Windows Server 2003 or Windows Server 2008 Amazon Machine Images (AMIs) or you can use VM Import to bring your own Windows virtual machines images in to EC2. These options give you the breathing room you need to stay on 32-bit while you work on additional migration options for your applications.

You can also run your 32-bit applications on 64-bit instance types. This will give you additional options, including access to more than 4 GB of memory via PAE. In order to take advantage of this feature, you’ll need to contact AWS Developer Support.

Migrate to a Modern Operating System
If you are currently running 32-bit Windows 2003 or 2008 EC2 instances but are ready to migrate, now is the perfect time to get onto the latest version. AWS supports in-place upgrades from Windows 2003 to newer Windows operating systems; you can find the details for how to perform OS upgrades by visiting the EC2 Windows upgrade documentation page. As described in the documentation, this process updates the network driver on the instance so that it can be accessed via Remote Desktop after the OS has been upgraded.

Modernize Legacy Apps
When you are ready to start the process of modernizing legacy Windows Server 2003 applications, you can find the right resources for your needs with just a few clicks. AWS has an extensive partner network to help migrate applications to newer versions of Windows. The AWS Windows and .NET Developer Center provides tools, documentation, and code samples. The AWS SDK for .NET (which includes its own library, code samples, and Visual Studio templates) makes it easy to build your applications on Windows and .NET. If you are a Visual Studio user, it’s easy to get started with the SDK using the AWS Toolkit for Visual Studio. You can find more info on the EC2 Developer Resources page. You can also get connected and join the community of developers running Windows and .NET on AWS by visiting our Community Forum or AWS on Github.

If you need help with the migration of your Windows Server 2003 applications, AWS offers various levels of support including technical documentation, the AWS Support Center, and access to qualified AWS partners. AWS partners specialize in cloud migration services; they are ready to help you assess what applications need to move, identify any risks, gaps and/or modifications needed to migrate smoothly even when migrating unsupported applications without redeploying.

AWS as a Platform for Your Needs
In addition to Windows Server 2008 and Windows Server 2012 being more secure and supported software solutions, your move from on-premises infrastructure to the cloud can bring additional benefits: the AWS cloud has been architected to provide a cost effective, flexible and secure cloud computing environment. Since you can provision resources as your business dictates and you only pay for what you use, the cost savings of migrating to AWS can be significant. In addition, Amazon Virtual Private Cloud provides you with an additional layer of security by enabling you to create your own logically isolated networks, which you can provision your resources into. With VPC you can specify your IP range, decide which instances are exposed to the internet and which remain private.

Start Today
As I mentioned earlier, now’s a great time to start the planning process and we are here to help you. We anticipate that you will have questions and may want some help with this, so to get started read our essential Windows Server 2003 FAQ as well as the Windows Servers Server 2003 End-Of-Support page which cover many more details on this transition. We realize that your migration away from Windows Server 2003 can be challenging, hopefully AWS can be there to help ease this transition.

— Bryan Nairn (Senior Product Manager) and Niko Pamboukas (Senior Product Manager)

Let’s take a quick look at what happened in AWS-land last week:

New & Notable Open Source

• redshift-udfs contains SQL for many helpful Redshift UDFs.
• cfn-flow is a command-line tool for developing CloudFormation templates and deploying stacks.
• s3-backup-script tars up local files and folder, dumps a MySQL database, and uploads the resulting files to S3.
• md5s3stash implements content-addressable storage in S3.
• PhotoEncryptionInCloud is an Android app that stores encrypted photos in AWS.
• auto-simple-calculator is an auto-pilot for the AWS Simple Monthly Calculator.
• aws-cloudwatch-chart is a Node module that draws charts for CloudWatch metrics.
• awsqr generates QR codes for AWS MFA logins.
• grails-aws is an AWS plugin for Grails.
• NFLX-Security-Monkey monitors policy changes and alerts on insecure configurations in an AWS account.

New Customer Success Stories

• Essent -Handling high volumes of data from smart meters.
• JustGiving -Test & production environments and big data analytics.
• Major League Baseball Advanced Media (MLBAM) – big data processing (17 petabytes per season):
  • MLBAM Builds New Player Tracking System on AWS.
  • MLBAM and the Business Value of Using AWS.
  • MLBAM and the Power of Innovation Possible on AWS.
• Nextdoor -Private social network for neighborhoods.
• Ohpen -Mutual fund platform for banks.
• RedMart -Site and fulfillment center software hosting.
• RoZetta Technology – Big data storage, management, and analytics.

New SlideShare Content

• Fred Hutchinson Cancer Research Center: Cloud On-Ramp Project Briefing.
• Security Best Practices.
• AWS for Startups.
• Amazon EC2 Container Service.
• Scaling the Platform for Your Startup.

New YouTube Videos

• AWS Loft Talks – Benefits of the PaaS Approach to IoT.
• AWS Loft Talks – An Engineer’s Tour of the Internet of Things.
• Getting Started with AWS Directory Service.

New Marketplace Applications

• Slemma – BI.
• Haivision Media Gateway – Media.
• DeepSQL 5.6, Release 3.2  (MySQL 5.6 + DeepSQL plugin 3.2) – Databases.
• Alfresco One Enterprise 5.0.1 – Content Management.
• Conductor – Databases.
• Lumis Portal 8.1.1 – Free version (Portuguese) – Content Management.
• ProcessMaker Open Source Edition powered by Bitnami – BPM.
• Nuxeo Content Management Platform – Content Management.
• Barracude Message Archiver – Storage.

Upcoming Events

• September 14-18 – Live Event (New York) AWS Professional Services Delivery Best Practices Bootcamp.
• September 15 – Webinar – Building Your First Big Data Application on AWS.
• September 15 – Webinar – Infrastructure Deployment and Monitoring with AWS Lambda and Amazon SNS.
• September 15 – Webinar – Getting Started with DynamoDB Streams.
• September 16 – Webinar – Meet Regulatory Storage Requirements with Amazon Glacier Vault Lock.
• September 17 – Webinar – Running Microservices with Amazon EC2 Container Service.
• September 17 – Webinar – Visual Effects Rendering in the AWS Cloud with ThinkBox.
• September 17 – Webinar – Build Cross-Platform Mobile Apps with AWS and the New Xamarin SDK.
• September 22 – Webinar – Scientific Computing in the Cloud: Speeding Access for Drug Discovery – with APN Partner Avere Systems and customer H3 Biomedicine.
• September 24 – Meetup (Warszawa, Poland) – AWS User Group Poland.
• October 1 – Meetup (South Bend, Indiana) – Michiana AWS Meetup.
• AWS re:Invent – Sold out, register for the live stream!

Upcoming Events at the AWS Loft (San Francisco)

• September 14 – AWS Bootcamp: Architecting Highly Available Applications (10 AM – 6 PM).
• September 16 – ClearScale Customer Showcase + Premier Partner Party (6 PM – 9:30 PM).
• September 17 – The Right Tool for the Right Job on AWS (4 PM – 8 PM).
• September 22 – Accelerating to the Hybrid Cloud and Reaping the Rewards (6 PM – 9 PM).
• September 23 – Amazon Launchpad: Paving the Way for Startups to Launch on Amazon (11:30 AM – 2:30 PM).
• September 25 – TechNode San Francisco Demo Day (10 AM – 5 PM).
• September 28 – AWS Bootcamp: Taking Operations to the Next Level (10 AM – 6 PM).
• September 29 – Funding Options for Growing Technology Companies (6 PM – 7:30 PM).
• September 30 – Onshape Users (6 PM – 8:30 PM).
• October 1 – Market Differentiators and Elements of API Management plus The Developer Experience – Accelerating Growth (6 PM – 9 PM).
• October 21 – Intro to Using AWS and the Alexa Skills Kit to Build Voice Driven Experiences + Open Hackathon (10 AM – 3 PM).

Upcoming Events at the AWS Loft (New York)

• September 14 – Chef Bootcamp: A Taste of Chef on AWS (10 AM – 6 PM).
• September 15 – Chef Bootcamp: A Taste of Chef on AWS (10 AM – 6 PM).
• September 16 – Chef Bootcamp: A Taste of Chef on AWS (10 AM – 6 PM).
• September 17 – Chef Bootcamp: A Taste of Chef on AWS (10 AM – 6 PM).
• September 18 – Network with Amazon Business Leaders from NYC Area (6 PM – 9 PM).
• September 24 – Intro to Using AWS and the Alexa Skills Kit to Build Voice Driven Experiences + Open Hackathon (10 AM – 3 PM).
• September 24 – The Life of a Click: How Hearst Publishing Manages Clickstream Analytics with AWS (3 – 4 PM).
• September 24 – How to Implement Top 10 AWS Security Best Practices – Day Workshop with Evident.io (10 AM – 2 PM).
• September 24 – How to Implement Top 10 AWS Security Best Practices – Evening Session with Evident.io (6:30 PM – 8:30 PM).
• September 28 – Onshape Users (6 PM – 8:30 PM).
• October 1 – Behind the Scenes with LearnBop – Bulletproof Blue/Green Deployments – Myths, Pitfalls and Solutions (6:30 PM – 8 PM).

Help Wanted

• This Week’s Cloud Computing Jobs (Cloud Academy).
• AWS Careers.

Stay tuned for next week! In the meantime, follow me on Twitter and subscribe to the RSS feed.

— Jeff;

The Amazon Redshift team is on a tear. They are listening to customer feedback and rolling out new features all the time! Below you will find an announcement of another powerful and highly anticipated new feature.

— Jeff;

Amazon Redshift makes it easy to launch a petabyte-scale data warehouse. For less than $1,000/Terabyte/year, you can focus on your analytics, while Amazon Redshift manages the infrastructure for you. Amazon Redshift’s price and performance has allowed customers to unlock diverse analytical use cases to help them understand their business. As you can see from blog posts by Yelp, Amplitude and Cake, our customers are constantly pushing the boundaries of what’s possible with data warehousing at scale.

To extend Amazon Redshift’s capabilities even further and make it easier for our customers to drive new insights, I am happy to announce that Amazon Redshift has added scalar user-defined functions (UDFs). Using PostgreSQL syntax, you can now create scalar functions in Python 2.7 custom-built for your use case, and execute them in parallel across your cluster.

Here’s a template that you can use to create your own functions:

CREATE [ OR REPLACE ] FUNCTION f_function_name 
( [ argument_name arg_type, ... ] )
RETURNS data_type
{ VOLATILE | STABLE | IMMUTABLE }
AS $$
  python_program
$$ LANGUAGE plpythonu;

Scalar UDFs return a single result value for each input value, similar to built-in scalar functions such as ROUND and SUBSTRING. Once defined, you can use UDFs in any SQL statement, just as you would use our built-in functions.

In addition to creating your own functions, you can take advantage of thousands of functions available through Python libraries to perform operations not easily expressed in SQL. You can even add custom libraries directly from S3 and the web. Out of the box, Amazon Redshift UDFs come integrated with the Python Standard Library and a number of other libraries, including:

• NumPy and SciPy, which provide mathematical tools you can use to create multi-dimensional objects, do matrix operations, build optimization algorithms, and run statistical analyses.
• Pandas, which offers high level data manipulation tools built on top of NumPy and SciPy, and that enables you to perform data analysis or an end-to-end modeling workflow.
• Dateutil and Pytz, which make it easy to manipulate dates and time zones (such as figuring out how many months are left before the next Easter that occurs in a leap year).

UDFs can be used to simplify complex operations. For example, if you wanted to extract the hostname out of a URL, you could use a regular expression such as:

SELECT REGEXP_REPLACE(url, '(https?)://([^@]*@)?([^:/]*)([/:].*|$)', ‘\3') FROM table;

Or, you could import a Python URL parsing library, URLParse, and create a function that extracts hostnames:

CREATE FUNCTION f_hostname(url VARCHAR)
RETURNS varchar
IMMUTABLE AS $$
import urlparse
return urlparse.urlparse(url).hostname
$$ LANGUAGE plpythonu;

Now, in SQL all you have to do is:

SELECT f_hostname(url) 
FROM table;

As our customers know, Amazon Redshift obsesses about security. We run UDFs inside a restricted container that is fully isolated. This means UDFs cannot corrupt your cluster or negatively impact its performance. Also, functions that write files or access the network are not supported. Despite being tightly managed, UDFs leverage Amazon Redshift’s MPP capabilities, including being executed in parallel on each node of your cluster for optimal performance.

To learn more about creating and using UDFs, please see our documentation and a detailed post on the AWS Big Data blog. Also, check out this how-to guide from APN Partner Looker. If you’d like to share the UDFs you’ve created with other Amazon Redshift customers, please reach out to us at redshift-feedback@amazon.com. APN Partner Periscope has already created a number of useful scalar UDFs and published them here.

We will be patching your cluster with UDFs over the next two weeks, depending on your region and maintenance window setting. The new cluster version will be 1.0.991. We know you’ve been asking for UDFs for some time and would like to thank you for your patience. We look forward to hearing from you about your experience at redshift-feedback@amazon.com.

— Tina Adams, Senior Product Manager

Earlier this month I spent two exceptionally pleasant days at the AWS Loft in San Francisco. While I was there I sat down with a number of startups and recorded their stories. These stories are part of a new Intel Startup Spotlight series that I’ll be focusing on in the coming weeks and months. As an experiment, I am releasing four podcasts simultaneously.

In the past, I spent a lot of time editing the podcast to remove some pauses and some background noise. This was very time consuming and made for a marginally better product. In an attempt to get these stories to you on a more timely basis, I am now relaxing my standards and presenting the content to you on a more-or-less as-recorded basis. Because these interviews were recorded in the basement of the Loft, you will hear the occasional footstep or siren, along with the rumblings as the BART trains pass by underneath Market Street.

On Monday, August 31 I spoke with the following startups:

• Legion Analytics– Automated lead generation.
• Bohemian Guitars – Next-generation electric guitars.
• Remind – Messaging for teachers, parents, and students.
• Remeeting – Meeting recording and analytics.

One of the big takeaways from two days interviews with these startups (apart from the obvious creativity and intensity) is just how quickly containers have become an integral aspect of the systems that these developers are building. They spoke glowingly of Docker and make good use of Amazon EC2 Container Service to encapsulate applications and to support quick-turn development practices.

Here are the episodes and the show notes (the “Episode” links go directly to the MP3 files):

Episode 107 – Legion Analytics
For Episode 107, I interviewed Jamasen Rodriguez (co-founder and CEO. below in the center) and Sinan Ozdemir (co-founder and CTO, below at left) of Legion Analytics to learn more about how they built an automated lead generation platform on AWS using AWS Elastic Beanstalk, Amazon Simple Storage Service (S3), and other services. Jamasen and Sinan offered a free trail of their product; email them (yourfriends@legionanalytics.com) for more info.

Episode 108 – Bohemian Guitars
For Episode 108, I interviewed Adam Lee (Co-founder) of Bohemian Guitars. He told me how he and his brother were inspired by the musicians of South Africa, who repurposed discarded materials into musical instruments, starting from a ping-pong table in their parents’ basement. Adam shared some tips that will be useful to anyone who wants to run a successful KickStarter or Indiegogo campaign.

Episode 109 – Remind
For Episode 109 I spoke with engineers Mike Barrett and Eric Holmes of Remind.com to learn more about how they provide teachers with a better way to communicate with students and their parents. They have 25 million users and have sent over 2 billion messages to date, peaking at about 85,000 requests per minute to the API that is consumed by their mobile clients. The site runs on AWS (atop the Empire PaaS that was also built at Remind) and is backed by dozens of microservices. Events are dumped in to a “really big” Redshift cluster for analysis.

Episode 110 – Remeeting
For Episode 110 I spoke with Arlo Faria, founder of Remeeting.com . The voice recorder app runs on iOS and Android devices and uploads the raw (but compressed) audio to AWS for post-meeting analysis. As Arlo puts it, “the magic happens afterward.” Using speech technology that Arlo and his co-founder developed at UC Berkeley, they identify individual speakers and isolate phrases, and present the result in a structured, color-coded form.

In the Works
I will be publishing the second day of Intel Startup Spotlight interviews shortly. After AWS re:Invent, I plan to interview even more startups in Seattle and Portland (Oregon). Stay tuned for more info!

— Jeff;

PS – Special thanks are due to my colleague Gloria Kim for settings up the interviews and for taking the pictures.

Let’s take a quick look at what happened in AWS-land last week:

New & Notable Open Source

• awsfinder is a quick CLI tool for “quickly find X” ad hoc tasks on AWS.
• cloudcycler lets you cycle AWS resources on and off on a time-of-day basis.
• sumologic-kinesis-connector connects a Kinesis Stream to a SumoLogic Collection.
• S3QL is a filesystem that stores its data in S3 (Hacker News discussion).
• vagrant-aws-jenkins deploys a Jenkins server on AWS using Vagrant.
• aws-monitoring pushes custom metrics to CloudWatch and creates alarms on them.
• aws-services is a set of convenient microservices for managing AWS.
• RIFactor automatically refactors Reserved Instances to match running instances.
• npdynamodb is a Node.JS query builder and ORM for DynamoDB.
• ansible is a simple Ansible setup for AWS.

New Customer Success Stories

• International Civil Aviation Organization (ICAO) – predictive analysis.
• import.io – website scraping.
• Jobvite – social recruiting platform.
• polljoy – improve ratings for mobile apps in marketplaces.
• Samsung Business – mobile app store.
• Slack – messaging platform.
• VidRoll – video monetization platform.
• WOW air – website & booking engine.

New SlideShare Content

• Introducing Amazon Aurora.
• Amazon EC2 Spot.
• Amazon S3 Deep Dive and Best Practices.
• Running Batch Jobs on Amazon EC2 Container Service.
• Analyze Mobile Data and Build Predictive Applications.

New YouTube Videos

• Getting Started with AWS Directory Service.
• An Engineer’s Tour of the Internet of Things.
• How APIs Will Wrangle the IoT’s Coming Data Tsunami.
• Benefits of the PaaS Approach to IoT.

New Marketplace Applications

• BodySYS.
• IOMAD powered by System Sector.
• SEOTOASTER powered by System Sector.
• Codeanywhere.
• SAP IQ.
• Cognizant Engagement Catalyst.
• StackStorm.
• OpMon.
• WebSphere MQ v 8.0.0.3.
• eFront LMS powered by System Sector.
• FortiDirector.
• Kong.
• Magento+Memcached+HHVM+LAMP+Webmin Package powered by SAIN3.
• Magento + Redis + HHVM + LAMP + Webmin Package powered by SAIN3.
• Vidfy.
• BLISS GEO APP.

Upcoming Events

• September 10 – Live Event (Seattle, WA) AWS Workshop and Hackathon (8 AM – 11 PM).
• September 14-18 – Live Event (New York) AWS Professional Services Delivery Best Practices Bootcamp.
• September 22 – Webinar – Scientific Computing in the Cloud: Speeding Access for Drug Discovery – with APN Partner Avere Systems and customer H3 Biomedicine.
• September 24 – Meetup (Warszawa, Poland) – AWS User Group Poland.
• AWS Summits – Latin America.
• AWS re:Invent – Sold out, register for the live stream!

Upcoming Events at the AWS Loft (San Francisco)

• September 10 – Security Incident Response in AWS: Best Practices and Prerequistes (6 PM – 7:30 PM).
• September 11 – IoT Hack Day: AWS Pop-up Loft Hack Series-Sponsored by MediaTek Labs (10 AM – 6 PM).
• September 14 – AWS Bootcamp: Architecting Highly Available Applications (10 AM – 6 PM).
• September 16 – ClearScale Customer Showcase + Premier Partner Party (6 PM – 9:30 PM).
• September 17 – The Right Tool for the Right Job on AWS (4 PM – 8 PM).
• September 22 – Accelerating to the Hybrid Cloud and Reaping the Rewards (6 PM – 9 PM).
• September 23 – Amazon Launchpad: Paving the Way for Startups to Launch on Amazon (11:30 AM – 2:30 PM).
• September 25 – TechNode San Francisco Demo Day (10 AM – 5 PM).
• September 28 – AWS Bootcamp: Taking Operations to the Next Level (10 AM – 6 PM).
• September 29 – Funding Options for Growing Technology Companies (6 PM – 7:30 PM).
• September 30 – Onshape Users (6 PM – 8:30 PM).
• October 1 – Market Differentiators and Elements of API Management plus The Developer Experience – Accelerating Growth (6 PM – 9 PM).
• October 21 – Intro to Using AWS and the Alexa Skills Kit to Build Voice Driven Experiences + Open Hackathon (10 AM – 3 PM).

Upcoming Events at the AWS Loft (New York)

• September 8 – Infrastructure as Code (4:30 PM – 5:30 PM).
• September 8 – Behind the Scenes with Hudl: Development in the Multiverse (6:30 PM – 8 PM).
• September 9 – AWS Lambda Overview (10 AM – 1 PM).
• September 9 – AWS Lambda Deep Dive (2 PM – 5 PM).
• September 9 – Bringing Your Game to the Living Room (5 PM – 6 PM).
• September 10 – Amazon API Gateway Overview (10 AM – 1 PM).
• September 10 – Amazon API Gateway Deep Dive (2 PM – 5 PM).
• September 10 – Venture Capital Loft Talks (6:30 PM – 8 PM).
• September 14 – Chef Bootcamp: A Taste of Chef on AWS (10 AM – 6 PM).
• September 15 – Chef Bootcamp: A Taste of Chef on AWS (10 AM – 6 PM).
• September 16 – Chef Bootcamp: A Taste of Chef on AWS (10 AM – 6 PM).
• September 17 – Chef Bootcamp: A Taste of Chef on AWS (10 AM – 6 PM).
• September 18 – Network with Amazon Business Leaders from NYC Area (6 PM – 9 PM).
• September 24 – Intro to Using AWS and the Alexa Skills Kit to Build Voice Driven Experiences + Open Hackathon (10 AM – 3 PM).
• September 24 – The Life of a Click: How Hearst Publishing Manages Clickstream Analytics with AWS (3 – 4 PM).
• September 24 – How to Implement Top 10 AWS Security Best Practices – Day Workshop with Evident.io (10 AM – 2 PM).
• September 24 – How to Implement Top 10 AWS Security Best Practices – Evening Session with Evident.io (6:30 PM – 8:30 PM).
• September 28 – Onshape Users (6 PM – 8:30 PM).
• October 1 – Behind the Scenes with LearnBop – Bulletproof Blue/Green Deployments – Myths, Pitfalls and Solutions (6:30 PM – 8 PM).

Help Wanted

• Cloud Academy Blog: This Week’s Cloud Computing Jobs.
• AWS Careers.

Stay tuned for next week! In the meantime, follow me on Twitter and subscribe to the RSS feed.

— Jeff;

I have always advised my family, friends, colleagues, and audiences to plan to spend some time learning something new every day. If you don’t take responsibility for your own continued education, you can soon find that you have fallen far behind your peers!

If you are interested in staying current with AWS, I have a couple of recommendations. You can read this blog, follow me (and @awscloud) on Twitter, check in with the AWS What’s New page from time to time, and make use of our self-paced labs.

When you are ready for a more in-depth look at a certain topic or service, I would strongly advise you to attend one or more of our webinars!

Every month my colleagues assemble a lineup of sessions that are hand-selected to provide you with a detailed look at a subject that they believe will be of value to you. The webinars are presented by senior members of the team including evangelists, product managers, and solution architects.

With that said, I would like to introduce you to our September 2015 webinars (all times are Pacific).

• September 15:
  • 9 AM – Building Your First Big Data Application on AWS.
  • 10:30 AM – Infrastructure Deployment and Monitoring with AWS Lambda and Amazon SNS
  • 12:00 PM – Getting Started with DynamoDB Streams.
• September 16:
  • 10:30 AM – Meet Regulatory Storage Requirements with Amazon Glacier Vault Lock.
• September 17:
  • 9 AM – Running Microservices with Amazon EC2 Container Service.
  • 10:30 AM – Visual Effects Rendering in the AWS Cloud with ThinkBox.
  • 12:00 PM – Build Cross-Platform Mobile Apps with AWS and the New Xamarin SDK.

There’s no charge and no obligation, of course! Please feel free to sign up, and to share this post wiht your friends and colleagues.

— Jeff;

PS – Please feel free to suggest new topics by leaving a comment on this post.

Magento is a very popular open-source content management system for e-commerce sites. Sellers and developers appreciate its open architecture, flexibility, extensibility (hundreds of extensions), and back-end workflows that can be tailored to fit the unique needs of each customer.

Magento Community Edition (Magento CE) Magento Enterprise Edition (Magento EE) are popular among our customers. Some of these deployments have been launched on AWS by way of partners such as Anchor Hosting, Elastera, Tenzing, Razorfish, and Optaros. Others have been launched via the AWS Marketplace (a search for Magento returns more than 20 listings). And still others have been launched in do-it-yourself form.

Today we are publishing a new Magento Quick Start Reference Deployment. This 29-page document will show you how to build an AWS cluster that runs version 1.9.2 of Magento Community Edition. It walks you through best practices, provides cost estimates, and outlines the recommended set of AWS components.

Using the AWS CloudFormation template referenced in the Quick Start, you can launch Magento into a new or existing Virtual Private Cloud (Amazon VPC). The template will create (if requested) the VPC, along with the necessary EC2 instances (auto scaled instances for the web server and a NAT instance for SSH connectivity), an Amazon Relational Database Service (RDS) instance running MySQL, and Elastic Load Balancing. It will also create the requisite IAM roles and security groups and configure the Auto Scaling to add more EC2 instances when traffic rises and remove them when it subsides. Here’s what the completed system looks like:

The Quick Start also includes a pointer to some sample data that you can download from the Magento site!

— Jeff;