Amazon Web Services launches AWS Glue, a fully managed extract, transform, and load (ETL) service

New ETL service automates the preparation of data for analytics, reducing the time it takes customers to start analyzing their data from months to minutes

SEATTLE, 2017-Aug-15 — /EPR Retail News/ — Today (Aug. 14, 2017), Amazon Web Services, Inc. (AWS), an Amazon.com company (NASDAQ: AMZN), launched AWS Glue, a fully managed extract, transform, and load (ETL) service that makes it easy for customers to prepare and load their data into Amazon Simple Storage Service (Amazon S3), Amazon Redshift, Amazon Relational Database Service (Amazon RDS), and databases running on Amazon Elastic Compute Cloud (Amazon EC2) for query and analysis. Customers can create and run an ETL job with a few clicks in the AWS Management Console. Customers simply point AWS Glue at their data stored on AWS, and AWS Glue discovers the associated metadata (e.g. table definitions) and classifies it, generates ETL scripts for data transformation, and loads the transformed data into a destination data store, provisioning the infrastructure needed to complete the job. With AWS Glue, data can be available for analysis in minutes, and because AWS Glue is serverless, customers only pay for the compute resources they consume while executing data preparation and loading jobs. To learn more about AWS Glue, visit https://aws.amazon.com/glue.

Data integration – extracting data from various sources, normalizing it, and loading it into data stores – often represents as much as 75 percent of the time required to implement an analytics project. Customers can spend months hand coding and editing ETL scripts, which frequently become more complex and error prone as data volumes grow, and new data sources are added. And, running ETL jobs requires dedicated hardware that often sits idle between jobs. AWS Glue significantly speeds the ETL phase of analytics projects by eliminating all of the undifferentiated heavy lifting involved in creating, managing, and modifying ETL jobs.

After crawling a customer’s selected data sources, AWS Glue identifies data formats and schemas to build a unified Data Catalog that provides a central view of customers’ selected data. This makes it easy for customers to search and manage all of their data across various data stores without having to manually move it. When a customer identifies a data source (e.g., a database table) and target (e.g., a data warehouse) from the Data Catalog, AWS Glue matches the schemas and generates data transformation code that is customizable, reusable, portable, and sharable. Developers can schedule any number of ETL jobs, and AWS Glue manages the rest – automatically spinning compute resources up or down depending on customer ETL workloads. By streamlining the process of creating ETL jobs, AWS Glue allows customers to build scalable and reliable data preparation platforms spanning thousands of jobs, with built-in dependency resolution, scheduling, resource management, and monitoring.

“AWS’s scalable, reliable cloud storage, combined with our broad range of analytics services make it easier than ever for customers to collect, store, analyze, and share data,” said Raju Gulabani, Vice President, Databases, Analytics, and AI, Amazon Web Services. “While it’s amazing to see how much analytics are being run on AWS today, many have told us that there is one piece of the equation that is still way too hard – cleaning and preparing huge volumes of data for analysis. We developed AWS Glue to eliminate much of the undifferentiated heavy lifting involved with ETL. By cataloging all of a customer’s data and automating the ETL process, AWS Glue not only takes a lot of the hassle out of analytics. It also makes it possible for customers to store their data in as many sources as they want, and very quickly start analyzing all of it with whatever AWS service they choose.”

NewsCorp is a global provider of news and business information, delivering content to a few hundred million consumers every day in over 50 countries. “At NewsCorp, we are building a world-class digital platform on AWS to distribute content to our external customers and to facilitate data-driven decision making across all our businesses. We merge data from a variety of sources and load it to our Amazon S3-based data lake on a continuous basis,” said Simon Smith, Chief Data Officer at NewsCorp. “AWS Glue is unparalleled in its ability to infer, classify, and transform data. With AWS Glue our data scientists and analysts can always have access to the latest data available in our data lake. AWS Glue Data Catalog automatically detects the availability of new data, infers its metadata and makes it readily available in Amazon Athena so we can start querying that data. Our AWS Glue ETL jobs seamlessly convert raw data in a variety of data formats to an Amazon Athena optimized Parquet data format. And the best part is that AWS Glue is serverless. We do not have to provision or manage any resources to prepare data for analytics.”

21st Century Fox is home to a global portfolio of media companies that reach more than 1.8 billion homes in 50 languages every day. “As part of our overall data strategy, we are building a petabyte-scale data lake on Amazon S3 so that our executives can have access to any data asset through a unified data platform. We bring in data from a variety of sources, ranging from our ERP systems to clickstream and mobile analytics, process it, and make it available in a queryable form,” says John Herbert, Global CIO, 21st Century Fox. “We are always interested in trying out new products that will reduce the administrative overhead of managing our data lake. We are impressed by AWS Glue’s ability to automatically discover new data, extract the associated metadata and make it available through a central Data Catalog so we can instantly start querying this data. We are looking forward to making AWS Glue a component of our data lake.”

myTomorrows is an online platform that provides information and access to treatment options in the form of Clinical Trials and Early Access Programs. “We ingest clinical trial data, medical vocabularies and scientific publications that vary in formats, schema and quality from a variety of data sources, to provide insights to our customers,” said Robert-Jan Sips, Chief Technology Officer, myTomorrows. “AWS Glue’s automatic schema discovery and code generation features are truly a game changer for a small, fast-growing organization like ours. AWS Glue makes it extremely easy and cost effective to onboard new datasets, and its serverless offering makes it a breeze to test and run our ETL jobs. Our developers love that they can simply connect their notebooks to AWS Glue and get going without any ramp up time.”

The OLX Group operates a network of online trading platforms in over 40 countries, with over 300 million monthly users worldwide. “We collect clickstream data across billions of monthly visits and page views for all our online marketplaces into a central data lake on Amazon S3. We are constantly looking for products that will make our data ingest pipeline robust, reliable, and automated,” says Jakub Orlowski, Data Engineering Manager, OLX. “We jumped at the first opportunity to start using AWS Glue and loved its ease of use, flexibility, and zero administrative overhead. AWS Glue automatically converts raw JSON data from our data lake into Parquet data format and makes it available for search and querying through a central Data Catalog. We can use our Zeppelin notebooks to edit the AWS Glue generated ETL code and once we are done, AWS Glue runs everything on a serverless Spark platform. AWS Glue will allow us to push our data innovation and democratization efforts to the next level and bring data producers and consumers closer than ever before.”

OST, an APN Partner with expertise in building enterprise cloud solutions for connected products, is working with Herman Miller, one of the world’s largest manufacturers of office furniture, to bring IoT and Big Data to the workplace. “We are partnering on an IoT platform and analytics solution with Herman Miller to collect real-time data from sensor-enabled furniture, catalog it in a data lake, then run machine learning algorithms. Office employees benefit from instant ergonomic adjustments, and employers can measure the effectiveness of their space for optimal real estate use,” said Alex Jantz, Senior Architect, OST. “AWS Glue helps cut our DevOps time in half. We start with an auto-generated script, then customize it with Zeppelin notebooks as needed. AWS Glue has completely redefined the way we think of ETL. We just focus on the custom code and AWS Glue takes care of the rest.”

Customers can start using AWS Glue using the AWS Management Console. AWS Glue is available in the US East (N. Virginia) Region and will expand to additional Regions in the coming months.

About Amazon Web Services

For 11 years, Amazon Web Services has been the world’s most comprehensive and broadly adopted cloud platform. AWS offers over 90 fully featured services for compute, storage, networking, database, analytics, application services, deployment, management, developer, mobile, Internet of Things (IoT), Artificial Intelligence (AI), security, hybrid, and enterprise applications, from 44 Availability Zones (AZs) across 16 geographic regions in the U.S., Australia, Brazil, Canada, China, Germany, India, Ireland, Japan, Korea, Singapore, and the UK. AWS services are trusted by millions of active customers around the world — including the fastest growing startups, largest enterprises, and leading government agencies — to power their infrastructure, make them more agile, and lower costs. To learn more about AWS, visit https://aws.amazon.com.

About Amazon

Amazon is guided by four principles: customer obsession rather than competitor focus, passion for invention, commitment to operational excellence, and long-term thinking. Customer reviews, 1-Click shopping, personalized recommendations, Prime, Fulfillment by Amazon, AWS, Kindle Direct Publishing, Kindle, Fire tablets, Fire TV, Amazon Echo, and Alexa are some of the products and services pioneered by Amazon. For more information, visit www.amazon.com/about and follow @AmazonNews.

Media Hotline:
Amazon-pr@amazon.com
www.amazon.com/pr

Source: Amazon Web Services, Inc.

Amazon Lex now available to all customers

  • Amazon Lex, the technology that powers Amazon Alexa, enables any developer to build rich, conversational user experiences for web, mobile, and connected device apps
  • American Heart Association, Capital One, Freshdesk, Hubspot, Liberty Mutual, NASA, Ohio Health, and Vonage among customers using Amazon Lex

SEATTLE, 2017-Apr-20 — /EPR Retail News/ — Amazon Web Services, Inc. (AWS), an Amazon.com company (NASDAQ: AMZN), announced that Amazon Lex, an artificial intelligence (AI) service for building applications that can have conversations using voice and text, is now available to all customers. Amazon Lex brings the sophisticated and proven deep learning algorithms that power Amazon Alexa to all developers as a fully managed service. To get started with Amazon Lex, visit: https://aws.amazon.com/lex/.

Until now, very few developers have been able to build, deploy, and broadly scale apps with automatic speech recognition (ASR) and natural language understanding (NLU) capabilities because doing so required training sophisticated deep learning algorithms on massive amounts of data and infrastructure. Amazon Lex eliminates all of this heavy lifting, making it easy for developers to build apps that can have conversations using voice or text by offering the same ASR and NLU technologies that power Amazon Alexa, as a fully managed service. With Amazon Lex, developers can build and test conversational apps that perform tasks such as checking the weather or latest news, booking travel, ordering food, getting the latest sales or marketing data from business software, or controlling a connecting device. To build a conversational app, developers provide Amazon Lex sample phrases that describe a user’s intent (e.g., “book a flight”) along with the corresponding information Amazon Lex needs to ask to fulfill the intent (e.g., travel date and destination), and any required questions Amazon Lex needs to ask to elicit additional information (e.g., “when do you want to travel?” and “where do you want to go?”). Amazon Lex takes care of the rest by building a machine learning model that parses the speech or text input from the user, understands the intent behind the conversation, and manages the conversation (e.g., if the travel date is already known, the app will skip that question and ask for the destination). Developers can then publish the conversational app to mobile and Internet of Things (IoT) devices, web applications, and chat services such as Facebook Messenger, Slack or Twilio. Amazon Lex handles the authentication required by different platforms using the customer provided keys and scales automatically as traffic increases, so developers don’t have to worry about provisioning and managing infrastructure.

“Thousands of machine learning and deep learning experts across Amazon have been developing AI technologies for years, and Amazon Alexa includes some of the most sophisticated and powerful deep learning technologies in existence,” said Raju Gulabani, Vice President, Databases, Analytics, and AI, AWS. “We thought customers might be excited to use the same technology that powers Alexa to build conversational apps, but we’ve been blown away by the customer response to our preview – as organizations in virtually every industry like Capital One, Freshdesk, Hubspot, Liberty Mutual, Ohio Health, and Vonage have mobilized quickly to build on top of Amazon Lex.”

Amazon Lex is integrated with AWS Lambda, the pioneer in event-driven computing that lets developers run code without provisioning or managing servers (serverless). This means that developers can build Amazon Lex conversational apps that use Lambda functions to implement business logic and retrieve data from enterprise applications and AWS Services like Amazon DynamoDB. Amazon Lex also includes built-in connectors that make it easy for conversational apps to access data from popular SaaS applications like Salesforce, Marketo, Zendesk, and QuickBooks so apps built using Amazon Lex can answer questions like “what are my top 10 accounts in Salesforce” by fetching appropriate data from Salesforce. Developers can also easily access analytics provided by Amazon Lex to measure various application performance and accuracy metrics that they can use to improve their apps over time.

The American Heart Association (AHA) is the nation’s oldest and largest voluntary organization dedicated to building healthier lives, free of cardiovascular diseases and stroke. “The AHA engages nearly 1 million participants, nationwide, through our premier Heart Walk events to further our mission of saving lives,” said Roger Santone, Executive Vice President of Technology, AHA. “The world is rapidly changing and we are constantly rethinking traditional approaches to reach people at the pace that they live their everyday lives. We used Amazon Lex’s AI technology to streamline the registration process so prospective Heart Walk participants can use their natural voice to easily register through heartwalk.org. We are committed to the role that technology plays in enabling consumers, patients, and physicians to achieve better health outcomes and to further the mission of the AHA.”

Freshdesk is a leading provider of cloud-based customer engagement software, allowing organizations to support customers through email, phone, websites, forums, and social media. “Adding Amazon Lex to our cloud-based platform will help our customers provide a more personalized experience, a critical feature in customer support,” said Francesco Rovetta, Vice President Alliances, Freshdesk. “Our 100,000 customers will be able to use natural language to handle administrative tasks, review metrics and provide support, ultimately simplifying ticket management. Using Amazon Lex for intent identification, our customers will quickly be able to answer their clients’ questions, resulting in the ability for agents to address the more complex inquiries in a timely manner. With Alexa speech recognition and natural language technology, Amazon Lex maintains context in conversation, creating a more natural dialogue. We are excited to team up with Amazon Lex as we help organizations around the world deliver better, more personal support to their customers.”

Vonage is a leading provider of cloud communications for business. “The expansion of AI-driven conversational services has enabled businesses to engage with their customers in ways that are more meaningful and more contextual than ever before,” said Alan Masarek, Chief Executive Officer, Vonage. “With Amazon Lex, we can empower Vonage customers to choose how and where they will engage with us – building intelligent interaction paths into existing voice and messaging channels. Vonage is also developing ways to integrate Amazon Lex with our API Platform, Nexmo, to provide enterprise developers with an easy way to build custom conversational apps driven by natural language understanding and speech recognition, and deliver them through any medium, reaching customers wherever they are – whether it’s phone, text, app, or mobile device.”

Liberty Mutual Insurance helps people preserve and protect what they earn, build, own and cherish. “With the growing importance of cognitive technologies in every area of business, we were delighted to see Amazon Lex, with its Speech Recognition and Natural Language Understanding technologies, added to the broad portfolio of services AWS provides,” said Gillian Armstrong, Insurance Technologist, Liberty Mutual. “Amazon Lex integrates easily into our existing applications, as well as our new cloud-native serverless architectures, enabling us to rapidly take advantage of these powerful technologies to improve and extend the capabilities we can offer our employees and customers.”

Customers can launch Amazon Lex using the AWS Management Console, AWS Command Line Interface (CLI), or AWS SDKs. Amazon Lex is available in the US East (N. Virginia) Region.

About Amazon Web Services
For 11 years, Amazon Web Services has been the world’s most comprehensive and broadly adopted cloud platform. AWS offers over 90 fully featured services for compute, storage, networking, database, analytics, application services, deployment, management, developer, mobile, Internet of Things (IoT), Artificial Intelligence (AI), security, hybrid, and enterprise applications, from 42 Availability Zones (AZs) across 16 geographic regions in the U.S., Australia, Brazil, Canada, China, Germany, India, Ireland, Japan, Korea, Singapore, and the UK. AWS services are trusted by millions of active customers around the world – including the fastest growing startups, largest enterprises, and leading government agencies – to power their infrastructure, make them more agile, and lower costs. To learn more about AWS, visit https://aws.amazon.com.

About Amazon
Amazon is guided by four principles: customer obsession rather than competitor focus, passion for invention, commitment to operational excellence, and long-term thinking. Customer reviews, 1-Click shopping, personalized recommendations, Prime, Fulfillment by Amazon, AWS, Kindle Direct Publishing, Kindle, Fire tablets, Fire TV, Amazon Echo, and Alexa are some of the products and services pioneered by Amazon. For more information, visit www.amazon.com/about and follow @AmazonNews.

Source: Amazon Web Services, Inc.

Amazon.com, Inc.
Media Hotline
Amazon-pr@amazon.com
www.amazon.com/pr

Amazon Web Services: Amazon QuickSight now available to all customers

  • Very fast, easy-to-use, cloud-powered business analytics service for one-tenth the cost of traditional BI solutions
  • Infor, MLB Advanced Media, and Edmunds.com among the more than 1,500 preview customers using Amazon QuickSight

SEATTLE, 2016-Nov-18 — /EPR Retail News/ — Amazon Web Services, Inc. (AWS), an Amazon.com company (NASDAQ:AMZN), today (Nov. 15, 2016) announced that Amazon QuickSight is now available to all customers. Amazon QuickSight makes it easy for all employees within a company – regardless of their technical skill – to build visualizations, perform ad-hoc analysis, and quickly get business insights from their data. More than 1,500 AWS customers, including global enterprises and startups from a range of industries, have been using Amazon QuickSight during its preview. These customers have experienced how seamlessly Amazon QuickSight connects to AWS and non-AWS data sources, and how fast the query performance is for its robust Super-fast, Parallel, In-Memory Calculation Engine (called SPICE). Pricing for Amazon QuickSight starts at $9.00 per user, per month – one-tenth the cost of traditional BI solutions – so customers of all sizes can make rich business analytics functionality available to all of their employees. To get started with Amazon QuickSight, visit https://quicksight.aws

The volume of data businesses create and process is growing every day. To get the most value out of this data, customers need to make it easy for all employees, regardless of their technical skill, to analyze data and share insights with others to drive decisions. However, the cost and complexity of traditional BI solutions prohibit most companies from making analytics ubiquitous across their organizations because these solutions require investments in costly on-premises hardware and software, weeks or months of data engineering time to build complex data models, and ongoing investments in additional infrastructure to maintain fast query performance as data sets grow. Amazon QuickSight is built from the ground up to solve these problems by bringing the scale and flexibility of the AWS Cloud to business analytics. Getting started with Amazon QuickSight is simple and fast. Customers simply log in to Amazon QuickSight, and Amazon QuickSight automatically discovers their data stored in AWS services such as Amazon Redshift, Amazon Relational Database Service (Amazon RDS), and Amazon Simple Storage Service (Amazon S3). Amazon QuickSight also connects to third-party data sources such as Microsoft Excel or Salesforce.com. Amazon QuickSight formats the data and moves it to SPICE so it can be visualized in Amazon QuickSight, and customers can choose to keep the data in SPICE up-to-date as the data in the underlying sources change.

“Amazon QuickSight makes business analytics much easier, more accessible, cost effective, and faster than ever before,” said Raju Gulabani, Vice President, Database Services, Amazon Web Services. “Because so many companies store data in AWS, it’s very appealing to these customers that Amazon QuickSight can automatically discover their data in AWS, move it to SPICE, and return query results so quickly – all for one-tenth the cost of traditional BI solutions.”

Built from the ground up for the cloud, SPICE uses a combination of columnar storage, in-memory technologies enabled through the latest hardware innovations, and machine code generation to allow users to run interactive queries on large datasets and get rapid responses – even with thousands of users all simultaneously performing interactive analysis across a wide variety of AWS data sources. As users explore their data, Amazon QuickSight infers data types and relationships, issues optimal queries to extract relevant data, aggregates the results in the SPICE engine, and provides suggestions for the best possible visualizations of the data – from bar and line graphs to pie charts and scatter plots or heat maps and pivot tables.

MLB Advanced Media (MLBAM) is a leader in digital media and content infrastructure, powering an ever-growing number of massively popular media and entertainment properties. “We have been using the preview version of Amazon QuickSight to get insights into our digital content business,” said Brandon SanGiovanni, Traffic Manager, MLBAM. “Amazon QuickSight and the SPICE engine allowed us to tear down and explore our data in a fraction of the time we expected, making it easy for us to tap into the value inside our data. Amazon QuickSight made it easy to slice and dice our data by simply pointing Amazon QuickSight to our AWS data sources. With just a few clicks, Amazon QuickSight provided us with a real-time, 360-degree view of our business without being constrained by pre-built dashboard and metrics, which allowed us to expand our use of data to make informed decisions regarding our products.”

Edmunds.com is a leader and one-stop resource for automotive information online, and provides everything from prices for new and used vehicles, vehicle reviews, and true cost of ownership to tips and advice for car purchases. “At Edmunds.com, we have large amounts of data generated every single day in AWS, from website clickstream logs, vehicle transaction and inventory data, and third party datasets to our server and infrastructure logs,” said, Ajit Zadgaonkar, Head of Cloud Infrastructure, Edmunds.com. “Today, we use various tools to generate reports for the entire organization. However, there’s an increasing need to equip our business users with the ability to do their own ad-hoc data discovery and analytics to complement our centralized reporting. We are excited that Amazon QuickSight supports this self-service use case very well. Now that it is generally available, we’re looking forward to giving access to Amazon QuickSight to all of our business users because of its ease-of-use, fast analytics, deep integration with AWS data sources, and affordable price point.”

Infor provides business applications specialized by industry and built for the cloud, to its more than 90,000 customers and 66 million cloud users. “We have been using Amazon QuickSight during preview to analyze large datasets from our customers and we are excited about the speed of SPICE and the ease of use of Amazon QuickSight,” said Steve Stahl, Senior BI Development Manager, Infor. “Amazon QuickSight’s SPICE engine is very fast and lets us quickly process these datasets and visualize the results while greatly simplifying integration with Amazon RDS and Amazon Redshift.”

Hotelbeds is a global distributor of accommodations serving more than 185 destination countries worldwide and more than 25 million room nights annually. “Hotelbeds’ platform that connects travel partners around the world is built on top of AWS and generates massive amounts of data every day, but our existing BI solution limits how we make these data and insights available to our business users,”said Miguel Iza, Head of Data and Analytics, Hotelbeds. “Amazon QuickSight is the ideal service to make this data available to our business users. After testing this new service in preview, we found Amazon QuickSight to offer great performance with its SPICE engine, and an easy-to-use user experience when it comes to analytics. Amazon QuickSight simplifies the way our users access their data, perform self-service analysis, and share insights with others. We plan to adopt Amazon QuickSight for our new data solutions and look forward to Amazon QuickSight democratizing business analytics in our company.”

Amazon QuickSight is free for one user and one GB of SPICE capacity. The Standard Edition of Amazon QuickSight starts at $9 per user per month, includes 10 GB of SPICE capacity, and is now available in US East (N. Virginia), US West (Oregon), and EU (Ireland) and will expand to additional Regions in the coming months. The Enterprise Edition of Amazon QuickSight includes all Standard Edition features as well as support for Active Directory integration and encryption at rest and will be available in the coming weeks.

About Amazon Web Services

For 10 years, Amazon Web Services has been the world’s most comprehensive and broadly adopted cloud platform. AWS offers over 70 fully featured services for compute, storage, databases, analytics, mobile, Internet of Things (IoT) and enterprise applications from 38 Availability Zones (AZs) across 14 geographic regions in the U.S., Australia, Brazil, China, Germany, Ireland, Japan, Korea, Singapore, and India. AWS services are trusted by more than a million active customers around the world — including the fastest growing startups, largest enterprises, and leading government agencies — to power their infrastructure, make them more agile, and lower costs. To learn more about AWS, visit http://aws.amazon.com.

About Amazon

Amazon is guided by four principles: customer obsession rather than competitor focus, passion for invention, commitment to operational excellence, and long-term thinking. Customer reviews, 1-Click shopping, personalized recommendations, Prime, Fulfillment by Amazon, AWS, Kindle Direct Publishing, Kindle, Fire tablets, Fire TV, Amazon Echo, and Alexa are some of the products and services pioneered by Amazon. For more information, visit www.amazon.com/about.

Media Hotline:

206-266-7180
Amazon-pr@amazon.com
www.amazon.com/pr

Source: Amazon Web Services, Inc.