Migrating digital commerce workloads to the AWS Cloud with AWS Database Migration Service and AWS Schema Conversion Tool
Author: Daniel Carraro, Solutions Architect at Ultra Commerce
As an organization focused on delivering digital commerce outcomes for our customers on Amazon Web Services (AWS), Ultra Commerce is often tasked with helping organizations to migrate their existing on-premises hosting deployments to the cloud on AWS.
For many organizations, the migration to AWS presents an opportunity to both modernize architecture and reduce licensing costs. With this in mind, the database technology underpinning digital commerce platforms is often a key area for consideration.
While maintaining support for numerous database technologies, Ultra Commerce leverage Amazon Aurora as the standard database of choice. Amazon Aurora, one of AWS’s fastest growing services, provides enterprises high performance and availability with the simplicity and cost-efficiency of an open source database.
Amazon Aurora is the clear choice for delivering digital commerce on AWS however migrating data between cloud providers or from on-premise databases can be complex, costly, and time-consuming.
Today, AWS DMS and AWS SCT have become indispensable tools used in many digital commerce platforms, including Ultra Commerce when migrating customers from on-premise environments (and other cloud providers) to AWS cloud.
Even complex migrations are covered
In true AWS fashion, they’ve already thought about complex migration use-cases catering to customers who require more advanced migrations. For example, when data needs to reside in a different environment (e.g. from on-premises to AWS) and/or data needs to be stored using a different database engine (e.g. from Oracle to Amazon Aurora MySQL-compatible) due to licensing or business or technical requirements.
AWS SCT is crucial in this situation, supporting common conversions such as Oracle to Amazon Aurora, MSSQL to MySQL, MySQL or MariaDB to PostgreSQL and even Apache Cassandra to Amazon DynamoDB amongst others.
How the tools are used
When utilized correctly by AWS partners, AWS SCT and AWS DMS are straightforward and highly effective, especially for digital commerce organizations.
After organizations provide a source database endpoint and engine (e.g. an Oracle database hosted on-premises) and a destination database endpoint and engine (e.g. an Aurora MySQL-compatible database hosted on AWS), AWS SCT will analyze both databases and perform both the schema conversions.
AWS DMS is used in a similar fashion, with the exception that a DMS replication instance must be created, which will act as a middleman between the source and destination databases. This DMS replication instance is an Amazon Elastic Compute Cloud (Amazon) EC2 instance with DMS-specific software that acts as a black box.
Customizable to fit every business case
Both AWS DMS and AWS SCT can be customized to include specific schemas to convert or migrate; in the case of AWS DMS, specific tables can be included or ignored. AWS DMS also features a transformational layer that allows operations such as the ability to add/replace/remove a prefix or suffix to a schema, table, or column (or rename it entirely); remove a column from a table, or convert to lowercase or uppercase.
AWS DMS can be configured to drop and recreate, or truncate tables before loading data if required, and also to load tables in parallel, supporting up to 49 tables to be loaded and migrated at once. However, any tuning will be dependent on the DMS Replication Instance selected to perform the job.
Ultra Commerce and AWS
Ultra Commerce has used AWS DMS for many migrations ranging from on-premise and other cloud providers to different AWS regions and in some cases, between two databases in the same virtual private cloud (VPC). Additionally, Ultra Commerce has leveraged AWS SCT to perform conversions between MSSQL and Amazon Aurora (MySQL-compatible) databases for clients moving off on-premise infrastructure into AWS cloud.
By taking advantage of AWS DMS and AWS SCT, Ultra Commerce are able to perform complex database migrations for clients at a fraction of the cost compared to other database migration tools and services. When migrating to Amazon Aurora specifically, Ultra Commerce clients have not only experienced performance gains within their digital commerce applications but have also managed to save on day-to-day infrastructure costs, and in some cases, on licenses.
Contact Ultra Commerce today for help on your migration to AWS.
Established in 2005, Razer is one of the most recognized ecosystems for gaming hardware and software across the globe. Razer is for gamers, by gamers.
Experiencing astronomical growth in a short period of time due to its award-winning hardware and software that supports 60M users, Razer knew the need for a scalable and high performing digital commerce solution.
Facing several vital user experience issues and lost revenue due to site downtime, Razer came to Ultra Commerce to take advantage of their expertise in SAP Hybris and AWS.
As one of the world’s largest online stores for gamers, Razer frequently has large promotional events, new product releases, and gaming events that require a highly scalable platform to service large user volumes. An additional complication related to the overall stability and performance of the site was frequent DDoS attacks.
These capabilities were so vital to Razer’s business that a key requirement for Ultra Commerce’s Proof of Concept (PoC) engagement for Razer was to demonstrate SmartStack’s ability to handle scale during both scheduled and unscheduled peaks.
Razer is a highly innovative organization with rapidly evolving products and technology, requiring frequent updates to their product catalog and offerings. Traditionally this resulted in a 3-4 hour outage each month while Razer executed the SAP Hybris System Update task. These down for maintenance windows created a significant challenge since each update rendered the site unable to transact business, resulting in a negative impact on revenues and customer satisfaction.
Razer needed an SAP Hybris solution that would address current challenges while supporting future growth. To begin a new, more effective solution, Razer required assistance to migrate their digital commerce infrastructure as quickly and with as little disruption to the business as possible.
In under 50 days (April 25, 2018, to June 13, 2018), Ultra Commerce migrated Razer’s digital commerce infrastructure including a database re-platform to AWS Aurora Database (which comes standard with SmartStack) leveraging the AWS Schema Conversion Tool and Database Migration Service.
Once the migration was complete, Ultra Commerce utilized their platform on AWS to provide a guaranteed Service Level Agreement (SLA) of 99.99% uptime. SmartStack, built to AWS Well Architected specifications, provided much needed stability, scalability and performance improvements in line with Razer’s workload dynamics.
Continuing to make the most of AWS offerings, Ultra Commerce utilized AWS Elasticache with Memcached and SmartStack to deliver session persistence. In the unlikely event of infrastructure failure, SmartStack ensures Razer’s customers won’t experience any session-related issues, such as their cart being destroyed, or being forcefully logged out.
Ultra Commerce also utilized the SAP Hybris Rolling Update process to perform zero-downtime updates during Razer’s frequent upgrades. Rolling Updates work by cloning the original SAP Hybris typesystem, redirecting the user to the original version while code updates run in parallel on the cloned version, leaving no interference to the end user (see graphic below). As demonstrated in the graphic below, an example of a System Update that requires new code could be a new payment method, such as cash card acceptance, or a new attribute to a pre-existing product, such as a mouse’s logo.
To date with Ultra Commerce, Razer has experienced minimal downtime with no breach to the 99.99% availability agreement since go-live. Deployments now take less than 30 minutes with no downtime instead of the original 3+ hours with downtime. The ability to keep the site updated with the latest and greatest products and offers while processing orders at any time of the day has increased Razer’s ability to be competitive and differentiated in the marketplace as a true global 24/7/365 business.
“We can now execute site maintenance without incurring any downtime. This is a big deal!”
– Patricia Liu, Chief of Staff, Razer
Razer now enjoys a higher performing and scalable solution with greater availability for their online store with the help of Ultra Commerce powered by AWS to deliver the SAP Hybris application. This has allowed Razer to make the most of their digital commerce investment and give their customers the experience they expect from the world leader gamer brand.
General Pants (GP) is a leading Australian fashion retailer operating with over 50 physical stores across Australia, and online in multiple countries worldwide, covering USA, Canada, UK, Japan, Europe, Asia, Australia/New Zealand, and more.
GP were long-time SAP Hybris users, deployed on traditional physical infrastructure, on-premise in Data Centers hosted in Sydney. As part of a move to expand their online offering to other countries outside of Australia, GP looked to the cloud to add flexibility and resiliency to their infrastructure.
To support their expansion, GP needed to find the right partner to provide a platform for SAP Hybris to scale for anticipated surges in traffic (including sales promotions and holiday periods), add extra resiliency, and take full advantage of cloud technologies. GP was also going through a period of change and open to redesign with all elements of their infrastructure being under review.
Deployments of new code resulted in scheduled downtime to the GP site, located only in Australia. Fortunately for GP, this didn’t cause a huge impact to revenue since these deployments were done outside of Australian business hours. However, as GP looked forward to global expansion, they needed a new solution for updates that would minimize downtime at all times, decreasing disruption to customers.
Scalability is critical for any e-commerce business, and this was especially true for GP. While GP’s infrastructure allowed them scaling to handle anticipated surges in traffic (pre-planned sales, etc.), their target demographic meant that ad-hoc, instant surges in traffic (typically driven by social media) happened occasionally and by surprise. Their existing on-premise infrastructure setup meant that quickly scaling to handle the sudden surge of traffic was sometimes too slow to react, leading to issues with the website including poor user experience and inability to transact business.
GP came to Ultra Commerce and took advantage of their Platform as a Service (Ultra Commerce BYOL), professional services, and expertise with Amazon Web Services (AWS).
Thanks to Ultra Commerce, GP was able to make the most of a number of AWS services. First, to address the restrictions of on-premise infrastructure hosting, Ultra Commerce used AWS Database Migration Service to migrate GP site from MSSQL to Aurora with AWS Schema Conversion Tool. This combination ensured a smooth transfer to the AWS Cloud with little to no interruption to daily business.
Ultra Commerce also used AWS Elastic Compute Cloud (EC2) with Elastic Load Balancing, AWS Relational Database Service (RDS), and AWS Simple Storage Service (S3) to make an easier setup, operate, secure, scalable, available, and a high performing environment for GP in the AWS Cloud. Continuing to increase performance of the GP digital commerce solution, Ultra Commerce implemented AWS CloudFront, creating a better user experience for customers globally.
To address GP’s need for high global availability at scale, Ultra Commerce utilizes AWS EC2 Instances to perform code deployments in such a way that reduce the duration and frequency of downtime windows when deploying new code. Ultra Commerce also allows for 24/7 code deployments, even in Production, meaning GP can perform deployments at a time that suits them.
Additionally, Ultra Commerce takes advantage of the ease of scalability that AWS offers which allows GP to quickly add additional resources during unexpected peak times. This differs from their previous hosting situation where new physical infrastructure needed to be purchased well in advance.
Once commencing their relationship with Ultra Commerce, GP noticed an improvement in site performance, availability, and scalability – at a reduced cost, thanks to the smooth migration to the AWS Cloud.
Attaining their expansion goals, GP expanded to over 8 regions of online stores globally, transacting business 24/7/365. Ultra Commerce has eliminated downtime for code deployments, allowing GP to stay online at all times to be competitive in their market.
Without fear of their site slowing down or going offline due to unexpected high user loads, GP comfortable executes large scale sales and marketing campaigns. Ultra Commerce’s ability to quickly react to GP load requirements in the AWS Cloud has kept the online stores highly available with their guaranteed Service Level Agreement (SLA) of 99.999% uptime.
GP now delivers increased customer experiences with their new digital commerce solution to more customers globally. Ultra Commerce has proved a successful partner in supporting GP goals for global customer growth and business expansion, running millions in revenue through Ultra Commerce in the AWS Cloud.
CEO of Ultra Commerce, Matt Hyland, is frequently asked why he is so energised and excited about coming into work every day at Ultra Commerce. Today at our quarterly all staff briefing Matt gave his reason as to why.
Even though the day to day operations can become consuming and present really difficult challenges, Matt is pushed every day by witnessing our company vision coming true – to be the market leading digital commerce solution for enterprises globally. Matt says that is super important to remain focused on the big picture, connecting what appear to be seemingly small tasks that are actually active evidence of our company vision being fulfilled – “important to ensure that everything that we are doing is in some way moving the ball forward”.
Every day Matt sees employees oozing positive energy and excitement about what we do. Being surrounded by high-quality people who are passionate their product is really what motivates Matt and makes the long hours and extensive travel all worthwhile. “The work people do here is truly inspirational. We’re not a typical nine to five company where you fly under the radar, you can make a difference and have influence” says Matt Hyland.
Matt has a long background of managing high profile large teams of people but Matt says, “This has been my most difficult but most stimulating position yet”.
Full of passionate highly motivated and invested employees focused on being Digital Commerce solution experts providing thought leadership, Ultra Commerce benefits from radiated positive energy through the company which is stimulating new growth in our market. Starting with our CEO all the way to newly employed members of the team, this is what motivates Ultra Commerce.
Novartis is one of the world’s largest international pharmaceutical companies supporting multiple divisions in medicine, millions of products, and over 200 innovative projects.
In 2015, Novartis launched an ambitious Hybris eCommerce program for its Surgical Eye Care division, with the dual objectives of delivering a best in class customer experience, while streamlining internal processes to reduce manual work.
Under the original platform solution Novartis experienced a 3 to 4 week platform build lead time, delaying the release of important application features and stability improvements. Also, the solution did not satisfy strict security requirements for the pharmaceutical industry. The outcome of these business critical issues was the launch RFP and the section of the UltraServe SmartSack solution.
In three months, from July to September 2016, UltraServe used its Platform as a Service (PaaS), SmartStack, with SAP Commerce Cloud on Amazon Web Services (AWS) to launch Novartis’s digital commerce solution. SmartStack offered Novartis the scalability they needed at scale and matched industry required security requirements.
“Clearly experts with Hybris technology and AWS, customer focused and great to work with, the UltraServe team brought much needed stability to the platform.”
– Robin Shah, Head of IT, EMEA Region / Global Head of eCommerce solutions
As Novartis ramped up volumes on SmartStack, UltraServe worked closely with the internal teams providing the necessary environments and expertise to address performance bottlenecks, perform system upgrades and deliver additional capabilities through the regular sprint cycles.
Novartis now has a stable and performant enterprise grade digital commerce solution that meets a strict regulatory framework with the convince of continued integration and continuous deployment capabilities.
“UltraServe met our stringent security standards, and quickly became a trusted partner for our IT and business teams.”
– Robin Shah, Head of IT, EMEA Region / Global Head of eCommerce solutions
The digital commerce program has been a success story for Novartis with over 100% year on year growth equating to circa $300m of business going through the platform in 2018.
Contact an UltraServe Hybris expert today to talk in confidence about how we can help you.
DuluxGroup is a leading marketer and manufacturer of premium branded products that enhance, protect and maintain the places and spaces in which people live and work.
In addition to having a proud heritage, the business is maturing to meet an exciting future. UltraServe is helping them do that head on, with a suite of integrated platform services that can offer the scalability, responsivity and reliability to meet their ambitions.
“You’re going to experience major challenges on any e-commerce project of this scale, and if your partner isn’t experienced with projects of the same technology, scale and complexity, you can expect those problems to multiply. UltraServe demonstrated that they had not only delivered similar projects to ours but were also a thought leader in how these projects should be managed.”
Dafydd Lewis, Technical Lead, DuluxGroup
Months of discovery, analysis and planning went in to defining DuluxGroup’s digital transformation strategy. The result was a multimillion-dollar commitment to delivering a single, group-wide marketing and e-commerce platform that encompassed mobile push, point of sale and analytics.
The solution had to be fully centralised while remaining scalable across multiple geographies, businesses and audiences. At every stage, user experience and best practice were to be championed. That meant reliability – and experience – were of paramount importance when it came to selecting a partner to ensure the smooth deployment and implementation of the chosen SAP Hybris, Adobe Campaign and Adobe Experience Manager (AEM) platforms. Which made UltraServe the natural choice.
“UltraServe came highly recommended by both our digital marketing agency and SAP themselves. They had the most Hybris experience by a significant margin, and also had experience with Adobe AEM and Campaign.”
As with any large-scale, multi-market e-commerce solution, deployment, hosting and management was never going to be straightforward. However, the DuluxGroup team recognised the need for expert support early in the process.
“Hosting is often deceptively simple. It’s seen as a commodity to purchase, but it needs expertise to launch successfully without racking up technical debt. With such a large, complex and evolving project, we didn’t know exactly what would be needed when we started. UltraServe had that experience.”
By getting involved sooner, the DuluxGroup team – led by Dafydd Lewis – was able to mitigate against risk at launch and beyond. In addition to hosting, UltraServe managed deployment and patching while automating as many processes as possible. By removing human intervention, UltraServe greatly reduced the potential for error.
“UltraServe took the uncertainty out of hosting solutions. And they did so in a way that flexed to accommodate the fluid nature of the project. They were hugely responsive and went above and beyond to meet all our support needs.
With UltraServe’s instantly scalable services in place, DuluxGroup can be confident that their platforms are ready for whatever the future brings, be that international growth or e-commerce expansion.
- The deployment of an integrated platform to ultimately support 60+ e-commerce and content sites
- Integrated management and analytics spanning multiple geographies
- Instantly scalable, completely recoverable platforms
- Recouped opportunity cost by decreasing the need for post-implementation support.
Contact an UltraServe Hybris expert today to talk in confidence about how we can help you.
Businesses are expected to be available around the clock to meet customer needs and market challenges, but the only way to effectively achieve these goals is by ensuring that the company’s digital commerce solution is humming along like a well-oiled machine. An ITIC study showed that 81% of its survey participants indicated a loss of over $300,000 due to downtime, while large enterprises suffered losses of over $5 million. Updates are a critical part of competitive in the marketplace and maintaining software infrastructure. However, updates are also a headache, a system-wide update can result in significant downtime.
Updating a digital commerce solution does not need to be an all-or-nothing proposition. The UltraServe team understands how critical updates are to supporting the health of enterprises. It has implemented a way to decrease system downtime while improving the digital commerce solution infrastructure via rolling updates. How can the deployment of rolling updates support enterprise success?
Get the ball rolling
Usually, traditional software updates involve taking the application servers completely offline. This allows developers to install the upgrades and run tests to ensure that the updates work as they should. Traditional updates do not always run smoothly, and a bug in an update can result in significant downtime for a business. Rolling updates, however, sidestep the issues with traditional updates. Deploying a rolling update means that a system upgrade is managed in phases, with a server (or subset of servers) getting the updated program first. This ensures that there is no need for a system-wide restart. Rolling deployments offer three main benefits:
- Zero-downtime to a digital commerce site. Perhaps the most important aspect of deploying rolling updates for a digital commerce solution is the impact on the application’s downtime. Without access to a digital commerce companies website, customers cannot make purchases or engage with representatives, and employees cannot execute their duties, such as processing orders or managing inventory. However, since only one server (or a few servers) is updated at any stage in the updating process, other parts of the digital commerce platform will be unaffected, allowing customers to interact with the business and employees to manage mission-critical tasks.
- Highly automated, lower resource requirements. Since the rolling deployment focuses on implementing an isolated update or limited series of updates, developers only need to concentrate on a restricted set of functionalities; this frees up developers to deliver higher levels of service for the specific updates. In addition, since there is no need to take down all of the servers simultaneously to perform the updates, fewer resources are needed at any given part of the rolling deployment to support the modifications in the system. The business can leverage those resources for other, high-value tasks.
- Seamless deployment of customer experience updates. Rolling updates effortlessly to ensure that the business’s customer experience is relatively frictionless, with little or no interruption. The entire digital commerce system can be updated in simple phases, without impacting user access with issues that may possibly arise in other parts of the platform. Customers continue to interact with the business while enjoying the benefits of the improved software platform.
Deploying rolling updates serves businesses by ensuring that your site has little to no downtime for customers to continue to transact business with no interrupted user experience. Most digital commerce platform services cannot successfully manage rolling deployments. The experienced team at UltraServe has been delivering scalable digital solutions for almost 20 years and has successfully managed rolling deployments. With its deep knowledge of Hybris, the team manages mission-critical commerce applications in the cloud, so businesses can focus on growing, not wrangling with their software solution. Contact the UltraServe team today to attain the time and resource savings of rolling deployments.
The digital commerce industry is a diverse one, encompassing a bewildering array of tools, systems, and data for both buyers and sellers as well as covering everything from online payment encryption to mobile shopping and beyond.
Enterprises with online presence usually make use of a digital commerce platform or store to conduct both sales and online marketing activities and oversee fulfillment and logistics. With the rising dominance of digital commerce, the retail industry is undergoing a seismic paradigm shift. Digital commerce platforms and marketplaces are transforming the way people purchase items, becoming the more preferred method of shopping for consumer markets in U.S., Europe, and Asia.
The continuous growth of digital commerce
Over the years, the digital commerce industry has become synonymous with continuous growth, with the last 14 years seeing the massive growth of digital commerce companies across the board. This has been even more spectacular for merchandise lines such as beauty and clothing products, which averaged a remarkable 25 percent growth in compound annual growth rate (CAGR) between 2000 and 2014.
Statistics show that in 2016, shopping on digital commerce platforms accounted for 11.7 percent of overall retail sales, totaling a whopping $394.86 billion. This represents approximately 42 percent of all growth in the year 2016, with the digital commerce industry showing a 15.6 percent increase from 2015 figures.
The massive shift from traditional retail shopping
In the U.S., this massive shift from traditional retail shopping to digital commerce platforms has been fuelled by a number of factors, one of which is the increasing popularity of flash sale event days such as Black Friday. In 2017, sales from Black Friday totaled nearly $5.03 billion, and this massive success led to its adoption by other countries such as India, the Netherlands, the UK, et cetera. Although impressive, sales from Alibaba’s Double 11 festival in China was even more spectacular, raking in an unprecedented $25.3 billion in 2017. This trend shows no signs of slowing down.
Massive potential for improved revenue generation
Projections show that overall digital commerce revenue in the U.S. will exceed $638 billion by 2022, with the sale of accessories, footwear, and apparel expected to surpass $123 million. Retail sales worldwide are predicted to exceed $4.058 trillion by 2020, while reports from eMarketer indicate that the number of digital buyers may exceed 2.14 billion by 2021.
Also, the Quarterly Retail digital commerce Sales report released by the U.S. Department of Commerce shows that when compared to 2017 figures in the same time period, the first quarter of 2018 recorded a 16.4 percent increase in digital commerce sales. It is indeed clear that now is the best possible time for enterprises to tap into the power of the digital marketplace and grow their digital commerce businesses.
In 2015, the global digital commerce platform market was valued at $4.44 billion. A recent study carried out by Transparency Market Research indicates that the global demand for these platforms will increase by 14.8 percent, reaching an estimated $15.30 billion by 2024.
Growing demand for digital commerce platforms
The growing demand in the global market for digital commerce platform is driven by the all-pervasive nature of internet connectivity and the continuous rise in the use of consumer electronics. These factors contribute to both the growth of digital media and the digital commerce sector. The increasing demand for digital commerce platforms worldwide can also be attributed to the evolving nature of cloud computing services, making it much easier for consumers to access digital content.
However, more progressive growth is restricted by numerous factors including the growing security and safety concerns with regards to malware and spyware as well as lack of marketing skills shown by major players in the market.
Currently, North America holds the leading position in the global digital commerce platform market in terms of revenue generation and demand volume. This has been attributed to the massive base of digital media users, the attendant high use of smartphones and devices as well as high-speed internet services and data networks. North America’s retail segment is already a major source of revenue for market players in the industry, while its B2B segment is showing phenomenal growth within the digital commerce platform market.
The dominance of digital commerce platforms
Businesses can no longer ignore the increasing importance/dominance of digital commerce platforms as a sales vector. The everyday demands of modern life mean that there is less and less time for people to spend on nonrevenue generating activities such as shopping, meaning that more and more people will come to appreciate the ease and stress-free nature of online shopping. To stay relevant and competitive, businesses must look for ways of exploiting this trend to improve customers’ shopping experience and protect their customer base.
Increasing popularity of PaaS as a deployment model
Unlike their predecessors, however, the new generation of digital commerce marketplaces will become more localized and industry-specific. Companies want digital commerce platforms that will enable them to solve particular problems for a specific region and/or target customer demographic. As such, they require a digital commerce platform solution that is easy to develop, deploy, use and scale, thus ensuring success and profitability in the long run. Currently, the deployment models for digital commerce platforms are segmented into open source, fully managed Platform as a service (PaaS) and on-premise.
Although each deployment model comes with its advantage and disadvantages, cloud-based PaaS solutions are becoming increasingly popular due to a low total cost of ownership (TCO), capability for Payment Card Industry compliance and security, launching speed, easy integration, and process automation as well as reduced downtime.
UltraServe’s PaaS – SmartStack
The UltraServe digital commerce solutions offers 18 years of industry experience, a 24/7/365 global support team and our leading PaaS solution, SmartStack.
Deploying in 25% of the time, SmartStack controls your AWS Cloud while enabling your data and application (SAP Hybris, Magento, or Adobe Experience Manager). This combination allows for a decreased, risk, time, and money.
Increase your customer’s experience through a seamless digital commerce ecosystem, orchestrated with microservices.
Sydney | Australia
Gosford | Australia
Chicago | United States
Grand Rapids | United States
London | United Kingdom