Change data capture
Data staging and change data capture processes
Cloud Data Warehouse
The case for making the move
Growing popularity
Cloud data warehouse solutions increasingly popular because, historically, the only clear choice for most organizations was on-premises data, often using an appliance-based platform. Now the costs of scale are gnawing away at the idea that this is the best approach for all or some of a company’s analytical needs.
Scaling challenges
Modern appliances deliver power and familiarity, but budget constraints make it difficult to scale up additional appliances to expand storage, analytical workload capacity, or disaster recovery. Purchase and maintenance costs for an additional appliance can hinder information management and analytical capabilities. Other concerns are the real estate needed for additional appliances, complexity, and in-house talent needs. Still, the business need for data creates a need for warehouse appliance capacity.
Growing data volume and sources
Significant amounts of important data are sourced from the cloud. Other valuable analytical data are born in the cloud. The sheer mass of data “out there” rather than “in here” causes data gravity to shift externally, so organizations pulling data from the cloud—integrating, transforming, and storing on-premises—move the heavier data load to the analytics, rather than just take the analytics to where the data lives.
Data volumes, business needs, and information appetite.
On-premises enterprise data warehouses (EDWs) and analytical platforms often operate near capacity in terms of storage or performance. Plus, much of this data is highly valuable and mission-critical. Companies maintaining multiple appliances for disaster recovery and testing/development grapple with data volume, performance overload, and the cost of maintaining multiple environments.
Improved economic options with cloud data warehouses
The cloud now offers attractive options with better economics such as pay-as-you-go, which is easier to justify and budget, improved logistics, and better scale (elasticity and the ability to expand a cluster within minutes).
Cloud platforms offer multiple adoption possibilities
Many enterprises fully embrace cloud data warehousing, making it accessible across their current infrastructure and data ecosystems. Others adopt a secondary platform for disaster recovery and offloading analytic and data transformation workloads.
Factors to consider when choosing a cloud data management solution:
Data quality
Quality assurance, data validation, profiling, and data quality
Error handling
Exception handling processes, load job restarts, rollbacks, audits, and data traces
Level of service
Data availability service-level agreements and windows for extraction
Data protection
Security, privacy, and encryption
Emergency management
Disaster recovery
A secondary platform
Many enterprises are adopting a secondary platform for purposes such as disaster recovery and offloading analytic and data transformation workloads. The EDW can serve as an asset, coexisting and spanning both on-premises and in the cloud—whether public, managed, or private cloud. In some cases, organizations consider load balancing by moving integration or analytic workloads off on-premises EDWs to an EDW in the cloud. With a hybrid architecture, a company has many choices and doesn’t have to abandon one in favor of the other.
Scale dynamically with cloud bursting
Teradata has a robust hybrid cloud capability and offering. Customers can use cloud bursting to dynamically scale capacity among multiple EDW environments on-premises or in the cloud.
Hybrid cloud for a more manageable jump
Data synchronization is the key to making most hybrid cloud use cases work. A hybrid cloud architecture allows organizations to enter cloud-based data warehousing to solve workload, performance, compliance, and disaster recovery.
Cloud data warehouse security
Cloud computing revolutionized the way organizations manage their data. Along with this accelerating trend comes questions about security. Executives want to leverage as-a-service offerings to take advantage of agility and on-demand consumption—and at the same time there may be anxiety about entrusting core elements of IT infrastructure to an external provider.
Cloud security compliance
A cloud data warehousing service architecture should comply with strict international standards such as Cloud Security Alliance (CSA), General Data Protection Regulation (GDPR), Health Insurance Portability and Accountability Act (HIPAA), International Standards Organization (ISO) 27001, Payment Card Industry (PCI), and Service Organization Control (SOC) 1 and 2.
Cloud warehousing and business outcomes
Customer experience
Analyze big data to help deliver relevant, personalized experiences in real-time, influence customers’ journeys to align with desired business outcomes.
Quality assurance
Radically improve product quality and enable continuous yield improvement to achieve zero accident/zero defect manufacturing.
Operational excellence
Manufacture on demand, assemble to order and make to stock efficiently and responsively by creating adaptive manufacturing capabilities.
Production innovation
Companies must create new products, improve existing ones, and manage multiple product lifecycles while addressing product and supply chain issues.