Data Warehouse

                 

Data warehousing

Over the past decade, we have witnessed an unimaginable computer revolution.  Ten to fifteen years ago, the world could not have imagined the impact computers would have on businesses. Additionally, the availability of the internet and e-commerce has changed the way the consumers are. One of the next concepts in the computers revolution of the last decade was data warehousing. Data warehouses is divided into three main types: enterprise data warehouses (EDWs), online data warehouses (ODSs), and data marts.

1. Enterprise Data Warehouse (EDW):

EDW is the central warehouse. Provide company-wide decision support. Provides a unified approach to organizing and presenting data. It also provides the ability to categorize data by subject and enable access by those departments.

2. Operations Data Warehouse:

 

The operational data warehouse, also known as ODS, is just an indispensable data storage place when neither the data warehouse nor the OLTP system support organizations with reporting needs. ODS updates the data warehouse in real time. As such, it is widely preferred for routine tasks such as keeping employee records.

3. Data Mart:

 

 A subset of data warehouse is known as a data mart. Designed specifically for specific industries. B. Sales, Finance, Sales or Finance. Independent data stores can collect data directly from sources.

A data warehouse gathers and organizes data from business operations such as: transaction systems (registries, online ordering) technicians can analyse. The data warehouse is then made available in a variety of ways so that it can be accessed by those who need the insights. A strong performance is required for today’s complex analytics workloads. They include a wide variety of data sources and types, from structured transactional data residing on

on-premises to unstructured, cloud-born data flowing in from sensors and mobile Internet of Things (IT) devices. IT architects, business analysts, and data scientists need to integrate this data to uncover the most impactful insights. Bringing together disparate data allows for more sophisticated queries and more complex analysis, ultimately delivering deeper insights and enabling better data-driven decision making.  Whether you are looking to improve analytics performance, integrate new data sources, handle growing data volumes, or better connect data scientists with the right data, each You should consider the strengths and weaknesses of the platform. Some organizations need to holistically combine multiple data warehouse solutions to create a cost-effective and flexible foundation that can serve all users and needs across the enterprise. Site warehousing or appliance optimized for data science. A Data Warehouse is typically built with hardware and software components organized in specific ways to meet the organization's requirements and deliver maximum benefit. Therefore, a typical Data Warehouse typically includes the following basic components: data source, data store, data store, information dissemination, metadata, management, and control. Each organization's DW uses the same building blocks; however, the difference lies in the way they are arranged, and therefore, some components can be made more durable than others (Ariyachandra & Watson, 2008). The source data component captures electronic information entering the warehouse from multiple systems. It can also include internal, archived, and external data. This is followed by the execution of data staging components. This includes preparing the extracted data for storage for querying and analysis. The manufacturing process includes extract, transform, load (ETL). When extracting, care should be taken to ensure that the best technique is used for each data source. This is because the data may come in different formats from multiple source computers. Data transformation is a key step in the complete web data integration process. Additionally, depending on the integration process, data may need to be sanitized, merged, deduced, transformed, and aggregated for storage and use.

 This is followed by a data load involving two different processes. When it goes live for

 the first time, it loads a lot of data into the repository over a period of time. While the

 data repository continues to function, variations in the data source are continuously

 extracted and transformed, and incremental data revisions are continuously fed into the

 repository.

 The fundamental resource that is critical to business because it supports decision making is information. With the advancement of technology, the amount of data has increased significantly, making the task of storing, updating and efficient use increasingly complex. The answers to these, lie in the implementation of a data warehouse and the ability to use data mining methods and tools. However, for organizations to implement and recognize data warehousing and data mining, regardless of industry, several aspects must be considered. Aspects include top management support, data understanding required by the organization, governance and policies, proper data warehouse design, and the right tools or methods for data mining.

 

 References

Ariyachandra, T., & Watson, H. J. (2008). Which data warehouse architecture is the best? Communications of the ACM, 51(10), 146-147. Web.

Becker, S., A., 2002, Data Warehousing and Web Engineering, Idea Group Inc (IGI), New York

  Grable, J. E., & Lyons, A. C. (2018). An introduction to Big Data. Journal of Financial Service Professionals, 72(5), 17-20.

Khan, A., 2005, SAP and BW Data Warehousing: How to Plan and Implement. I Universe, Indiana

Slinger, G., & Morrinson, R. (2014). Will organization design be affected by BD? Journal of Organization Design, 3(3), 17-26. Web.

 https://www.google.com/imgres?imgurl=https%3A%2F%2Fwww.softwaretestinghelp.com%2Fwp-content%2Fqa%2Fuploads%2F2019%2F09%2FData-Warehouse-Fundamentals.png&imgrefurl=https%3A%2F%2Fwww.softwaretestinghelp.com%2Fdata-warehousing-fundamentals%2F&tbnid=N0jgu9_NKLIhjM&vet=10CNoBEDMosgJqFwoTCODc15-Y1vsCFQAAAAAdAAAAABAD..i&docid=kxpXnq8KIzxJsM&w=650&h=366&q=data%20warehouse&ved=0CNoBEDMosgJqFwoTCODc15-Y1vsCFQAAAAAdAAAAABAD

 www.geekinterview.com/Interview-Questions/Data-Warehouse