What is Data Architecture?

Nowadays, the set of data has been increasing together with its value. In order to systematically manage and utilize large amount of stored data, the concept called Data Architecture needed to be introduced.

Data Architecture is the concept of planning and set the structure of data designed by organizations to store useful data. Data Architecture works as a blueprint to illustrate the flow of collected data within the organizations through each factors. In some cases, the complexity of Data Architecture structure of each organizations might have differences when compared to others based on their functions and goals.

3 Essential Components of Data Architecture:

  • Data Warehouse
  • Data Mart
  • Data Lake

Data Warehouse

Data Warehouse collects relative data set from different sources within the organizations which it works as a single central storage. After collecting, data flows through ETL process (Extract-Transform-Load). During this process, data will be transformed repeatedly to match the expected result.

Data Mart

Data Mart is similar to Data Warehouse but Data Mart is consist of smaller data set, it works as a minor subset of arranged data to allow users in those organizations gain access and utilize the data in those particular tasks. Dara Mart is suitable for supporting organizations, businesses, departments, and teams by enabling time-saving access to the data when dealing with large-sale data set.

Data Lake

Data Lake is the area where larger amount of raw data is stored without being transformed or categorized from its origin, while Data Warehouse stores processed data. High flexibility in storing data in Data Lake is beneficial to Data Scientists, Data Engineers, and Developers to explore and utilize the data in machine learning works.

Benefits and Importances of Data Architecture

  • Facilitating the organizations and internal users to access the data with ease and also match their functions.
  • Assisting in systematically storing data.
  • Assisting in managing Data Life Cycle to be more convenient in the future
  • Increasing data security and privacy.

Focal-point for engaging in Data Architecture

  • Complexity of data usage by general users (non-developers), because stored data are diverse by their functions used by various users which are not only from IT department.
  • Storing data on Cloud-native/ Cloud-Enable system. This will reduce limitations and allow data to be accessed with convenience.
  • Designing the structure of data to match users’ objectives to reduce the difficulties in data usage. As a consequence of varied users, the data is needed to be categorized to fit users’ tasks properly.
Facebook
Twitter
Pinterest
LinkedIn
Latest Post

What is Data Governance?

In the age of shifting to digital transformation, data has become the value asset among various organizations throughout the world. In the data-driven world, managing

Read More »

รู้จัก Data Pipeline และ Data Architecture ฉบับผู้เริ่มต้น

หลังจากที่เราทราบถึงประโยชน์ของการทำ Data Analytics กันแล้ว (Data Analytics 101 – “ก้าวแรกสู่การทำ Data Analytics” ปรับมุมมองทางการคิด เพื่อช่วยให้คุณคิดแบบ Analytics ให้มากขึ้น) ในบทความนี้จะพาทุกท่านไปเห็นรวมว่า Data มาจากไหน เก็บไว้ที่ไหน และภาพรวมโครงสร้างของการเก็บ Data เป็นอย่างไร ผ่านสิ่งที่เรียกว่า Data Pipeline

Read More »

Dashboard Canvas

To make the dashboards impactful for business, we need to start analyzing the needs of business and technical availability before designing the suitable dashboard. We can do so by using Dashboard Canvas proposed by Davoy.tech.

Read More »

Best Free SEO Tools for 2022

You don’t need to purchase high-tier tools for everything. Depend on your circumstances, may you need an SEO tool for your backlink checker, link building, a page optimization, content marketing, on-page SEO, Keyword ideas etc. Have fun exploring the wide choices of SEO tools and you may find something that suits you!

Read More »