SAP Datasphere Architecture

 



SAP has retained all of the functionality of SAP Data Warehouse Cloud (SAP DWC), while adding new functionality that improves the discovery, modelling and distribution of enterprise data. This evolution has had no impact on the workload of SAP DWC customers. The update is performed automatically, so no migration is required. This will be the case for all new functionalities

Accessing and using diverse data from different information systems and locations such as cloud providers, on-premise systems and different data sources has always been a complex challenge for organisations. The processing that this data undergoes in order to centralise it and return it afterwards (extraction, transformation, export, etc.) leads to the loss of its business context. SAP Datatsphere gives its customers the benefit of an enterprise data fabric architecture that harmonises critical data (SAP and non-SAP) in a single way and rapidly delivers meaningful data with business context and logic.

SAP Datasphere is based on the SAP Business Technology Platform (SAP BTP), which includes robust enterprise security capabilities, including database security, encryption and governance.

SAP Datasphere follows a simple 3 layered Architecture. 
  1. Data Integration
  2. Data Modelling
  3. Data Consumption

SAP Datasphere can be connected via Cloud source, On-premise Sources and API external data load. 
Data Integration is done with in-memory database called Hana Cloud where you can use its capabilities including data lakes and virtual data access and replication. We also have Data Marketplace from where we can also take the data like currency exchange rates or other other data sets which is available on open market. We can also use replication flows and data flows to bring in the data from your external SAP systems. 

In this way, SAP Datasphere opens its connections to both SAP and Non-SAP Source systems that are either on-premise or cloud platforms. In addition, SAP has announced strategic partnerships with leading data and AI companies including Collibra, Confluent, Databricks, and DataRobot. These partnerships expand SAP Datasphere and enable companies to build a unified data architecture that securely brings SAP software and third-party data together.


Data Modelling in SAP Datasphere is a huge concept in the overall architecture. Following are covered in this part.
  1. Business Modelling
  2. Data Modelling
  3. Data Marketplace
  4. Data Space
  5. Data Catalog
  6. Data Governance
Lets talk about the key features.

Space management: 
Create spaces tailored to your business needs and monitor them. You model your data within spaces. Spaces are decoupled, yet open for flexible access. Decide on the size, storage type, and importance of your spaces. Add users and connect your sources in the spaces.

Data integration and data flow: 
Access data from SAP and non-SAP on-premise and cloud sources. Connect data virtually or replicate it in real time or scheduled via data flows powered by SAP Data Intelligence. Use APIs or tools to access data. Implement data preparation with transformations and scripting for advanced requirements.

Data builder: 
Define data models for your data using a technical, model-driven approach in the graphical tools or in the powerful SQL editor of the data layer. As a data engineer, model, combine, and harmonize data in a unified, standardized way. Flexibly update data models.

Business builder: 
Model your business scenarios in the graphical tools of the business layer independently of the data layer. As a BI analyst, model in a demand-driven way using business language to answer common questions independently of IT. Map your models to the data layer.

Administration and security: 
Manage settings on system level, such as connectivity and data integration settings, security, auditing, and monitoring settings. Manage self-service IP allowlists, database access, and others. Define security on all layers. Manage access on tenant, functional, and space level, and configure secure connectivity to sources. Manage data access by defining row-level security on data and business layer. Enable auditing for read and change operations.

Business catalog: 
Access, maintain, and manage all objects in your system based on provided tools.

Business content: 
A large set of SAP delivered and partner managed content is available to accelerate application development.

Data Consumption in SAP Datasphere can be done using multiple options like SAP Analytic cloud and other 3rd party Analytic tools. We can connect our standalone SAP Analytics Cloud solution or consume available models with the SQL tool or BI clients of choice.


Comments

Post a Comment

Popular posts from this blog

SAP Datasphere Data Integration - Part 1 - Introduction and Integration using Remote Tables

Image
SAP Datasphere provides a large set of default connections to access data from a wide range of sources, source from SAP as well as non-SAP sources or partner tools, residing in an cloud as well as on-premise environment. Connections are defined in a separate view which can be found in the main navigation window of the left. Connections are individual objects in SAP Datasphere. They are created and maintained per SAP Datasphere Space which means only members of a specific Space are able to make use of the related connections. These connections can be then be used within the different tools (like SQL View Builder, Graphical View Builder or Data Flow) for creating your data models. SAP Datasphere can integrate with both SAP or Non-SAP Source systems and it can be either cloud or on-premise. We have multiple connection types in SAP Datasphere. Each connection type supports a defined set of features. Depending on the connection type and the connection configuration, a connection can be used...
Read more

SAP Datasphere - Data Integration - Part 2 - Data Integration based on Data Flows and External Sources

Image
Data Integration based on Data Flows: A Data Flow is used as per SAP Definition “to move and transform data in an intuitive graphical interface”. The Data Flow is created within the part of the Data Builder in SAP Datasphere, and it currently supports the following operators to be used within your transformation process:  Join Operator  Union Operator  Projection Operator  Aggregation Operator  Script Operator  As we are coming from a strong Business Warehouse background, we are always comparing things to the past. Which in our case would be a classical SAP BW on HANA or SAP BW/4HANA. We currently see the Data Flow as a substitute for what used to be in a BW system the transformation.   In the data flows, we will be able to use a series of standard transformations without the need of programming knowledge and in a graphic way, but we also have the possibility of creating transformations based on scripts. In a data flow, we will use views or tables...
Read more

SAP Datasphere - Data Builder types and creation of Tables

Image
 There are different artifacts available in the Data Builder as below. Table Graphical View SQL View Entity-Relationship model Analytic model Data Flow Replication Flow Transformation Flow Intelligent Lookup Task Chain Now lets discuss on them in detail. Tables: Column structure of the tables can be defined either manually or by using the existing data as template. These are going to get the information from different source systems like flat file / sap / non-sap and can be filled with data from a CSV file or via a data flow. While creating a table we can define the following: Technical and Business names Data Type Semantic Usage Label Column Primary Keys Default values  can be/not null Visibility of the columns We can also delete current data and upload new data from files and share the current table with other spaces. Hierarchies could be created and the generated CSN annotations could be edited in order to make it synchronize with the expecting changes. Lets discuss th...
Read more