Big Data Mechanisms overview

Technology mechanisms represent well-defined IT artifacts that are established within an IT industry.

Versie 1.0
Creatie datum 02-05-2021

Analytics Engine

Functionality for analysing the transformed and standardized data in a data analytics tool.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Analytics Engine

Cluster Manager

Management of clusters in a distributed or cloud based infrastructure

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Cluster Manager

Compression Engine

Big data sets can be voluminous so compressing has advantages for storage and/or processing

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Compression Engine

Coordination Engine

Coordination of automated tasks for example in batch processes and mapreduce.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Coordination Engine

Data Governance Manager

Register function for the governance of data sets in relation to consumers, business owners and qualities.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data Governance Manager

Data Transfer Engine

Transformation and transfer functionality from data sources to storage, processing and usage.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Data Transfer Engine

Processing Engine

Processing of data for transformation, cleaning and filtering of data

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Processing Engine

Productivity Portal

Portal functionality to give users and administrator access to the other logical functionalities in a Big Data environment.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Productivity Portal

Query Engine

Retrieval and querying function on the transformed and standardized datasets

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Query Engine

Resource Manager

Management function for the various resources in a Big Data environment

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Resource Manager

Security Manager

Administration and registration of security concepts in a Big Data environment.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Security Manager

Serialization Engine

Serialization and deserialization of proprietary datasets to standardized stored datasets

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Serialization Engine

Storage Device

Storage function of big data sets.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Storage Device

Visualization Engine

Visualisation of query and analytics results to data scientists and end users.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Visualization Engine

Workflow Engine

Functionality to design workflows to automatically perform transformations and cleaning of datasets.

Auteur Bert Dingemans
Alias
Stereotypes ApplicationFunction
Details van Workflow Engine