Datastage Designer Overview

The Datastage Designer is the primary interface to the metadata repository and provides a graphical user interface that enables you to view, edit, and assemble Datstage objects from the repository needed to create an ETL job.

An ETL job should include source and target stages. Additionally, your server job can include transformation stages for data filtering, data validation, data aggregation, data calculations, data splitting for multiple outputs, and usage of user-defined variables or parameters. These stages allow the job design to be more flexible and reusable.

Datastage Designer enables you to:

·         Create, edit, and view objects in the repository.

·         Create, edit, and view data elements, table definitions, transforms, and routines.

·         Import and export DataStage components, such as projects, jobs, and job components.

·         Analyze the use of particular items in a project.

·         Edit and view user-defined object properties.

·         Create jobs, job sequences, containers, and job templates.

·         Create and use parameters within jobs.

·         Insert and link stages into jobs.

·         Set stage and job properties.

·         Load and save table definitions.

·         Save, compile, and run jobs.

       Datastage Designer Window

The Datastage Designer window, which is the graphical user interface used to view, configure, and assemble Datastage objects, contains the following components:

·  Repository Window: Displays project objects organized into categories. By default, the Repository window is located in the upper left corner of the Designer window. The project tree displays in this pane and contains the repository objects belonging to a project.

·  Tool Palette: Contains objects that you add to your job design, such as stage types, file types, database types, and processor objects. You can drag these objects from the Palette into the Diagram window. By default, this window is displayed in the lower left corner, of the Designer window. This window appears to be empty until you open or create a job.

·  Diagram Window: Serves as the canvas for your job design. You drag, drop, and link stages and processor objects to create jobs, sequencers, and templates.

·  Property Browser: Displays the properties of the currently selected stage of the job that is open in the Diagram window. By default, this window is hidden. To open it, select View, Property Browser from the menu bar, and then click a stage to see its properties.

What is a Datastage Job?

 

A job is an executable Datastage program. In Datastage, you can design and run

jobs that perform many useful data integration tasks, including data extraction, data

conversion, data aggregation, data loading, etc.

 

DataStage jobs are:

• Designed and built in Designer.

• Scheduled, invoked, and monitored in Director.

 

Datastage Job design approach:

·  In Administrator, Create the project and set project properties.

·  In Manager, import metadata defining sources and targets as per your requirements for the project.

·  In Designer, add stages defining data extractions and loads, Transformers, link partitioners or link collectors to provide the flow of data from source to target and other stages to defined data transformations.

·  Define Job parameters to be used.

·  Save and Compile the job.

·  In Director, validate, run, and monitor your job and check logs for any errors occurred.

Types of Jobs in Datastage Jobs:

Server Jobs: These are executed by Datastage Server Engine, compiled into BASIC and does not support parallel processing.

Parallel Jobs: These are executed by Datastage Parallel Engine, have built-in functionality for pipeline and partition parallelism.

Sequence Jobs: These jobs control the order of execution of server/parallel jobs.

DS Job Types - Datastage Designer

     1. Datastage Work Area:

      Datastage Designer Canvas as shown below can contain various components of a job design. Such as we can create the job flow using stages, links, reusable routines and containers. 

 

workspace - Datastage Designer

    2.  Menu Bar :

 

It provides access to various functions of the datastage Designer. Like to create New job, Save job, Compile, run, job properties and so on.

menubar - Datastage Designer

     3. Palette:

      It provides access to various functions of the Datastage Designer. Like to create New job, Save job, Compile, run, job properties and so on.

palette - Datastage Designer

     4. Repository:

      The Repository window displays the branches in Manager. Items in Manager, such as jobs and table definitions can be dragged to the canvas area.

      Click View> Repository to display the Repository window.

Repository - Datastage Designer