What is Data Profiling

What is Data Profiling


Data profiling is a technique used to analyze the content, quality, and structure of source data. Use Power Center Data Profiling to detect patterns and exceptions of source data during mapping development and during production. Use data profiling to make the following types of analyses:
  • Make initial assessments.
  • Validate business rules
  • Verify assumptions.
  • Verify report validity.
Make initial assessments. You can make initial assessments about data patterns and exceptions data during mapping development. As a result, you can design mappings and workflows on actual data, rather than make theoretical assumptions about sources.
Validate business rules. You can validate documented business rules about the source data. For example, if you have a business rule requiring columns in a source table to contain U.S. ZIP codes, you can profile the source data to verify that the rows in this table contain the proper values.
Verify assumptions. You can verify that the initial assumptions you made about source data during project development are still valid. For example, you may want to view statistics about how many rows satisfied a business rule and how many did not.
Verify report validity. You can use data profiling to verify the validity of the Business Intelligence (BI) reports.

Comments

Post a Comment

HTML/JAVASCRIPT

Popular posts from this blog

Teradata SQL Assistant Shortcuts

Teradata SQL Assistant Shortcuts ctrl + T This will clear all the queries in the Teradata Query Editor ctrl + Q This will format the query in the Teradata Query Editor ctrl + D This is used to comment and uncomment the selected query text in the Teradata Query Editor F11 This will get you the last error message ctrl + C This is used to copy the selected Text in the Teradata Query Editor Ctrl + P This is used to paste the copied content into the Teradata Query Editor Ctrl + F This is used to find a Text in Teradata Query Editor Ctrl + H This is used to Find and Replace the Text in Teradata Query Editor Shift + F10 + I This will get you the current date in the Teradata Query Editor F5 This will execute the Query in the Current Query Tab in the Teradata Query Editor F6 This will get you the execution plan for the query in the Query Editor F9 This is used to execute the Query in Parallel.
Read more

How to List All Tables in Oracle, MySql, Teradata, DB2 and PostgreSQL

Very Often we may need to check avaiable tables in a database or list columns in a table.every database has its own syntax to list the tables and columns.Here we will see How to List All Tables in Oracle, MySql, Teradata, DB2 and PostgreSQL. Oracle To list all tables owned by the current user, type: select tablespace_name, table_name from user_tables; To list all tables in a database: select tablespace_name, table_name from dba_tables; To list all tables accessible to the current user, type: select tablespace_name, table_name from all_tables; To describe a table, type: desc <table_name>; MySQL To list all databases, in the MySQL prompt type: show databases Then choose the database: use <database-name> List all tables in the database: show tables Describe a table: desc <table-name> DB2 List all tables: db2 list tables for all To list all tables in selected schema, use: db2 list tables for schema <schema-name> To describe ...
Read more

7473 Requested sample is larger than table rows. All rows returned

Explanation: This is a warning message. It occurs when the total number of rows requested in the sample is larger than the total number of rows in the table. Generated By: AMP Sample Step code - stpsamp. For Whom: End User. Remedy: In this case, all the rows in the table will be returned. Each sample request will be honored until the total number of table rows has been reached. After that, no rows will be returned for the sample.
Read more