BI City

Most Popular

Techniques to Handle Big Data in BI Data Integration

By SiliconIndia   |   Thursday, 10 May 2012, 04:37 Hrs
Print Email

Bangalore: The quality of Business Intelligence systems and their supporting data warehouses depends heavily on the quality of the data that they deal with. Incorrect handling of BI data integration can land your end users and your organization in dilemma.

Now, as BI tools penetrate into organizations and determine the success of business operations, utilizing a fool proof way to integrate BI data is crucial. The data integration issues have been a major constraint on the progress of BI, quite often leading to project failures.

Recently, due to the changing complexities of data (with 'Big Data' also in the picture), matching and making the data ready for BI application is turning out to be a nightmare. In addition, for older systems it becomes necessary to interpret the data. When faster access to BI information is required, the problems become quite complex.

The traditional technology used for BI data extraction is ETL (Extract, transform and load) software. This manages BI data extraction by extracting the requisite data from source systems. Newer data integration techniques seem to reduce the delays as they stream the data in granular form as compared to the ETL which manages streaming in huge chunks. Another option is a virtual approach which will not move the data from its source system. Instead, data can be viewed from multiple sources for BI uses. However this never antiquates ETL, which will be used as long as there is data that cannot be delivered in real time.

The analysis of Big Data makes BI data integration more complex in many organizations. Organizations that are planning or have just started the implementation of big data analysis should be prepared for data integration issues, starting with the capital and manpower to deal with challenges like huge inputs of data obtained from social media.

Real time integration is expensive and only a strong business need for it warrants the usage. Yet we can't deny that analytics applications are moving towards real time data integration. So one may deduce that BI is at interesting crossroads.

Experts on BI
Sanjeev Kumar Sharma
Managing Director
Harish   Pandey
BD Manager
Niranjan  Rout
Tata BlueScope
Rohan Anil Bhatt
Business Consultant
Dinesh Kumar Mehta
V P Operations
Roop Polymers
Gaurav  Mittal
Solution Architect
YASH Technologies
Jayant R Joshi
Delivery Manager
Tech Mahindra
Pramod Kumar Sharma
Project Manager
Suntec Web
Write your comment now
Small and medium-sized businesses stand to benefit from business in...
Data warehouse appliances that bundle analytic databases with serve...