Digitalization of the economy has resulted in data being the world’s newest resource for competitive advantage. Every digital process or social media exchange gives rise to data. Big Data is arriving from multiple sources at an alarming volume at a very high velocity and in a variety of forms. Making value out of these enormous data is the biggest challenge that organizations face today. Big Data has frequently been defined by the four Vs: Volume, Velocity, Variety and Value.
Big data is changing the way we do business; it is shifting decision making from a select few to a large mass of individuals who are all equipped with information to make better decisions at all levels.
Organizations need to develop a clear strategy around Analytics and how it can align with their overall business strategy, instead of piecemeal big data projects arising out of individual group imperatives. Below are a few things to remember before embarking on a Big Data journey:
• Never start with the technology but with the business need
• Start by identifying some simple use cases which can be easily understood from a business relevance perspective
• While the overall strategy should be guiding the initiative, it’s better to start small with the end goal in mind, with open source products, and a small set of people. A pilot or POC with concept and underlying technology would be a good idea.
• Change management and general stakeholder buy-in is key in any newer initiative and Big Data is no exception. Sincere attempt should be made to get stakeholder buy-in. Hence, the need for simple and relevant use cases to start with. Analytics is a team sport.
• Identify the right set of people to be part of the initiative. These should be run by people who understand the business and knows the business outcome expected from the Big Data initiative in general and the use case in particular and supplemented by Business Analysts, Data Scientists, Graphic Designers, Analytics Architect, Data Engineer, Graphic Designer. Often these skillsets are hard to get and hiring from the market might become challenging. Attempts should be made to reuse, cross train and retrain existing skillsets.
Incubating big data projects with true values is a challenge in itself for the industry. Deep understanding of structured data, augmented with relevant unstructured data, is not an easy task. From ingestion of various data sources to meaningful business intelligence dashboard is a long journey which will require a good strategy and careful planning.
In agile way, the Big Data Analytics team and the business users work in a series of iterations right from scope definition, requirements gathering, data extraction, data exploration, data analytics phases, to delivery. Working in iterations and in close collaboration with the user ensures the delivery of a meaningful business outcome, which the business users can relate to because they have been involved in the full lifecycle.
Another challenge is with respect to technology & people. The landscape is changing with a rapid pace and newer technologies are being added before the previous one has proven its worth. Finding the right mix of technology and a matching skillset is a real challenge.
Explosion of unstructured data from social media, messaging, connected devices (IoT) etc. will always have trouble fitting in the traditional data management scheme. It’s not just augmenting the database with a field or two every time there is a need. The data strategy of tomorrow has to be scalable, performance centric, secure, highly available, fast, and logically useable. Cloud is a promising answer to all these challenges. With promise of ‘anything as service’ cloud has potential to solve many Infrastructure issues arising from digital and big data transformation. "Analytics is addictive, this positive addiction quickly turns sour if your infrastructure can't keep up”- Matt Wood, AWS Data Science Chief.
Benefits Brought About by Big Data in Customer Centricity
The rise of social media has already proven that customer is at the centre and every strategy revolves (or will revolve) around her. With better persona of customer the companies are in a better position to reachout and interact with the customers. Structured data within an organization and unstructured data together can release immense business intelligence which is/will transform how companies do business today. Many start-ups, insure-tecs and fin-techs are a result of this evolution. Traditional way of doing business is no more viable. And meaningful outcome based options are emerging more and more – re pay-as-you-use, pay-how-use etc.
The most heartening evolution will be that finding the right skill will become easier as more and more young professionals are focusing on these skillsets and these areas are making entry into the educational curriculum as well.