Sunday, October 21, 2012

Missing Perspectives in Big Data Industry

Missing Perspectives in Big Data Industry

I have been personally talking to a lot of people in the big data industry in many events I attend. For those who already know me I attend:
  • On the average one event every day of the week
  • Average one full day event every week
  • Have also moderated few panels on big data in the recent months of 2012
  • Attended few conference in the last few months ranging from 2 days to 4 days.
I have also interacted with big data industry leaders and professionals. I have talked to companies in this industry to include those who focus on:
  • Developing and Supporting Big Data Platforms - Either they offer standard open source Hadoop or rewrite some codes. We all hear Hadoop and its close cousins. Other big data platforms with totally innovative approaches are yet to be born.
  • Consulting companies, SMB and Large - Most are nothing more than job shop companies, with no big data strategy, other than hiring a lot of fresh graduates from university and college campus in USA and BRICS countries, offer them regurgitated courses while they are on "bench" and waiting for American and EU companies asking for big data programmers. Many of these large companies have the same business model for over 3 to 4 decades. Hire cheap Indian (or other countries) graduates, mostly programmers, pay them local Indian rates, while they charge American or EU rates to the respective customers. They rake billions of dollars. They just do not believe in innovation, new technology development or product development. The leadership does not understand big data strategy.
  • At least, the Chinese are presenting challenging products in software, web based products and services and significantly in hardware products in computing, telecom, wireless, mobile and consumer electronics.
  • Big Data Scientists and Companies in Big Data Science
  • Companies Specializing in Big Data Visualization hiring a lot of fresh graduates from university and college campus
This is the problem I am seeing: People are either familiar with server design at hardware level, or those who do big data are mostly Hadoop software types or data scientists.
In all my efforts, I have not found those who are knowledgeable in the intersection of how big data will create special supply chain demands and performance demands in not only servers, but also data centers and the components that go into them like processors, Solid State Memories (SSD) memories.

Additionally, there will be similar demands in networking, latency, cost etc.

Hardware supply chain can not scale up as fast as the software aspect of big data. Infrastructure building will have definite push back on big data growth.

Another important issue for big data to happen as much as we all want, knowing all the benefits of big data power, is the training of the professionals and experience to do hardware, software and networking.

The number of professionals in hardware, software and networking plus data science to derive the benefit of big data is very big, much more than the supply of graduating engineers and computer scientists, those professionals already in the work force or unemployed to be adequately trained. If all verticals, markets and companies in these were to embrace big data paradigm, the demand is many times the supply in USA, and similar supply - demand imbalance in EU and the BRICS countries.

I have even tried to discuss briefly to do the litmus test among the attendees and even the Key Note speakers types in conferences like Flash Memory Summit, ATCA Summit, video game conferences, other events in Silicon Valley area to check out if they are even thinking of in these lines I listed above. I have personally talked to big data company CEO and CTO levels. I have tried similar discussions with the Indian and American consulting companies who claim that big data practice. They are not even thinking deep enough or have enough mind share to be prepared to address the problem.

I will prepare my own presentation to address these topics. I plan to do the following sections in my presentation:

  • State of the Industry
  • Demand pull from Big Data
  • Some Industry Verticals and Market Examples
  • Potential push back from the different supply chain - processors, memory, servers, data centers, networking, cloud scale up, talent in different aspects of big data
  • Highly critical issues to include security and privacy
  • Quick provisioning, service assurance (SLA)
  • Pricing Strategy and Price Elasticity for Big Data as a Service (BDAAS)
  • Capital intensity issues for manufacturing infrastructure for the processors, memory, servers, data centers, networking
  • Play out scenarios
  • Murthy's Recommendations for the Industries and the aspiring nations: USA, EU Countries and BRICS countries.
  • Additional Topics: Missing Perspectives and Initiatives in current Big Data thought leaders.
 Feel free to contact me if you need corporate advice, a Key Note Speaker or a panel moderator:

bigdataexpert@gmail.com

Saturday, July 28, 2012

Big Data Strategy National Emergency


Big Data Strategy National Emergency

NOTE: I am sure that I have appropriately titled this particular blog. It is really alarming and high time that our country leaders take this seriously. Please read on, act on it and contact me for any discussion.

The Big Data Strategy is not limited to a particular company or enterprise one or few products or services. Conglomerates may have multiple product lines or lines of businesses made up of many business units, related or unrelated. Big data strategy could be in silos if the businesses of the conglomerate are not related. For mutually related business units, an integrated strategy would be appropriate.

Industry or vertical wide big data strategy would apply for industry associations with many companies in that industry are members. The big data strategy would encompass issues and commonalities between the member companies of the industry association.

A national level or state / province level big data strategy is very important to ensure the prudent big data policies drive the big data strategy. It would also be helpful to revisit the national, state or province level strategy from big data perspective.

Let us take examples of national or state / province level big data strategy. For example, energy department in a country like USA needs big data strategy, to leverage and exploit to the full extent the immense power of big data, not only in the legacy energy technologies and infrastructure, and surely in alternative or green technologies. Wireless Sensor Networks (WSN) in the energy generation, transmission and surely in the distribution segments, fully incorporating smart grid features with monitoring devices in residences, commercial buildings, industrial buildings and also military building and campuses. WSN embedding is pertinent in outdoor lighting, street lighting and lighting in highways, freeways, parks, airports etc.

The WSN would generate data every minute, hour, day, week, month and the whole year, needing big data methodologies to derive the best value for prudent actionable and decision knowledge.

Similarly, the state / province and national departments where big data strategy would be needed include: Department of Transportation, Department of Health and Human Services, Department of the Interior, Department of Commerce, the intelligence agencies like CIA and FBI, the difference defense departments, Department of Education, Homeland Security, Department of Finance, Department of Treasury, the list too long to list them all.

Whether it is for a company or enterprise, industry vertical, state or national agencies and departments, the strategic approach would always start at policy level. Big data policy may be revisited, 
and from it big data procedures are developed, trickling logically down to processes at different levels. A reverse big data value chain analysis from processes up to procedures and further up to policies would also be appropriate. Each big data policy item may generate and demand multiple big data procedures pertinent to different business units, departments and functional entities. For example, the human resources, finance and accounting, the supply chain, purchase, inventory, shipping, R&D, engineering, manufacturing and assembly, marketing, sales and business development, customer service and field operations would derive and conform to higher level big data processes and procedures in terms of big data value. Even the ISO and other industry standard compliance would have big data dimension or aspect to them.

Industry wide supply chain dependency should have, along with supply chain standards compliance and bench marking, big data strategy, procedures and processes fully integrated and monitored, measured and bench marked with continuous improvement leveraging and exploiting on the big data power.

Big data fully integrated at strategy, policy procedure and processes, when prudently and diligently implemented and exploited will be pivotal for national competitiveness.

Big data has the power to help exhaustively utilize every point of monitoring, measurement, trending, decision making, control and continuous improvement, which exhaustiveness never existed in the human technological history.

I would urge companies, enterprises, industry verticals, industry associations and governments quickly build their big data capability and infrastructure, or else they may be left behind. Even countries not in the international technological league can benefit from the big data revolution.

Training many types of big data professionals is the way to lay the foundation for countries to enter and competitively move ahead t the international level. To be able to have enough big data workforce to encompass all aspects and functions is also very important, because a proper balance to cover all professional categories needed in big data implementation is very vital and prudent.

To be able to conceive, design, develop and market variety of big data computing, processing, manipulation, streaming and staging, storage, querying, statistical tool development and augmentation, data science, business intelligence analysis, visualization, networking and communication for synchronous and asynchronous processes would require professionals of different technology skills and expertise, at the same time business, management and support professionals properly trained for their respective professions and functions.

Today, focus is mostly on developers, coders, data base professionals and architects. The companies, industries, industry associations, states, provinces and nations seem to be limited to a small section of the needed talent development. The primary reason is that most companies, industries and governments do not understand big data technology, tools, needed professionals, training and continuing education, especially strategic level.

Country like USA needs a Big Data Chief Information Officer (CIO) and Big Data Chief Strategy Officer (CSO). USA can not repeat appointing novices for these types of very important positions, as it has done in the recent years. To be a CIO or CSO requires decades track record in similar functions. Especially to be a CIO or CSO at USA country level, the person needs track record at large enough level to merit being and functioning at national level. Appointing poorly qualified and intellectually ill equipped individuals driven only by political motivation surely indicates lack of vision at decision making level, as viewed internationally.

As most of the appointments at many levels in USA are politically motivated and big posts are politically appointed, with very little regard to experience, wisdom and track record, I am particularly afraid that USA will miss the boat again in big data, as it has already missed areas like manufacturing, automobiles and alternation energy, finance and banking, as only examples, becoming completely and irrevocably dependent on China. Similar dependency, even though to a much lesser extent is true for software outsourcing to India, including many vital software and business process functions.

The educational institutions, at school, college, university levels and also the Department of Education need to act urgently to train students, along with a supplemental continuing education program, large number of professionals in the areas already listed by me. Based on my initial high level estimate, I strongly feel that the universities need to act very fast, as the man power requirement to fill the big data professionals needed is so large that USA may lag behind, and living a void for other countries to fill them, thus further increasing dependence of USA on other countries.

I am currently estimating the required number of trained professionals for different categories.

I will be open to co-opting team members in this estimating endeavor.

Please contact me at: (408)-464-3333 bigdataexpert@gmail.com, expertboardadviser@gmail.com or ICubed.Murthy@Gmail.com

Monday, July 16, 2012

We all want to know these about big data

We all want to know these about big data


Some of the big data professionals, companies and even the enthusiasts have a general idea of what is already there and happening in big data platforms, tools, something about BI, data science and visualization. However, most or all of them would like to know novel areas that are unique not discussed much in the media, lectures and conferences. Of course, all of us have one or more favorite areas based on our function and a priority list that addresses the individual or company needs and charter.

Here are some example questions, to which all of you may add by sending an email to me at bigdataexpert@gmail.com :




  • What are the verticals that may adopt or embrace big data in the next
  • six months to one year?
  • Professionals are either already doing big data work or are interested
  • in getting into big data area.
  1. What should they do?
  2. What courses, training, resources and companies they should learn?
  3. Is it possible to jump into the "cold water pond" and start swimming?
  • What are the perspectives of the VCs and angels?
  • If anyone has some start up and product / service ideas, what are the most important steps and preparations you advise?
  • What is really missing in the big data world that you strong;y desire to see, that makes your company, the big data industry move even more aggressively?

Monday, July 9, 2012

Security Dichotomy


Security Dichotomy

Does data explosion mean more security to go wrong for all of us: the individuals, companies and governments? More about you is stored and stared, packed and hacked, snooped even as you snooze, especially by many you do not even know. You have given permissions to so many websites, companies and agencies, yet you can not even list more than 10% of them. In a frenzy to download free software, free apps, and myriads of freebees, you have let predatory people, machines, companies and even good old “uncle Sam”, and his cousin “FBI” feed on all types of your personal and private information gobble like a “monster” in feeding frenzy 24X7.

You probably knew, or at least had a clue, when you got many things for free, including websites, apps and search engines, yet never cared or had the patience to read legal agreements and contracts, nor printed it out for a later review. We are all very good in blindly signing on a dotted line; in other words, you are very good in giving away your rights, and never knew the national constitution or bill of rights.

Don't cry! Now that you have sold all about you, you may as well enjoy your Face Book, Twitter, Google and talk to so many stranger friends. Yes, you are probably very proud that you are connected to share even your most intimate inner secrets with hundreds to thousands of strangers, that you may never have met or heard their voices. Who cares about all your personal details, including your everyday happenings, vacation photos and videos, birthday and marriage anniversary? Very little of what you shared may be read or viewed by those strangers.

Don't feel bad that no one cares about your inner secrets. The Big Data gulping monster engines have been built, more this year than ever, next year more than this year, progressively. These Big Data monsters have ferocious appetite. They eat all day, tirelessly. A lot of HUNK is produced from the all the junk that is eaten. 

Monday, July 2, 2012

Invitation to Big Data Business Plan Competition and Showcase


Is anyone interested in participating in a Big Data Business Plan Competition and Showcase?

If you are interested, please send me the following:
  1. Your name and contact
  2. Your company or organization: Add principals of the company profiles
  3. Name of the business and short abstract: Like a 100 to 200 words pitch
  4. Stage of the company: Idea, Seed, Demo, Proof of Concept, Growth, Later Stage, Interested in M&A
  5. Amount of funding required

NOTE: You do not need to give any proprietary information


--
Dr. KRS Murthy - You may read about me in the links below:
My Skype ID is    drkrsmurthy     (408)-464-3333
CEO, I Cubed

Wednesday, June 27, 2012

You are cordially invited the BIG marriage


Match Made in Heaven

It is a made for each other match between energy and big data; especially green energy. You are all invited to partake in the marriage.

The role of Big Data Technology in all spans of energy is impending; its span includes generation, transmission, distribution and even the smart grid; it encompasses all functions: the full supply chain, manufacturing and assembly of different equipment, transportation logistics, installation, operation and maintenance.

Let us discuss one example at a time to make the point, starting with green energy, also called alternative or clean energy technology

Solar PV

The solar PV industry supply chain is made up of solar cell manufacturers, panel assemblers / manufacturers, the inverter companies, tracker companies, mounting and cabling companies.

The transportation logistics, installation, operation and maintenance for all type and size of installations: small and large solar farms on land, industrial, commercial and military roof top installations, the residential roof top installations, the building integrated PV (BIPV), on parking lot roof tops, solar for telecom towers and so on. Don't forget the soldiers who could carry flexible solar panels.

Now, wireless sensor networks (WSN) on the panels are very much needed to monitor the health of the solar panels. There would be WSN for perimeter security, building security, other asset security and the security monitoring of even the soldiers.

The WSN will routinely monitor not only security and report any failures, but more routinely the performance parameters of the different panels, spread across a small or large solar farms, roof tops, buildings, telecom towers and even the GPS based location monitoring, all mashed up on zoom capable maps. The WSN will also be for weather / climatic conditions like temperature, wind, dust, rain, hail.

This is essentially machine generated or WSN reported big data. When there would be hundreds of GW of solar installations in the upcoming years, it spells peta, exa and zetta bytes of big data, every hour, day, week and month of the year.

WSN as an Exploding Business Opportunity

Does this also give you any ideas of WSN as a very big opportunity, from variety of sensors, wireless motes, mesh network, gateways, monitoring centers in the data centers and on the cloud?

Other Green Energy Big Data Business Opportunity

The logical discussion in the previous paragraphs on Solar PV applies to the following: Solar Thermal, Wind Power, Hydro, Geothermal, Fuel Cells, Waste to Energy, Biomass to Energy etc.

Legacy Energy Big Data Business Opportunity

The legacy technologies whether they are coal, natural gas, big or micro hydro, big data would play a vital role in enabling and empowering all stake holders with aggregated, analyzed, actionable enterprise and infrastructure intelligence for prudent decision making.

We are Big Data Strategists and Futurists

Yes, we are loosing sleep over this 'business big bang' all over the world. Every minute and hour my brain is exploding with all these big bang explosion in big data applicable to many verticals, especially the energy industry.

Our company has developed proprietary secrets for USA and rest of the world to leverage on big data based aggregated, analysed, actionable business and enterprise intelligence for a variety of decision making, and vital routine use at all levels from CEO, CFO, COO down to supervisory professionals.

The investors in energy industry / market in private and public companies will find important decision and investment diversification decision value addition in big data.

In addition,  our company has developed additional secrets to ensure security of the different energy infrastructures. 

Energy companies should prudently adopt a holistic approach by utilizing the big data available through intently installing various wireless sensor networks through generation, transmission, distribution and the powermonitoring devices in residential, commercial, industrial, government and military buildings and campuses.  Load management and power routing is extremely important for enhancing financial performance of the business and getting most of the big data intelligence. It all spells "high availability"

Thousands of new breeds of entrepreneurs will emerge stimulating business and employment opportunities in big data collection, different stages of processing, analysis, intelligence, data and visualization.


Increasingly in the energy industry and infrastructure,  O&M, as well as total business efficiency, the big data analysis must be accomplished in near-real time to provide the best return on investment for pertinent stakeholders. 

Feel free to contact us for big data strategy, proof of concept (POC), implementation and execution of your company big data strategy.

We will also be glad to be Key Note Speakers and featured speakers in international conferences and also organize & moderate panels discussion, and interview experts as part of fire side chats.

Dr. KRS Murthy
bigdataexpert@gmail.com Skype ID: drkrsmurthy (408)-464-3333

Tuesday, June 26, 2012

Global Big Data Summit 2012 / 2013 And International Joint Venture Delegation


Global Big Data Summit 2012 / 2013
And
International Joint Venture Delegation
(Routine Updates on these sites)

You are cordially invited to attend the event.
  • We are planning to organize the Global Big Data Summit in many metropolises in USA and in many countries and continents around the world.
  • If you are interested in being the host or co-organizer or sponsor for any location or locations of your choice, please send your or your company experience and track record in conference, summit or international business delegations, along with your contact details.
  • If you are a big data experts in strategy, technology, business, marketing, business development, deal making, strategic alliances, joint ventures, mergers and acquisition, angel, venture capital, private equity, industry analysis, press and media, government professionals and regulators, please send your participation interest with your name, title, company / organizational affiliation, address, phone, email, Skype ID, twitter ID and type of interest in the SUBJECT TITLE and body of the email.
  • If you are a subject matter expert and interested in speaking, please send the talk title, abstract and professional profile along with other contact information with "Speaker" in the SUBJECT TITTLE and also in the body of the email.
  • If you are interested in attending as a VIP delegate, with special interest in joint venture or funding, please make sure to expressly mention that you are a VIP Corporate Delegate or a Financing Company in the subject title and also in the body of the email.
  • Please send emails to bigdataexpert@gmail.com
  • You may also connect with me on Skype ID: drkrsmurthy or call me on  (408)-464-3333
Background:

The citizens of the world today are producing more data than ever in the history. Without consciously thinking about it, their mobile handsets, their bank and credit card type transactions, while at home, driving around and even their very homes are producing “big data”. We do not speak of giga or terra anymore, already in peta, and soon exa and in the upcoming years zetta and much larger numbers of bytes of data. Please note that each of these measures of data are progressively 1000 times the previous.

There is inflation or explosion of data volumes, and we have recently crossed inflexion point or the cusp of this unprecedented and accelerated growth of data. As a futurist, Dr. KRS Murthy professes that (big) data will be the new international currency, with various big data bartering, trading and swaps becoming a common thing of the upcoming years.

Big data is a 'gigantic creature' that seems to grow with unending appetite. Big data technology in different market verticals aims to tame this 'creature' and even domesticate to use it as a tool to make predictions and find the most critical and actionable items of intelligence.

Increasingly, this must be accomplished in near-real time and the information must be packaged in a format capable of being shared with all other pertinent parties. The result is that sensor, computer and communication technologies are being strained beyond capacity to keep pace with current and future information management and analysis needs. ‘Big Data’ tools, techniques, and technologies seek to provide the means to analyze exploit and share conclusions drawn from this seemingly overwhelming information load.

Global Big Data Summit

         Conference Chair: Dr. KRS Murthy
         Conference Committee: Industry Experts from different countries
         Inter Government Committee: Government Leaders
         Host Country Committees: Various for event organization and sponsorship

The Global big data summit brings together the key government and industry experts who are shaping the direction of big data research and development, especially to launch many countries on par with other countries in other continents, leveraging the most important equalizer: Knowledge Economy.

Attendees and Delegates: Countries of the world
Attendance Budget
·         Target total attendance 500 or more for open plenary
·         Between 50 to 100 for special parallel sessions
·         Between 25 to 50 companies in parallel private sessions for business and technology alliances and MoU, Joint Ventures (JV) & Contracts
·         Closed door inter government leaders caucus – Parallel Sessions
Topics

The summit will address the following example / suggested topics:
·         What is the unique business opportunity in big data?
·         The different big data functional and market verticals – How to prioritize?
·         What are the latest needs and initiatives in big data?
·         How is big data analytics being applied to Information sharing, fusion, video analytics, atmospherics, identity, biometrics, and a whole range of other critical mission applications?
·         What role are new tools, techniques, and technologies – predictive analytics, cloud computing, metadata, etc. – playing in making big data analytics a reality?
·         What are the future challenges and opportunities?
·         What role(s) can different countries play?
·         Potential Mergers and Acquisition Scenarios

Strategic Focus Areas
·         Leading Big Data Experts will examine various aspects including:
·         Role of Governments in Big Data: National and International Strategy, Policy, Plans and Initiatives
·         National and International Big Data Strategy and Identification of High-Value Missions and Applications
·         Big Data Related Compliance, Regulations and Vulnerabilities
·         Building in Flexibility, Scalability, Privacy and Security Issues and Solutions
·         Need for Private Cloud Services and Government Managed Cloud for Big Data
·         The Latest Tools and Technologies – Predictive Analytics, Semantics, Sentiment Analysis, Causal Analysis, Cloud, Metadata, etc.
·         Big Data Analysis Implementation: Collection, Processing, Management and Dissemination Strategies and Techniques
·         Big Data Analysis in the Enterprise Architecture
·         Big Data in Different Verticals
·         Big Data Education and Training: In Colleges and Universities, Private Training Companies, Nationally Funded Work Force Training Programs, Tuition Assistance and Scholarships
·         National Competitiveness in Big Data
·         National and Regional Centers of Excellence.
·         National and International Angel, Venture and Private Equity Opportunities
·         How should governments provide funding and financial stimulus to big data industry covering start up, small, medium and large companies.
·         Government Models for Involvement as a Enabler or Catalyst in Big Data industry Capability and Growth

Conference Format
·         Half Day Plenary and Open Sessions – large group of attendees representing the governments, industry leaders, business financing companies, academicians, youth entrepreneurs and scholars.
·         Special parallel sessions to address business and technology alliances, training and recruitment, offshoring opportunities and government leadership roles to empower the businesses and technologists.
·         MOU (Memorandum of Understanding) and other contractual agreements in private sessions.
·         Evening networking, gala dinner event and presentation by visionary leaders.
·         International business delegation tours to local industries
·         Company Exhibits and Country Showcase Pavilions

Business Delegations, Strategic Alliances, Joint Ventures and Investors
·         Two to Three days of Business Collaboration and Joint Venture Opportunities, Connections & deals
·         Pre-qualified & Screened Attendees Ensure the Best Opportunities for Meaningful Connections
·         Executive Level and Secure Online Deal Rooms to Expedite the Exchange of Confidential Information
·         Pre-Summit Web Conferences to Prepare Participating Executives Result Oriented Presentations
·         Delight Filled and Relaxed Ambiance in Networking Enclaves for VIP Attendees for Deal Making
·         Legal and Finance Consultants will be available, as needed

WHO SHOULD ATTEND THE JOLINT VENTURE AND DEAL MAKING EVENTS?
Founders, Chairman, Managing Partners / CEO, Managing Directors, Principals, Presidents, VPs, COOs, CFOs

Contact:

Dr. KRS Murthy
CEO, Big Data Experts and I3 World
 (408)-464-3333     Skype ID:  drkrsmurthy   Twitter:  bigdataexpert