A significant constraint on realizing value from big data will be a shortage of talent, particularly of people with deep expertise in statistics and machine learning, and the managers and analysts who know how to operate companies by using insights from big data …. we project that demand for deep analytical positions in a big data world could exceed the supply being produced on current trends by 140,000 to 190,000 positions (Exhibit 4).
The growing integration of technology in our daily lives has created an abundance of new possibilities for producing better and more timely data based on nontraditional sources of information. As Census Bureau Director Robert Groves has written, “(t)he volume of data generated outside the government statistical systems is increasing much faster than the volume of data collected by the statistical systems; almost all of these data are digitized in electronic files” (Groves 2012). Nontraditional sources of information include both digital administrative data (e.g., tax records and records related to participation in government transfer programs) and records generated in the private sector (e.g., data from Internet searches, scanner data and social media data).