The New Frontier of “Big Data”
Posted on | December 4, 2011 | No Comments
The uses of database technology have been going through some dramatic shifts due to new storage, processing, representation, and transmission capabilities. Innovations have made data continuously cheaper to store, quicker to organize, easier to visualize and faster to transmit. As a result, various private and public sectors organizations are developing new data-driven analytic strategies to capture value from a wide variety of information sources and the large volumes data that are now routinely collected and stored.
The Internet has added a whole new dimension to the “mining” of data from outside the organization while user generated content has added tremendously to the “infoverse” of obtainable and usable data. Terms like “terabytes”, “petabytes’, “exabytes” and “zettabytes” are being used to describe the large data volumes that are in play now. Mobile and satellite technologies are adding yet more new realms of information, leading overall to what some are calling the era of “Big Data“.
A recent report by the McKinsey Global Institute (MGI) and McKinsey’s Business Technology Office entitled Big Data: The Next Frontier for Innovation, Competition, and Productivity studied the implications of the “Big Data” phenomenon for a variety of private and public sector organizations; specifically healthcare and retail in the US, governments in Europe, as well as personal-location data globally that in itself they estimate could become a $600 billion industry. They concluded that the ability to capture, analyze, and visualize large data sets would be key to “new waves of productivity growth, innovation, and consumer surplus”. The research offered seven major points:
1. Data resources are now what economists call a factor of production. With land, labor and capital, they are integral to the production of economic goods and services that are key to the future viability of the US economy.
2. Big data can create value in a number of ways. The collection and organization of digital data can make information transparent and usable at much higher frequencies. Transactional data can provide useful performance information, assist management decision-making; and improve the development of new products and services while targeting them to individual customers.
3. Distilling value from mountains of data will become key for individual firms. Established firms, competitors and new entrants will continually compete to capture value from big data and develop data-driven strategies to leverage the scale and scope of companies’ access to data to drive innovation and competitive advantage. Data consultant Larry Mantrone, summarized the relevance of these trends: “Big Data tools offer organizations the ability to analyze information ranging from sales patterns and internal business processes to public perceptions of the organization itself. Current tools can even process data that isn’t stored in relational databases, such as application log files, plain text or even Twitter feeds.”
4. The use of big data offers benefits to consumers, although the amount of information that can be collected is rather disturbing. Personalization capabilities reduce search and transaction costs for consumers and reduce marketing costs for producers. On the other hand, data collectors promise they can deliver anonymity by stripping identifying characteristics, such as a name or physical description, from the data collected. Terence Craig, co-author of Privacy and Big Data thinks otherwise. “We’ve seen the Netflix de-anonymization, the AOL search release, and others. There’s been several cases where medical data has been released for laudatory goals, but that data has been de-anonymized rather quickly.” This includes the medical records of former Massachusetts governor William Weld that were identified by combining the State of Massachusetts voter’s list with PII healthcare records by Dr. Latanya Sweeney, the Director and Founder of the Data Privacy Lab at Harvard University. In her work on K-anonymity and the 1990 US census, she revealed that some 80% of the US population could be identified based on just three attributes: the 5-digit zip code, a birth date, and a person’s gender.
5. Some economic sectors like computers, finance, government, insurance and manufacturing are likely to experience greater gains of productivity and value from big data than other areas. Arts, construction, education; not so much.
6. Talent is a major issue. A shortage of some 140,000 to 190,000 people with “deep analytical skills” is expected in the US economy over the next 6 years. Also needed are another 1.5 million managers who can use the analysis of quantitative and qualitative data to make strategically effective decisions.
7. A number of ethical and social issues will continue to require scrutiny and policy responses. Protection of trade secrets and individual privacy will be crucial as well as the intellectual property and liability issues from drawing information from multiple sources. The situation gets more complex when you consider the use of third parties.
A practical example that provides interesting insights is the case of Google. The search and advertising behemoth is by most accounts the leader in the use of big data. A recent article in Wired magazine entitled “Googlenomics” discusses their strategies for gathering and monetizing the vast amounts of data they collect.
Citation APA (7th Edition)
Pennings, A.J. (2011, Dec 04) The New Frontier of “Big Data”. apennings.com https://apennings.com/technologies-of-meaning/the-new-frontier-of-big-data/
© ALL RIGHTS RESERVED
Anthony J. Pennings, PhD is a professor of global media at Hannam University in South Korea. Previously, he taught at St. Edwards University in Austin, Texas and was on the faculty of New York University from 2002-2012. He taught at Victoria University in Wellington, New Zealand and was a Fellow at the East-West Center in Hawaii.
var _gaq = _gaq || []; _gaq.push(['_setAccount', 'UA-20637720-1']); _gaq.push(['_trackPageview']);
(function() { var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true; ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js'; var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s); })();
Visiting the Future of the Panama Canal
Posted on | November 2, 2011 | No Comments
I recently went to Panama with a group of our students in New York University’s MS in Management and Systems degree program that I am chairing and two faculty members from the Stern School of Business. Kristen Sosulski and Harry Chernoff were developing a course called Operations in Panama examining global supply chain management, logistics, and real estate development. We met with business leaders and government officials and visited some small and large businesses. Panama is a study in contrast with some of the largest rain forests in the world surrounding its capital city which impressed me as one of the tallest cities I have ever seen (And I live in NYC!).
As one might expect, visiting the Panama Canal was the trip’s highlight. It had special relevance for me because when my parents immigrated to the US from the Netherlands, they went first through the Canal and on to California, where they caught a train to New York and settled to raise our family.
The Canal was being upgraded to handle more and larger ships. Panama charges ships by their size, with the largest vessels paying over a half million US dollars for the transit. As 60% of the world’s shipping is conducted through containers, it is worth noting that the upgrades planned for the Canal will allow ships carrying nearly 12,000 containers, more than twice as much as the current limit of 4,800 containers. Dr. Sosulski wrote this interesting blog about different ways to understand the Panama Canal through various modes of visualization.
We happened to be at the Canal the morning President Obama signed the trade agreement with Panama. The Panama – United States Trade Promotion Agreement or Tratado de Libre Comercio (TLC) entre Panama y Estados Unidos is a bilateral agreement that has been in the works for the last ten years. The deal is part of Panama’s plan to leverage the Canal to become a major commercial hub. Panama is striving to go beyond just providing passage between the great oceans to adding value by building infrastructure such as a major international airport nearby and fiber optic networks. It also is working to improve its educational facilities and enticing companies to set up operations centers. It hopes to become the Singapore of the Americas.
The agreement is controversial, but it opens Panama to many international financial, insurance, and IT services. As the country continues to become a logistical hub for trade in the region, it will continue to need increasingly sophisticated services. These will help better coordinate its shipping traffic, financial activities, and distribution operations. Hopefully, it will also enhance safe passage for goods and services.
Postscript 2022: Shortages and Inflation
The expanded canal began commercial operation in June of 2016. The project built two new locks, one on the Atlantic side and another on the Pacific side. It dredged new channels to the enlarged locks and deepened and widened existing waterways. As a result, bulk shipments such as Liquefied Natural Gas (LNG) increased immediately and container shippage also grew steadily.
A relevant question for 2022 is whether shipping ports have prepared sufficiently for increased container traffic? Have ports such as Baltimore, Charleston, Los Angeles, Miami, New York, Philadelphia, Portland, and Virginia, modernized their facilities to become “big ship ready”? Ships anchored offshore, containers piling up on docks, and long-haul trucks queued for hours to get to the containers suggest they have not.
East Coast ports, in particular, have not been prepared for shipments from the largest and busiest ports: Shanghai, China; Singapore; Hong Kong; and Busan, South Korea. Massive ships coming in from Asia through the Panama Canal may need deeper waterways, wider turning basins, longer berths, bigger docks, and taller cranes that could stretch across 20 or more containers.
The supply crisis contributing to the inflation surge of 2022 has shed light on many of these insufficiencies, resulting in increased public support for modernizing these shipping infrastructures.
Anthony J. Pennings, PhD has been on the NYU faculty since 2001 teaching digital economics, information systems management, and global communications. © ALL RIGHTS RESERVED
Tags: containerization > Containers > Panama Canal > shipping ports
Popular Programming Languages
Posted on | October 12, 2011 | No Comments
It has been a while since I reviewed the latest statistics about the most popular programming languages.
The top 10 most popular programming languages according to the TIOBE Index in Sept of 2011 are.
- Java
- C
- C++
- C#
- PHP
- Objective-C
- (Visual) Basic
- Python
- Perl
- JavaScript
The list is a bit misleading. According to the Language Popularity Index, C and Java split just over 50% of the compiled and general purpose languages among the two with C having a slight edge. C was developed by AT&T’s Bell Labs in the early 1970s in conjunction with its work on Unix. Java was developed by Oracle’s subsidiary Sun Microsystems in the mid-1990s for interactive TV and mobile devices but found a more immediate home in the emerging World Wide Web. Java is currently a source of contention between Oracle and Google due to its influence on the Android operating system.
For non-compiled scripting languages PHP is the most popular with a 27.476% share followed by Perl with 16.415% and Python with about 13%. JavaScript returns to the top ten although the number 5 scripting language (after Ruby) with a 5.5% share.
Anthony J. Pennings, PhD has been on the NYU faculty since 2001 teaching digital media, information systems management, and global communications. © ALL RIGHTS RESERVED
The Price of Neglect
Posted on | October 8, 2011 | No Comments
I don’t always agree with Tom Friedman but the guy thinks about important questions and is an active contributor to major economic debates. Lately he has been promoting his new book with Michael Mandelbaum on the American predicament called That Used to be US: How America Fell Behind in the World It Invented and How We Can Come Back. They list the main challenges for America as they see it:
- Globalization
- Information technologies
- National debt
- Patterns of energy usage
I like this interview on Charlie Rose.
Their basic contention is that America is neglecting the basic formula which has made it great. And that is the focus on four aspects of American society that require some collective action:
- Educate people up to the latest developments in science and technology
- Rebuild American infrastructure such as airports, energy, roads, and telecommunications
- Open up immigration to allow the brightest and hardest working to come to America
- Restructure investment capabilities to support innovation and production capabilities
We’ll see if I have more to say on the book after I get some more time to read it. I like their focus on collective action but unfortunately too many Americans believe government investments go to someone besides them. Collective action for them means bailing out Wall Street, providing healthcare benefits for illegal aliens, overpaying government bureaucrats, or providing welfare for people who don’t want to work. And while a case can be made for each of these arguments, we are throwing the baby out with the bathwater, so to speak. This is the real tragedy of our times.
Anthony J. Pennings, PhD has been on the NYU faculty since 2001 teaching digital media, information systems management, and global communications. © ALL RIGHTS RESERVED
The Walt Disney of Japan
Posted on | July 29, 2011 | No Comments
with Justin Restivo
Hayao Miyazaki is one of the most renowned animation creators in the world, known primarily for his classic Japanese feature-length films such as My Neighbor Totoro, Princess Mononoke, Spirited Away and the recent release, Ponyo. He founded the Japanese animation venture, Studio Ghibli. “Ghibli” is the Arabic name for the Mediterranean wind, and refers to Miyazaki’s intention for a wind of change to blow through the Japanese animation industry. Many have come to consider him to be the Walt Disney of Japan because of the memorable animated characters he created and the impact of his films.
Miyazaki was born during World War II in a suburb of Tokyo. He was fascinated with aviation as a child, and loved to draw airplanes as well as trains and automobiles. In high school, he saw the Japan’s first feature length anime film, The Tale of the White Serpent and became interested in the field of animation. Although Miyazaki obtained his college degree in economics, he began working at the Toei Animation Studio as an artist and assistant animator but maintained a strong interest in the industry, becoming the leader of their labor union.
By 1968 Miyazaki became a chief animator and concept artist for Hols: Prince of the Sun directed by Isao Takahata, who he continued to work with for the next few decades. Miyazaki left Toei Animation Studio to direct several episodes of the television show, Lupin III, an action comedy and also worked on several films at A-Pro and Nippon studios. His signature film was the feature length Lupin III: The Castle of Cagliostro which he directed.
He was developing his own oeuvre which were incorporated in his next film Nausicaa, The Valley of the Wind. His was beginning to explore issues of pacifism, feminism, a fascination with flight, and the impact of humans on the environment. Miyazaki was also concerned with exploring the morality of his characters and particularly his villians, which he infused with ambiguity. He would pursue these themes successfully after he started Studio Ghibli in 1985 with films such as Castle in the Sky, My Neighbor Totoro, Kiki’s Delivery Service and Porco Rosso. A major achievement came in 1997 with Princess Mononoke, which became Japan’s highest grossing film of all time was the first animated film to win Japan’s equivalent of “Best Picture” award.
This relationship brought global fame to Studio Ghibli as Miyazaki’s films were developing a fan base in the West. Spirited Away won ”Best Animated Feature” at the 2002 American Academy Awards and eventually surpassed Princess Mononoke‘s box office totals while Ponyo is reaching even higher levels of acclaim and revenue as the distribution partnership with Disney continues.
Anthony J. Pennings, PhD has been on the NYU faculty since 2001 teaching digital media, information systems management, and global communications. © ALL RIGHTS RESERVED
var _gaq = _gaq || []; _gaq.push(['_setAccount', 'UA-20637720-1']); _gaq.push(['_trackPageview']);
(function() { var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true; ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js'; var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s); })();
Tags: Hayao Miyazaki > My Neighbor Totoro > Princess Mononoke > Spirited Away > Studio Ghibli
Electric Money Never Sleeps
Posted on | June 27, 2011 | No Comments
Money used to sleep a lot. It would nap while waiting for a telex message to go out. It would doze off while waiting for a telephone connection. It would slumber on railroad routes. It would hibernate on transoceanic crossings. By the mid-20th century, money developed insomnia.
Computers and telecommunications were being used together to add a new immediacy to financial transactions. Reuters created a new online facility for international currency trading in the early 1970s and Bloomberg followed up in the next decade with the “Bloomberg Box” to allow traders to analyze and trade Treasuries and other equities. Geosynchronous satellites and undersea fiber optic cables provided a new technological environment for the movement of money and news. Combined with faster micro-processing capacity, it created new transactional spaces so that money did not have to sleep; it became continuously active. Electric money was 24/7, and it was global.
I wrote my Masters thesis on international finance and telecommunications deregulation, so I had a lot of interest in two of Oliver Stone’s films: Wall Street (1986) and the recent Wall Street: Money Never Sleeps (2010). In Deregulation and the Telecommunications Structure of Transnationally Integrated Financial Industries, I examined the forces that were transforming the technological infrastructure for banking, currencies, derivatives and other financial activities. These financial industries have been a major driver of computerization and communications technologies since the 1970s. Consequently, the emergent financial technologies have transformed the spatial and temporal limitations on OTC (over-the-counter) transactions and bypassed the barriers to international data communications and the flows of information and money.
These developments that led to money’s insomnia provide the backdrop for Stone’s Wall Street: Money Never Sleeps (2010). This film is not as enjoyable as his classic Wall Street (1986) which I argued used the icons of a gangster film moved from New York City’s outer boroughs to heart of its official economy. In “Figuring Criminality in Oliver Stone’s Wall Street” I examined both the iconographics that Stone uses to dramatize his morality tale as well as the dynamics of the new era of global electronic finance.
In this latest film, Michael Douglas revives his role as Gordon Gekko, but he is no longer the “Master of the Universe”, pontificating the “greed is good” mantra. He emerges from jail in the beginning of the movie to find instead that his universe is a lonely one, having lost his wife to divorce, his son to drugs, and the affections of his only child, a daughter named Winnie, to Jake Moore, a young trader. Jake works at a venerable Wall Street company caught up in the credit crisis. Played by Shia Labeouf, he seems to lack Charlie Sheen’s Adonis DNA, but the comparison is unfair. More palpable is his character’s lack of depth emanating from the dramatic and narrative limitations of the story.
It’s clear that the story that Stone wanted to tell was the one about the financial crash and the resultant “Great Recession” so that is the direction I’m going here. The story is personal for Stone whose father was a stockbroker on Wall Street and Wall Street the film series has been his main vehicle to grapple with this issue. But Wall Street has changed a lot since Stone’s father was a broker in 1960s. He might have seen the automation crisis that accompanied the turn of that decade but not likely the financial derivatives phenomenon which started in Chicago during the 1970s and began to take hold on Wall Street in the 1980s.
What drove the derivative markets were the combination of algorithms such as the Black-Scholes equation and microprocessing power that enabled quick calculations on the trading floors. But even the exchanges notable for their frenetic energy and strange hand signals are seeing their demise as online trading platforms replace the face-to-face “open outcry” trading floors. Soon traders spent most of their time behind desks, coolly scanning economic data and trading trends while setting up parameters for automated trades.
By the 1990s, automated systems merged with hedge funds to trade a global buffet of new electronic instruments. The new hedging strategies not only exploited the global diversity of financial trades from developed and emerging markets, their risk models depended on them. “Dynamic hedging” was based on the capability to trade anywhere and all the time. Money truly never slept.
Most notable of the new hedge funds was Long-term Capital Management, the Greenwich Connecticut-based financial firm that John Meriwether, the famed bond trader from Salomon Brothers put together with 2 Nobel Prize winners and 80 founding members putting up the minimum investment of $10 million. LTCM’s computerized trades made good money for three years before the “Asian Contagion” and the collapse of the Russian market in 1998 sparked a major disturbance in the global markets that their systems hadn’t anticipated. When Russia defaulted on its debt in August of that year, LTCM lost billions and put a trillion dollars of trading at risk throughout the world. The subsequent global flight to US treasuries and the tech markets destroyed LTCM and nearly brought down the US financial system.
This Frontline video with the same name provides an interesting historical analysis.
Oliver Stone’s Wall Street: Money Never Sleep picks up the story and addresses the financial crisis of 2007-2008. One could say it started with the securitization of student loans for college students in the 1980s, accelerated in the 1990s when Freddie Mac and Ginnie Mae used these techniques for home mortgages, and turned a major fiasco when Wall Street began to package mortgage-backed securities into collateralized debt obligations (CDOs) for global distribution. The low-interest rates set by the Federal Reserve Bank that was trying to recover from successive “dot-com”, 9/11 and telecom crashes set off the housing bubble that was fueled by this securitization process.
As in any bubble, people leaped in to buy lest they are left out. Add to this ratings agencies that were paid for their evaluations by the over-leveraged banks and the credit default swaps set up as insurance policies on futile instruments and you have the recipe for the greatest financial disaster since the Great Depression.
Anthony J. Pennings, PhD was on the NYU faculty since 2001 teaching digital media, information systems management, and global economics. © ALL RIGHTS RESERVED
var _gaq = _gaq || []; _gaq.push(['_setAccount', 'UA-20637720-1']); _gaq.push(['_trackPageview']);
(function() { var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true; ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js'; var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s); })();
Tags: Black-Scholes > Bloomberg box > collateralized debt obligations (CDOs) > Deregulation and the Telecommunications Structure of Transnationally Integrated Financial Industries > Figuring Criminality in Oliver Stone’s Wall Street > Gordon Gekko > securitization > Wall Street: Money Never Sleep
Online Media Business Models: The Intercontinental Interview
Posted on | June 25, 2011 | No Comments
Recently I was contacted by Stanislav Serdyukov, a second year Master’s program “Media Management” student in Moscow, Russia at the School of Business and Political Journalism at National Research University – Higher School of Economics. He is working on the master’s project with the theme “The Online Media Business Models and their Transformations” and wanted to ask me some questions about online media business models.
Q. What factors cause the origin of new online media business models?
I think the simple answers are technology and customer expectations. Media consumers are busy and they want their content where and when they want it. Digital technology has disrupted traditional media models and the empowered the media consumer – so far. One way to start thinking about this topic is by reflecting on Nielsen’s 3 screen strategy. The venerable ratings agency is now tracking attentive eyeballs on PCs and mobile phones as well as televisions. These viewing options expanded the time and place of viewing media and challenge the traditional media models and in the process they have created a more demanding media customer. Having said that though I think innovation is driving these services, creating new services customers didn’t even know they wanted, creating a “cool” factor when unanticipated new apps, technology and services are released, literally “blowing people’s minds”.
Q. How can online media firms renew their business model in the dynamic media industry?
From the business perspective it’s all about competitive advantage, something that has been hard to obtain in the web world. How can a company create or utilize barriers to entry to keep other companies from competing with them?
It is unfortunate in many ways, but the “app” is a vehicle to reduce competition on the Internet. How many apps do you have on your Droid X? On your iPad? When you are mobile you generally look to reduce your options so the apps are convenient. How many apps do you actually use? Compare that to the links you interact with when you get on your PC or MacBook at home.
Mobile devices are quite small for the web model – physically. How much space do you have smartphone? How small do you want the icons to be? How long is your thumb? The app will capture customers by limiting their options like the web never could. I’m sorry to say.
3. What are the future challenges for the online media business models?
I think money, people making payments, is a real issue. As is a related issue, security. Companies that tie in customers with comfortable payment systems like Amazon and Netflix have real advantages. People love the advantages of e-commerce and the social media aspects of the web, but are extremely wary of identity theft, fraud, malware and other problems that come with giving up personal information and making purchases over the Internet.
All this discussion about “free” is useful too. Free has always been an important model for the broadcast industry in that advertisers picked up the costs of production and distribution. Interesting that Netflix has challenged that model with a subscription model – remember that cable television started off in the US promising an ad-free environment. Now you have pay the subscription fee and suffer the ads. Cable has managed to maintain some key sources of competitive advantage: government protection, customer captivity, and fixed costs such as their huge investments in the network infrastructure. Media industries will have to continue to figure that calculus between ads and subscription prices. The higher the subscription costs, the lower the customer base, and the less interested advertisers will be. Its interesting to the see the New York Times has had some success with their new subscription model but other newspapers may not have the base of high income readers that don’t know how (or care) to clear their cookie cache. Media firms, particularly, news organizations need to come to grips with ads and economics of the Internet.
The “freemium” model is popular now and it makes a lot of sense. Sites build up a large customer base by offering a free service and then offer a premium service at a price. Picture sites are good at this, Flickr provides free storage services to the general public and makes money by offering advanced services to more serious photographers for a price. I noticed Skype is aggressively trying to move people into the premium paid services after their purchase by Microsoft last month as is Linkedin, after its recent IPO. Another strategy is to offer something free and then sell other products to produce a revenue stream. Fotki.com, another picture site, makes money by selling products like coffee cups, mousepads, and refrigerator magnets customized with user images along with traditional images used for framing.
4. What online media business models will be efficient during next five years?
Content continues to be overrated. Anytime you can get someone else to produce your content you are ahead of the game. Content is expensive and extremely interchangeable. Digital cameras, mobile camcorders are providing a lot of useful “user-generated” content and of course anytime you do a search you are producing statistical content that companies like Google are increasingly able to monetize. Just because you are not paying for something, it doesn’t mean someone is not making money from your online activities.
Syndication is also an important dynamic to consider. The process has been around for awhile. Think cartoons in your local paper. But it is particularly effective in an online environment. Think RSS feeds. Syndication is basically selling the same thing again and again. Hard to do with a car and hamburgers but possible with digital processes and products where the costs of reproduction and distribution are nil.
It’s hard to think 5 years into the future, but it’s clear one trend is that consumers are putting the ‘commune” back into communication. I’m talking about social media here. This is working itself out in three ways. One is that they want to interact with content, question it, explore it further, and add to it. Shopping is a much richer experience now due to all the information and reviews you can access online. Much better in many cases than dealing with a pushy salesperson, if you can track one down. Second, consumers want to share the media content with others. By sharing they express themselves and construct an identity. Facebook as been great for this. People are sharing their intimate photos, revealing their links with other people, and attaching media content that they find interesting. Mimetic desire is an important factor here. That is a theory of desire that recognizes that people develop interests based on the interests of people they are interested in. Third, they want to connect with people who share the same interest and interact with them. Whether it is organized around a football team, a pop singer, or a political cause, people are interested in being part of a community that shares the same meanings, goals, and values.
Anthony J. Pennings, PhD has been on the NYU faculty since 2001 teaching digital media, information systems management, and global communications. © ALL RIGHTS RESERVED
var _gaq = _gaq || []; _gaq.push(['_setAccount', 'UA-20637720-1']); _gaq.push(['_trackPageview']);
(function() { var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true; ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js'; var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s); })();
Smith Effect III: Adam Smith, the Census Machine, and the Beginnings of IBM
Posted on | June 20, 2011 | No Comments
This is the third in a three part exploration of Adam Smith and how his ideas laid the foundation for information technology (IT). Here I specifically explore connections between his theories and the formation of IBM which last week celebrated its 100th birthday.
This post further develops the thesis that Adam Smith’s new conception of wealth set the foundation for modern information practices and calculating technologies. The premise of this section is that the new system of economic understanding engendered by Adam Smith, the Scottish philosopher and author of the Wealth of Nations (1776), laid an important intellectual foundation for modern information technologies.
Smith contended that the wealth of a nation lay not in the riches gathered by the monarch but rather in the enterprise and productivity of the population. This had the effect of helping to transform a system of calculation, “political arithmatik,” designed to tally the wealth of the sovereign, into statistics (“state-tistics”), a system of measuring a wide range of economic and social activities.
Smith is mainly known for his notion of the “invisible hand” – God’s infusion of the world with a regulatory system based on individual human desiring. However, his reconceptualization of governmental wealth reverberated through time to stimulate the development of information technologies.
This “Smith Effect” grew in importance, especially as modern computerized bureaucracies emerged and “electronic” monetary policy became heavily reliant on the surveying capacity of modern statistical techniques. Smith, while generally accredited with ideas used to argue for the limitation of the state, also set the foundations for modern bureaucratic states and extensive surveillance systems dependent on information technologies.
This new direction in governmental activities led to continual interest and innovations in mechanical calculations and statistical measurements.
Consequently, it can be argued that the Smith effect resulted in Herman Hollerith’s tabulating machines, created for the 1890 US Census. These technologies eventually became the foundational product that led to the formation of International Business Machines (IBM). The Constitutional Convention of 1787 mandated the counting of Americans every ten years.
Still, by the late 19th century the American population had increased to the point where calculations were nearly impossible to compute using non-mechanical means. Immigration surged after the Civil War, and the whole idea of census-taking nearly became obsolete because of the complexity of the task. By the time one census was finished, it was almost time to do the next one.
Hollerith’s machine became an immediate success and prospered mainly due to the process of “Morganization” occurring in major companies at the time. J.P. Morgan was consolidating several similar companies under names such as AT&T, General Electric, New York Central Railroad, and US Steel. These companies had significant data processing needs that required the telegraph for transmitting information from various locations to tabulating machines that would aggregate information for reports to upper management.
Failing in health, Hollerith sold his business to Charles Flint in 1911. Flint merged the enterprise with two other companies to form the Computing Tabulating Recording Corporation. IBM celebrated this merger as its centennial marker in 2011.
CTR changed its name to International Business Machines (IBM) in 1924 after it purchased German tabulating firm Deutsche Hollerith Maschinen Groupe (Dehomag). Under the leadership of former NCR and indicted supersalesmen, Thomas Watson, IBM expanded to other countries interested in tallying their own populations. In the 1920s and 1930s, IBM began to comb the world, selling its tabulating machines and personalized census services to countries like Russia and Nazi Germany. The punch-card tabulating systems were then generalized for a wide range of commercial and government purposes, including monitoring racial politics as well as parts management for the Luftewaffe, Germany’s air force.
In the US, IBM got the Social Security contract that supported them through the Great Depression. Former IBM salesman Ross Perot would follow that model by getting Medicare contracts to help build his company EDS. It was the son, Thomas Watson, Jr., who guided IBM into the electronic computer age during the Cold War.
Citation APA (7th Edition)
Pennings, A.J. (2011, June 20). Smith Effect III: Adam Smith, the Census Machine, and the Beginnings of IBM. apennings.com. https://apennings.com/dystopian-economies/adam-smith-the-census-machine-and-beginnings-of-ibm/
Ⓒ ALL RIGHTS RESERVED

var _gaq = _gaq || []; _gaq.push(['_setAccount', 'UA-20637720-1']); _gaq.push(['_trackPageview']);
(function() { var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true; ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js'; var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s); })();
Tags: Adam Smith > Census Bureau > Constitutional Convention of 1787 > Herman Hollerith > IBM > International Business Machines > Nazi Germany > punch-card tabulating machines > Social Security Act > state-tistics > Tabulating Machine Company > The Wealth of Nations