How many updates per second can a standard RDBMS process?

Folks: This weekend I’m teaching a class at MIT on RDBMS programming. Sadly I forgot to learn the material myself before offering to teach it. In giving students guidance as to when a standard RDBMS is likely to fall over and require investigation of parallel, clustered, distributed, or NoSQL approaches, I’d like to know roughly how many updates per second a standard RDBMS can process. Here are the criteria:

  • mixture of inserts, updates, and selects, with the server doing 10 queries for every update and the typical update or insert involving two rows
  • a 4U server with 8 CPU cores and enough RAM to hold the entire database
  • eight hard drives so that transaction logs, indices, and tables can all reside on separate spindles (or magic RAID approaches can be used)
  • perhaps a little bit of magic in the form of a solid-state drive being used for the transaction logs
  • any RDBMS, including MySQL/InnoDB, Oracle, Sql Server, DB2, etc.

I’m looking for a number that is good to within one order of magnitude.

Thanks.

[http://www.tpc.org/tpce/results/tpce_perf_results.asp makes it look as though the answer is “about 2000” though I’m not sure if the TPC-E benchmark simultaneously requires some queries. It is tough to say because the tpc.org Web site is unusably slow…. I finally got the Word doc. It looks like they count some queries as “transactions”, e.g., “The [Customer-Position] transaction is a real-only transaction”. So maybe the answer is closer to 1000? The TPS-E benchmarks use some ridiculously expensive systems, but they also require a huge amount of data to be kept, e.g., 8 TB for a low-end system doing 2000 queries and updates/second.]

(The venerable TPC-C standard never struck me as matching up that well to typical Internet applications.)]

Full post, including comments

How falling real estate prices can affect an equities investor

One of my big mistakes as an investor was not seeing that a U.S. house price bubble deflation could affect the price of industrial equities (my main investment; I had faith in GE’s ability to sell jet engines in China and India even though I thought houses in Cincinnati were overvalued). Clearing off my desk from 2010, here’s a story from the Wall Street Journal (“Shareholders hit the roof over relocation subsidies”, October 25, 2010) about how whenever top managers at public companies change job, they’re compensated for any loss they might incur from selling their house. The Microsoft shareholders had to pay Stephen Elop $5.5 million in relocation costs, including $3.7 million to make up for the loss on his Los Altos mansion (separately, I would have loved to have gotten the $1.8 million furniture moving contract!).

How much will this take out of shareholders’ pockets? Let’s assume 5000 substantial public companies (e.g., the Wilshire 5000). Let’s assume that each company has 10 top executives, that turnover occurs every five years (2 execs per year), and that each one gets an average of $1 million if he or she sells a house in a down market. Peter Schiff in the WSJ on December 30, 2010 said they’d have to decline another 20 percent to get to the historical trend line (and Philip says the trend line itself is too high because it factors in continued robust growth for the U.S. economy, whereas in fact there has been little growth since 2007); the Dallas Federal Reserve Bank economists say another 23 percent drop is due. So let’s assume the down market in real estate lasts at least another 5 years. The Case-Shiller index peaked in 2006, so that means a total of 10 years of decline. That’s $2 million per public company per year and a total of $100 billion that will go to employees rather than shareholders.

Full post, including comments

Children learn all of their math from Mom

The figure above (click for larger version) is from an NSF study of K-12 math and science education and shows eighth graders’ math proficiency as a function of their mothers’ education level. I attended a presentation recently where the figure was used to show that schools should not be held responsible for the math ignorance of their graduates because kids with uneducated mothers were inevitably doomed to incompetence. My first thought upon seeing the figure was “Wow, the schools don’t teach any math at all; kids learn all of their math from Mom.”

Full post, including comments

Motorola Atrix: Mobile phone with laptop dock

Readers have been sending me pointers to articles about the Motorola Atrix, a mobile phone with a laptop dock, and saying that it is similar to my 2005 article “Mobile Phone As Home Computer”. I don’t see the similarity because the Motorola dock has no hard drive and isn’t necessarily different than using a bluetooth keyboard and bluetooth display (does that work?) with any other smartphone. My idea of the dock was that it had its own monster CPU and graphics chips, unconstrained by power considerations, plus a hard drive for storing near-infinite video (the one form of data that a typical consumer might accumulate that is too large to be stored inexpensively in the cloud) and a removable hard drive mirror for backup.

Even if Motorola has not implemented my pet idea, this would seem to be a useful tool for travelers. Use the laptop dock when in a hotel or an office; use the phone by itself while walking around. Don’t carry any extra chargers or cables or extra weight from the full hard drive and circuitry of a typical laptop. I don’t like this for replacing a home PC because the 11″ screen on the laptop dock is so small. A $550 Dell home PC includes a 24″ “full HD” monitor with 1920×1080 resolution. That’s enough to view two pages of text side-by-side, a critical ability for students, certainly (one window for Wikipedia, from which to cut and paste into the other window, which holds the term paper).

Thoughts on the Atrix? Anything else from CES strike folks as interesting? There were a lot of tablet announcements, but I didn’t see much in the way of pricing. If a Netbook retails for $300, I would think that a $249 Android tablet would drive consumers truly wild, though this February 2010 analysis of iPad manufacturing cost makes it seem as though a high-performance $249 tablet is at least another year away.

Full post, including comments

Hybrid car progress

I recently rented a 2010 Nissan Altima Hybrid and drove it for about 250 mostly highway miles. When I topped it off for the return to Hertz, I found that it had averaged 28 miles per gallon, i.e., hardly better than the 7-passenger 1993 Dodge Grand Caravan that I owned. The Altima seated four in comfort and five if they didn’t mind getting friendly. The trunk could hold one standard suitcase plus a carry-on bag or two ; much of what would have been the trunk was apparently being used to hold batteries. I learned what 17 years of progress from the automotive industry looks like: going from 25 to 28 mpg while reducing the interior volume of the vehicle by half.

[Typical indicated highway driving speed was 70 mph, with the air conditioner on roughly 60 percent of the time. The trip included about 30 minutes of traffic jams due to an overturned vehicle (how would Southern Californians manage on the icy potholed roads of Massachusetts if they are flipping their vehicles over in broad daylight on perfectly dry and smooth Interstates?) and weekend traffic on a state highway going through what had been a small town and is now part of the endless strip mall sprawl.]

Full post, including comments

Jihad, Middle age misery, PhD salaries, and other items from the Economist

A few interesting articles from the December 18, 2010 Economist magazine…

“Is it worth doing a PhD” notes that in Britain a man with a PhD earns 26 percent more than a man “who could have gone to university but chose not to” (i.e., a high school grad). In theory that extra 26 percent might make up for the 10+ years of lost wages during bachelor’s and graduate programs, but a man who gets a master’s degree earns a 23 percent premium. I.e., the difference in ultimate salary is nowhere near enough to make up for the lost wages of extra years in grad school and, in fact, in math and CS the premium does not exist. The economic damage of PhD programs is not limited to graduates, however. There are a huge number of dropouts and they tend to drop out after wasting many years in school (clinging “like limpets before eventually falling off”). As this is the Economist, the question of whether the PhD graduates might have had a lot of compensating fun during graduate school was not addressed.

In Economics Focus “Exploding misconceptions”, Barack Obama is quoted: “extremely poor societies…provide optimal breeding grounds for disease, terrorism and conflict.” The article cites studies by Alan Krueger of Princeton and Claude Berrebit of the RAND Corporation as well as surveys by the Pew Global Attitudes Project. Jihadists, including suicide bombers, turned out to have higher incomes and more education than average within their societies, e.g., in Lebanon or among the Palestinians in the West Bank and Gaza. The surveys of Muslims found that those with the most education were more likely to agree that suicide bombing against Western targets in Iraq was justified. As far as producing terrorists go, “citizens of the poorest countries were the least likely to commit a suicide attack”. (This dovetails with my November 2009 post “Who finances the Taliban and Al-Qaeda? We do.”)

Iceland, which let its banks fail, is compared to Ireland, which took on government debt to bail out its banks. Iceland had a painful brief period of adjustment and now is doing better than Ireland. (story)

The cover story “The U-bend of life” is about how average human happiness varies with age. Old people and young people are happy. The middle aged are miserable, with a reduction in happiness that starts around age 25, dips to a nadir at 46, and begins to rise again around 60. These data were adjusted for the presence of children and other responsibilities, supposedly. Tying this back to the first article discussed in this post, better educated people are happier, but the effect disappears when adjusted for income. A plumber or electrician who earns the same as a Ph.D. will be just as happy. [I guess one could argue that plumbing skill is in fact a “better education” than an abstruse Ph.D.]

Full post, including comments

Last-minute Christmas gift ideas

Here are my ideas for last-minute Christmas gifts, almost all of which are available at Amazon.com:

cheap

expensive

  • mother of all toaster ovens: Breville BOV800XL (way faster (due to convection) and more convenient (due to integrated timer) than a standard oven)
  • best all-around compact camera: Canon S95
  • mobile phone with the best screen for viewing photos: Samsung Epic 4G (Organic LED screen, unique among smartphones; real keyboard; order with two extra batteries and three chargers unless recipient lives in a very good Sprint coverage area)
  • tablet computer for someone who wants to carry it in a pocket and listen to music: Creative ZIIO 7 (half the price of an iPad; should also run any Android application)
  • great sound in a small convenient package: Bowers & Wilkins iPod Dock (same concept as the Bose systems, but engineered by the world’s leading speaker company (B&W is an English company that makes most of the $10,000 monitors used in recording studios))

aviation-related

  • book for helicopter nerds: The Helicopter: Thinking Forward, Looking Back (some real aerodynamics)
  • for a pilot: an ebook reader for viewing approach plates, either the Kindle (cheap, very sharp screen, near-infinite battery life) or iPad Tablet (expensive, screen slightly blurry due to color LCD technology, shorter battery life, more flexible and capable than Kindle)

Folks: please use the comments section to post your best Christmas gift ideas.

    Full post, including comments

    Santa Claus flies in via helicopter

    When we started doing helicopter charter flights we imagined that it would be taking rich people to their backyards on Martha’s Vineyard. Business of that sort has been, uh, rather lean. Therefore we were grateful to have the opportunity to operate a charter flight yesterday from Hanscom Field to the Billerica High School with Santa Claus (a.k.a. “Harvey”) on board:

    [I took these photos with a Samsung Epic 4G phone (Sprint). Note that I did not wear an elf or reindeer costume, though I did consider trying to find some of those antlers that people attach to their car doors. I wore my usual jeans and T-shirt and welcomed the children for photos in the helicopter while “Santa” worked a separate line of munchkins.]

    Full post, including comments

    All couples with children should get divorced?

    I was on the phone last night with a friend I’ll call “Susie”. She talked about how angry she was with her husband for not doing enough of the work associated with their two children. “I probably do 85 percent of the work,” Susie noted, “and in any case there is nothing that Bill could do now to make up for a year of lost sleep. I’m still angry about things that happened 10 years ago.” Did she imagine that other American women were getting more help? “No, all of my friends are in the same situation.” If her husband was no worse than others, why then was she angry? “If you were born into slavery and everyone you knew was a slave, it would still make sense to be angry about the situation. Maybe every woman being angry is the first step towards justice.”

    It then occurred to me that perhaps Americans with kids would be happier if all couples got a divorce when the kids were about 10 years old and did not need too much hands-on child care. If a woman desired “the society of a more or less coarse-minded person of another sex” [Isabel Archer in Henry James’s Portrait of a Lady] she could remarry a man who’d wronged some other woman by not doing his fair share. Every married woman would still be stuck with a slacker, but it wouldn’t be the same slacker who prevented her from enjoying a full night’s sleep when her children were young.

    Full post, including comments