Monday’s DBTEST 2010 Workshop at the 2010 ACM SIGMODconference in Indianapolis concluded with an interesting panel discussion that included keynote speaker Phyllis Frankl (Polytechnic Institute of NYU), Leo Giakoumakis (Microsoft), Harumi Kuno (Hewlett-Packard Laboratories), Ken Salem (University of Waterloo) and Florian Waas (Greenplum). Each panelist discussed what they thought the “Grand Challenges” of database and [...]
Notes from the DBTEST 2010 Workshop
June 9th, 2010 · Comments Off
Tags: Computer Science education · Product development
Benchmarks and measurement bias – part deux
June 5th, 2010 · Comments Off
This past Thursday I had the opportunity to listen to Peter F. Sweeney of the IBM T. J. Watson Research Laboratory as he spoke on “The Poor State of Experimental Evaluation of Software and Systems in Computer Science” during a lecture at the University of Waterloo. Here’s Peter’s abstract: As hardware and software continues to [...]
Tags: Computer Science education · Performance measurement
CFP: Second TPC Technology Conference on Performance Evaluation and Benchmarking
March 16th, 2010 · Comments Off
Raghunath Nambiar of HP Labs sent an email to me this morning about the forthcoming Second TPC Technology Conference on Performance Evaluation and Benchmarking, which will be co-located with the 2010 VLDB Conference in Singapore this September. This is the second TPCTC workshop, that follows a successful 2009 workshop in France last summer. The papers [...]
Tags: Computer Science education · Performance measurement
Benchmarks and measurement bias
September 20th, 2009 · 2 Comments
In the past few weeks I’ve witnessed a number of published performance analyses, both with and without SQL Anywhere. By and large these “benchmarks” have been exceedingly simplistic, which is unsurprising since a simple benchmark requires significantly less development effort than a complex one. Performance analyses I see frequently, for example, involve (simply) inserting a [...]
Tags: Performance measurement
ORM toolkit benchmarketing wars
August 16th, 2009 · Comments Off
This past Saturday, ORM toolkit provider X-tensive.com announced ORMBattle.Net, “The ORM Tool Shootout”. What X-tensive has done is they’ve created a “benchmark” to test the efficiency of various ORM toolkit implementations, and then published the results, comparing Microsoft’s Entity Framework, Lightspeed, LLBLGenPro, NHibernate, OpenAccess, and Subsonic with X-tensive’s own ORM toolkit, DataObjects.Net. Unsurprisingly, the performance [...]
Tags: Database interfaces and persistent objects · LINQ · NHibernate · Performance measurement
Book review: The Data Access Handbook
April 21st, 2009 · Comments Off
Good books on database API programming are hard to find. That’s why I was pleased to discover The Data Access Handbook [1] on amazon.com, and I recommend this book to those of you who are either writing .Net, ODBC or JDBC applications directly, or who are DBAs responsible for such applications. The authors, John Goodson [...]
Tags: Database interfaces and persistent objects · Performance measurement
Essentials of test data management
March 25th, 2009 · Comments Off
In our whitepaper on capacity planning with SQL Anywhere, Ivan Bowman and I stress the importance and difficulty in properly scaling a production database to create a representative test instance: Because constructing synthetic databases can take a significant degree of effort, often a representative production system is used as the test workload database. While such [...]
Tags: Database Administration · DBA Administration Tools · Performance measurement
TPC hosts workshop at VLDB 2009
March 19th, 2009 · 1 Comment
The Transaction Processing Council (TPC) has secured a workshop to be held in conjunction with VLDB 2009 in Lyon, France, in August. The workshop, the First TPC Technology Conference on Performance Evaluation & Benchmarking, will be held on August 24. The workshop chair is Raghu Nambiar of Hewlett-Packard, with the keynote speaker just confirmed as [...]
Tags: Performance measurement
Maybe we need another benchmark
December 3rd, 2008 · Comments Off
For more than a decade we at iAnywhere have been arguing that schema and query complexity is largely uncorrelated to the size of the database instance, or the characteristics of the hardware platform: In our experience, there is little correlation between application or schema complexity, and the database size or deployment platform. Developers tend to [...]
Tags: Hibernate · LINQ · Performance measurement · Query optimization · Self-managing database systems · SQL Anywhere
Capacity planning with SQL Anywhere: forthcoming webinar
November 15th, 2008 · Comments Off
A reminder that I’ll be presenting the last of the SQL Anywhere 11 webinar series, on Capacity Planning with SQL Anywhere, this coming Thursday 20 November 2008 at 11am EST. Here is a link to the Sybase registration page for the series; if at all possible please register beforehand. In the talk, I’ll outline a [...]
Tags: Performance measurement · SQL Anywhere

Glenn Paulley is a Director of Engineering at Sybase iAnywhere.
