Main

July 10, 2007

Dynamo Reference

I omitted the Dynamo reference from the previous collection, but now that the SOSP program is live:

Guiseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swami Sivasubramanian, Peter Vosshall and Werner Vogels, “Dynamo: Amazon's Highly Available Key-Value Store”, to appear in the Proceedings of the 21st ACM Symposium on Operating Systems Principles, Stevenson, WA, October 2007.

The final version needs to be camera ready by August 9, I will see whether the ACM allows us to put it online at that time.

Update: to avoid all confusion: this is internal-only technology, it will not be released as a public web-scale computing service. We just happen to write up its architecture for this year's SOSP.

July 7, 2007

Reading References

I recently gave a few talks in which I gave some reading advice to the audience and I promised to follow-up with posting the links here.

The first article is the interview of Michael Stonebraker by Margo Seltzer in the May/June edition of ACM Queue (unfortunately the article is online yet, but this link seems to work thanks to Peter O’Kelly). One of the points Mike makes is that almost everything in the data management world has changed dramatically over the past decade: applications, operating environments, hardware architectures, but that databases management systems have stuck to the one-size-fits-all architecture from 25 years ago. He goes into several examples why there is a need for different approaches to address application needs and to exploit hardware advances. 

I refer to this article in my talks as it resonates strongly with my experiences. Even if you would only take a narrow look at scalability and reliability requirements you can see that the traditional database architectures have clear, well understood, limitations.  There are many data patterns at application level that can be served by simpler data storage systems, for example applications that only need to access their data store through a primary key (promotion for this product, shopping cart of this customer, thumbnail image of this product).  One can develop storage technologies that specifically address this category of applications and that have excellent scalability and reliability properties and are very cost-effective.

The second reference is a presentation by Richard Gabriel where he lays out a time model of traditional software adoptions: “Models of Software Acceptance: How Winners Win”. I use the data from this presentation for two purposes: the first to show that for companies such Amazon, who require technologies to address scaling needs that have not even left the research labs yet, it is essential to accelerate this adoption model through active involvement with productizing research results. Most often these advanced research results will come from our own product teams. The second point is how service oriented software development can help break through the traditional barriers.

A paper I refer to often is “From Push to Pull – Emerging Models for Mobilizing Resources” by John Hagel and John Seely Brown. This paper describes the shift in economic models to deal with uncertainty in demand and growing consumer power, etc. At Amazon we are addressing these new realities with our web-scale computing services. On-demand, pay-as-you-go, connectable services are key in the “Pull models” that are arising in many different economic areas.

I use Richard Conniff’sLimits of the Alpha Male” as an easy intro into self-organizing systems and how in real life self-organizing is a proven concept. For any truly scalable agile environment, self-organization is essential.

I then use Steve Grand’s  “Creation: Life and How to Make it to dive deeper into self-organization and the emerging properties one can expect of such an environment.

April 29, 2007

New in May

  • Tori Amos - American Doll Posse – Each of the 5 persona on the album have their personal blogs, more details at the wikipedia page for the album (May 1).
  • Groove Armada - Soundboy Rock – Unpredictable (May 10 US release).
  • Linkin Park - Minutes to Midnight – Highly anticipated. 4 years since Meteora; too long a wait. They seem to have dropped the Nu Metal sound, I am not sure I like that (May 15).
  • Black Book (Zwartboek). Paul Verhoeven’s new war time drama/thriller playing in last year of WWII in the Netherlands. Betrayal, tragedy and revenge. 8.0 rating at IMDb ( No release date for the US, but May 1 at Amazon UK).
  • Pan’s Labyrinth (El Laberinto del Fauno). A dark, amazing movie. Ranked #1 for 2006 and #45 all time at IMDb. It is not too late to see it in a theater. Too bad New Line doesn’t produce HD DVDs (May 15 - US).

April 16, 2007

Myths of Innovation

Congrats to Scott Berkun for sending his "Myths of Innovation" book to the printer. Scott has collected an excellent set of recommendations for his book; among others JSB, Guy and me. It is well deserved; I read a beta version of the book and I was impressed.

It is very different from Scott’s first book "The Art of Project Managment" which I consider to be the standard professional work for project management. That book was a very personal story, with best practises and Scott’s extensive PM experiences. In this book Scott uses the voice of innovators through history to tell the story of the myths of innovation for him. It is a very clear story; solid research and lots of documentation. It would be a good read for your next offsite with your management team. Highly recommended.

November 1, 2006

New in November

The Casino Royal soundtrack will be released on November 14. It will be interesting to compare not only with the 1967 movie (Peter Sellers as Bond) but also with the original Burt Bacharach soundtrack

May 1, 2006

May Countdown

January 30, 2006

January Recommendations

The first month of this year has been cold and rainy in Seattle but it did bring a number of surprises in books, music and theater.

  • I am sure many of you have seen the announcement last week that Amazon.com will be producing a weekly internet-only Bill Maher show called “Amazon Fishbowl with Bill Maher”. The fishbowl concept is something that Amazonians are very familiar with; frequently musicians, authors and other artists will visit Amazon, to talk about their work, and to give short performance or read from their work, etc. Last Friday author Max Barry read a chapter from his latest book Company and at lunch time Scottish singer-songwriter KT Tunstall performed. KT was truly spectacular, making use of a playback machine to create her on backing’s on the fly. Here is a videostream from her website that demonstrates the process. She is an incredible strong live performer. Her album is not out yet in the US, but you can preorder it, or you can get it directly from the UK.
  • In the past I have read most of Ian Rankin’s Rebus novels, enjoying the later ones more than his earlier ones. I think he rightfully got an Edgar Award for Resurrection Men in 2004. It wasn’t until 2 weeks ago that I discovered two unknown novels by him at the Toronto airport (on my way back from CUTC) which he had originally written under the pseudonym Jack Harvey: Blood Hunt and Bleeding Hearts (there is also a 3rd one: Witch Hunt). The books are fast-paced thriller stories, very different from the moody and complex Rebus ones. They are very enjoyable and addictive entertainment, of the kind that makes you read through the night.
  • Last night I went to see the 1st event performance at UW School of Drama of Bertolt BrechtThe Good Woman of Setzuan”. This was a very strong performance with interesting set design and costumes. What made it particular interesting was the original score developed for the performance based on blues and ragtime music. Opening night is on Wednesday Feb. 1 and it will run through Feb 12. You will not be disappointed.

December 8, 2005

Two Recommended Essayists

There are two online technology essay writers who I truly enjoy reading: Scott Berkun and Paul Graham. Paul is probably the more well known of the two given his Hacker and Painters book, but I think that both have a unique insights in the software industry and the development process. Both are excellent writers who take a deeper, philosophical look at human nature and the specifically the traits of professionals, they investigate the fundamentals of human collaboration, and the ways that it impacts our daily lifes Paul's background is in Lisp programming, while Scott's is in program management and UI design. If you want to sample Paul Graham I suggest you start with "Made in the USA", for Scott Berkun I suggest his recent "Why Smart People Defend Bad Ideas".

What triggered this posting is that Scott Berkun now also has a book out: "The Art of Project Management" which I think is very much worthwhile reading for anyone involved in project management. There is a lot of useful food for thought in this book as well as many pratical suggestions, and this week it will land on the desks of the people that work for and with me as "suggested reading". A sample chapter can be found at Scott's book site, if you are interested in sampling before you buy.



Contact Info

Werner Vogels
CTO - Amazon.com

605 5th Ave S.
Seattle, WA, 98104




Syndication

Subscribe to this weblog's
atom feed or rss feed
Powered by
Movable Type 4.01