More thoughts on time analysis: correlations and revealed preferences

Posted: - Modified: | analysis, geek, quantified, time

People often ask about the time analyses I do as part of my weekly review. My weekly time tracking reports go back to about December 11, 2010, when I started tracking my time using the free Time Recording app on the Android. I do it because of the following reasons:

  • I need to track my project-level time for work anyway,
  • I want to see where I spend my time and if that’s in line with my priorities,
  • I want to know how much time it takes me to do certain things, in order to improve my estimates and get better at planning,
  • I want to avoid burning myself out
  • I want to make sure I allocate enough time to important activities instead of, say, getting carried away with lots of fun work and flow experiences, and
  • I want to cultivate other deep interests and relationships.

Fatigue and burnout are particularly big concerns for developers. There’s always the temptation to be unrealistic about one’s schedule, either through over-optimistic estimates or through business pressures. However, sustained crunch mode decreases productivity and may even result in negative productivity. Sleep deprivation severely cuts into cognitive ability and increases the chance of catastrophic error. I like what I do too much to waste time burning out.

Development is so engaging for me. I could keep writing code and building systems late into the night, at the expense of other things I could do. Tracking time helps me keep a careful eye on how much time I spend programming. Like the way a good budgeting system helps me make the most of my expenses and gives me the freedom to take advantage of opportunities, a good time budgeting system helps me make the most of my focused work time and allows me to also focus on other things that matter (the care and feeding of relationships, the development of new skills, and so on).

So here are some new things I’ve learned from time tracking:

  • I sleep a median of 59 hours a week, which is about eight and a half hours a day. This is more than I expected, but I manage to get a lot done anyway, so it’s okay.
  • I work a little over 40 hours each week, except for the occasional week of crunch time or travel. I don’t make a habit of 50-hour weeks, and I get a little twitchy when I work too intensely several weeks in a row (46 hours or so). This means that when I estimate timelines or project my utilization, I should assume 38 or 40-hour weeks instead of 44 hours.
  • I spend most of my time sleeping (44%), working (31%), or connecting with people (11%). Regular routines take up 9% of my time, while my favourite hobby (writing) takes only 5%. I enjoy my work and I sleep well at night, so this time allocation is fine.

In economics, there’s the idea of a revealed preference, which is basically what your actions show compared to what you might say or think you prefer. I may think I’d like to sew or learn languages or do the piano, but if I spend time playing LEGO Star Wars III instead, then that tells me that sewing, Latin, and Schumann are lower on my priority list. (Rationalization: LEGO Star Wars is awesome and it counts as bonding time with W- and J-, so it’s not all that bad.)

So, how do I really trade my time? Which activities are positively or negatively correlated with other activities? I made a correlation matrix to see how I spent my time. I used conditional formatting to make high correlations jump out at me. I found some interesting patterns in how I shift time from one category to another.

Activity 1 Activity 2 Linear correlation coefficient (r) Notes
Prep Personal 0.87 Getting things in order means I can give myself permission to learn something new
Cooking Prep 0.86 Makes perfect sense. Big chore days.
Break Drawing 0.75 More relaxing time = more drawing time
Travel Work 0.69 When I commute to work, I probably tend to work longer. Also, I needed to go to the office for some of the crunchy projects.
Sleep Break 0.67 Relaxed days
Sleep Writing 0.60 Nice to know writing isn’t conflicting with sleep
Social Drawing -0.50 The Saturday afternoons or weekday evenings I spend with people instead of sketching
Routines Drawing -0.65 Lots of chores = less drawing time
Personal Drawing -0.55 Learning other things = less time spent on drawing
Travel Cooking -0.60 Lots of travel = live off home-made frozen lunches
Sleep Cooking -0.62 Late weekend mornings = less cooking?
Sleep Prep -0.58 Likewise
Sleep Personal -0.57 More sleep = less time spent learning other things

I can guess at the causality of some of these relationships, but the others are up in the air. =) Still, I’m learning quite a lot from this exercise. For example, I thought I was giving up sleep in order to write more or draw more. It turns out that sleep cuts into cooking, prep, and other personal interests (sewing, piano, etc.), and doesn’t have much effect on work, writing, or drawing. I do sleep quite well, though, so it may be interesting to experiment with that.

I’m also happy to see I don’t give up too much because of travel – a median of 3.4 hours / week, much of which is spent reading, brainstorming, or listening to audiobooks with W-. Travel time reduces cooking time, but that’s okay because we batch-cook in order to minimize weekday cooking. It’s good to see that it doesn’t affect my other activities a lot.

The same dataset lets me analyze my sleeping patterns, report project-level breakdowns at work, and review quick notes on my day. I’m in consulting, so I need to track and bill my time per project. Time Recording makes it easy to do that, and I’m thinking of tweaking my workflow further so that I can use task-level times to improve my estimates.

So that’s where I am, tracking-wise. It takes me a few seconds to clock into a new category, and the habit is handy for making sure I know where my phone is. Tracking my time also helps me stay more focused on what I’m doing. If you’re curious about the idea and you have a smartphone or other mobile device, find a time-tracking application and give it a try. Have fun!

2011-03-29 Tue 21:54

You can comment with Disqus or you can e-mail me at sacha@sachachua.com.