Failure: Establishing Flow

Like my past posts in this series, we’re going to talk about failures and I’ve had this problem at a number of places that I’ve been employed or contracted.  I just can’t maintain flow.  Developers all know what flow is, whether this is what you call it or not.  You know that feeling when you’re “in the zone” or “on fire”.  That’s flow.  It’s a period of focused hyper-productivity.  We enjoy it.  I long to experience the adrenaline like rush that it provides to me.  The things is, achieving flow is the exception, not the rule, for our daily lives.  Here are some examples from my experiences.

At one place I worked I shared an office with another programmer.  It was located part way down a quiet dead end hallway.  Just a little farther down that hallway was an office belonging to a manager in the company.  She had a fairly regular stream of people coming and going through the day.  The office that I was in was a little bit weird in it’s layout.  While there was a hallway right outside of it, the office also had doors connecting it to those on either side of it.  For some reason my co-workers got in the habit of not using the hallway to walk to this manager’s office.  Instead they would travel through my office and use the joining door.  When the manager was busy people would linger in my office waiting for her to free up.  Essentially my office became a waiting room for this manager’s visitors.  As you can imagine it was quite disruptive.  No amount of loud music in headphones could completely block the distractions of movement that occurred in my peripheral vision all day long.

In another working situation, I was managing a fairly large development team.  As a result, I was required to be constantly moving about helping to solve problems, clear roadblocks and to communicate (read: meetings) with management above me.  All of those tasks were part of the job.  Over time my managers began to request my attention on shorter and shorter notice.  This resulted in my day constantly being broken up by spur-of-the-moment meeting requests and drop in discussions.  Regularly these would interrupt work that I had to get done.  Instead of being able to focus on that work for any appreciable amount of time, I found my self constantly having to re-integrate the work task into the front of my conscious mind.  As most of us know, this kind of context switching takes an enormous amount of effort and an appreciable amount of time.  Tasks that would normally have required 30 contiguous minutes of effort were now taking two hours (when the smaller pieces were added together).

In both of those cases I was far less productive than I could have been.  I responded differently in both situations as well.  In the highly trafficked office I expended an enormous amount of effort trying to block out the distractions.  When that wasn’t providing any results I attempted to break my co-worker’s habits by locking the connecting doors between the offices.  The, of course, revolted against my attempts to change their habits and freedom of movement was quickly restored for them.  In the end the only times I was able to regularly achieve a state of flow in that job was when I was working in the office after 7pm.

When I was fighting with the cost of context switching in the second example, I did for a short time attempt to counter act the problem by block booking “meetings” in my calendar.  For a short while people respected those meeting blocks which gave me the desired results.  Again the old habits and practices came back once people clued into what I was doing.  Once that happened seeing a “meeting” entry in my calendar simply invoked the person to walk by my cubicle to see if I was there or not.  If I was….well…you get the picture.  Like the other example, the only times that I could make any progress were in non-traditional working hours.  For the duration of that work engagement I never once successfully achieved flow.

So how is this a failure (since this is a series on failures)?  I failed to be able to produce at the levels that my employers should have received from me.  Yes, a significant portion of the blame can rest with my co-workers and bosses for not allowing or providing an environment where flow was possible.  On the flip side, as a professional I should have requested that I be allowed to create those conditions.  I’m not saying that I should have marched into management’s office and stated “I want to be left alone to work”.  That just won’t fly.  Any development role requires interaction with others.  You can’t just squirrel away and expect to have full day after full day of flow capable time.  It’s unrealistic.  There are a couple of things I should have done though.

First I should have requested to have an office that minimized any unnecessary distractions.  I should have made it clear that having my office be a hallway and/or waiting room was unacceptable considering the alternative (the hallway) that was available. 

I should have made it clear to people that I had ‘office hours’ where I would be available and ‘productive hours’ where I would not.  As long as the ratio of the two is well balanced (this will vary depending on your role and the requirements that the job places on you), I don’t see this as being a difficult request to fulfill.

Finally, I should have made it clear to all of my bosses that the environment was not allowing me to achieve what I was being asked to do.  I should have explained to them, and quantified if requested, how much it was costing them by keeping me from achieving flow.

In any event both of those experiences are from a number of years ago.  It wasn’t until last spring that I was lucky enough to hear Neal Ford mention the book Flow by Mihaly Csikszentmihalyi in one of his talks.  I spent a week reading and really absorbing the information in the book and now understand that the state of flow doesn’t just happen.  You can construct it and make it repeatable.  Not allowing myself to do that at future jobs will be a failure completely born by me now.

Published at

Failure: Napkins and a completed product are not good enough

Continuing on my journey through failures and the lessons that I’ve learned, we’re going to make a stop at a project that I did when I worked at a very small (but successful) development shop.

I started at this shop and one of the first tasks that they assigned me was building a reporting engine for a POS style’d application that they were re-developing.  This sounded fine by me as I’d just rolled out of a company where I’d done the exact same thing.  I gathered what little info I had on the new and old applications plus the reporting that was being replaced.  People dropped print out copies of existing reports on my desk.  I was getting my bearings with regards to the outputs that may be needed, but I still was completely lost when it came to what the user experience should be.  It wasn’t too long into this project that I realized this (I hadn’t written any code yet in fact) and decided that I needed a sit down with whoever was going to act as the client.

After finding out who I should talk to I set up a meeting so that I could gather some requirement stuff.  I sat down and laid on the table that I wasn’t sure what the expected experience should be when we finished this thing.  The response was “It should be configurable.”  I asked how.  I was told “We want to be able to change things like logos and stuff when we put this out to different clients.”  Okay…this person was obviously thinking of the final reports.  I redirected the conversation back to the user experience leading up to the generation of the reports.  The advice I was given at this time was “We need the same selection criteria as we currently have.”  Nothing more (nothing less mind you).  When I asked about layout, modality (this was a WinForms app) and other things that every user would see and have to deal with I was met with blankness.  After an hour of probing and questioning in different ways I left the meeting holding onto one detail…the criteria must be the same as before.

I left the meeting believing that the user experience was firmly in my hands and that anything I did (within reason and practicality) would be acceptable.  Oh my was I wrong.  I worked for about a month and a half on the product and had some working reports that I could show so I asked for a desk review of what I’d done.  None of the user experience was acceptable.  It didn’t mimic the green screen style of the system we were replacing.  In the eyes of the reviewers, I had horrifically failed.

For some reason, when trying to initially gather requirements I chose to ignore my past experience, which had taught me that just because a client didn’t state something, it doesn’t mean that they didn’t want it.  I should have known to dig harder to pull those requirements out.  That was a large part of my failure.  One simple assumption quickly transitioned into a mistake which grew into failure.

How could I have fixed it?  Well, the obvious answer is that I should have asked more questions and taken more time before getting started.  Sure, that will work, but I like to get things delivered quickly so having a large up front requirements gathering task, just isn’t my style.  The not-so-obvious answer is that I should have started, but delivered after the first week instead of waiting one and half months.  I should have mocked up the user experience in a way that conveyed my intentions and direction and shown that too the parties concerned.  I could have done it by drawing up some forms and linking them together to show navigation and mock content.  I could have take the decidedly lower tech solution and just drawn up some story boards.  Either way, after one week I would have known if I was on the right track or not.  If not, I would have had a great opportunity to use the existing mockup as a conversation starter to elicit more requirements and then I could have started over. 

Having to start over after one week is hardly a failure in my mind.  In the case of lacking guidance it would have acted as a necessary step in gathering requirements.  Better yet, I only would have burned one weeks effort instead of one and a half months.  That is a more responsible use of the company’s money and a much better way to get exactly what the business needs.  Fail fast and succeed.

Failure: Interviewing for a position

Experience is simply the name we give our mistakes – Oscar Wilde

Continuing on my series of posts themed around failure, we’re here to look at an interview that I once did.  It resulted in me taking the job.  That was the failure.  Before we get too far into this, let’s step back to the beginning…..

When I was just getting started contracting/consulting independently, I was presented with the opportunity to be a team lead for a project.  I was told that the client was very excited to have me as a possible candidate and with my experience.  Feeling good about the fact I was desired by a company I went off and did what I thought would be the first in a series of interviews with them for this position.  I arrived at my interview and nothing seemed out of place when we got started.  There was the obligatory HR person and another who was introduced as the Project Manager.  As I’ve found to be the case, HR takes the reins and leads us down a touchy-feely path about how I work with people and “tell me about one time that you were in a stressful situation and how you dealt with it” stuff.  As I was expecting that this was simply a starter interview that would determine if HR and the PM thought that I’d fit in their environment and team, I played along for about half an hour.  That’s when it got different…and I didn’t notice enough to act on it.

The PM started to investigate my technical skills, or so he said he was going to.  He led off with a monologue about the team, the project, the client and the importance of all these things.  After about fifteen minutes of me listening to his manager-speak he asked if I thought I could handle this, to which I replied that I could.  He immediately followed that by asking “So you know about design patterns?”  I was relieved.  Finally I was going to be able to show some of the technical skills/knowledge that I’d amassed over the years.

“Yes, I have experience with the theory of them as well as their practical applications.”  I left the door open for the PM to take the design pattern conversation where he wanted to which was….

“Okay, I think you’ll be able to work with our library of them then.” Looks at HR person, “I think we’re done here.”

And the interview ended.  I was so dumbfounded at that being the technical portion of the interview I couldn’t react and left, my mouth agape.

The next day I was offered a contract that saw me leading (at one point) a team of sixteen developers on a project that nearly had an eight digit budget.

Where is the failure in getting a lucrative, long term contract?  I had no idea what I was getting into.  Zero idea.  I didn’t make sure to ask a single question.  Interviews are a two way process.  The employer needs to ensure that the interviewee isn’t selling a false bill of goods, will fit the culture, etc.  The interviewee has to ensure that the role on offer will fit them, the culture is one they can work in, the project is interesting, etc.  Employers get a detailed CV detailing the history of the interviewee.  Usually it’s a couple, or more, pages in length.  The interviewee gets a boilerplate job posting and Google.  The knowledge of each other is firmly slanted in favour of the employer.  As a result interviewees have to spend more time probing during the interview to try to level the playing field.  I didn’t do that and, as a result, failed myself into a position that was a less than enjoyable experience.

I needed to ask to have a technical person in the interview.  I needed to ask why it was rumoured that this project was nearing 100% developer turnover rate in the last twelve months.  I needed to know what the codebase looked like.  I needed to know what the current developers were bitching about.  I needed to know a lot more than I did.

I’ve since learned that I don’t allow an interview to end until I’m satisfied that I have enough information to make a decision.  If people claim to have to end the interview due to other commitments, I ask to meet with other members of the project or team.  If they won’t produce those members, it counts against them.  If they won’t schedule a follow-up (if required), and one that has more than just HR in it, it counts against them again.  The process isn’t done until you can make a well informed decision.  If you can’t you need to tell the employer that and walk away if they won’t help you to.

Allowing that interview process to get me into a long term contract was a mistake…and an experience.  Certainly one that I’ve learned from.

Failure: An introspective series on those I’ve created and endured

I recently posted about Hiring Internally and it turned out to be about the failure in leadership that I had on a project.  I’m fine with that.  For those of you that don’t know, I fail.  I do so spectacularly (sometimes) and regularly.  Welcome to my realm.  What I do, however, that may (or may not) separate me, is spend considerable time thinking about the reasons for, actions taken during and result of those failures.

In the spirit of Scott C. Reynolds’ recently started series baring all for critcism, I’m going to do the same.  I’m going to openly document my failures.  I’ll do my best to make them detailed and comprehensive, but I will invariably miss something.  Please offer your thoughts and criticism.  I’m a big boy and I can take them.  Hopefully you can take something from one of these and learn from it.  If not, unleash your hounds and tell me how I did it wrong and why you would have done it differently.  I need to learn too after all.

I’ll keep updating this post with links to all of the posts in the series.  I’m not sure how long this will be or what content it will cover.  When I get bored with it I’ll probably stop.  When I think of something I’ll probably write.  Either of those might be my first failure in this series.

Hiring Internally
Interviewing for a position
Napkins and a completed project are not good enough
Establishing Flow

Hiring internally

In our Brownfield Application Development book, and in previous posts on this blog, Kyle and I have talked about the different personalities that you can encounter while working on a development project.  Unfortunately many of the types we listed, and that you see and remember, are negative.  Because development is such a social task (whether you like it or not) conflicts in personalities, styles and objectives are easily surfaced.  Add on a heavy dose of introversion and natural social ineptness and you have a cauldron of simmering conflict just waiting to bubble over.

During the hiring process HR and dev teams do their best to eliminate candidates that are obviously going to bring these types of issues with them.  Sometimes it works, occasionally they slip through and you have to deal with them.  Unfortunately, it’s very rare to see the same diligence applied to the transfer of people from one internal team to another.  The results can be disastrous.  About a year ago this happened to my team (I say my because I was the tech lead for the project).

We, as a cohesive and very productive team, were ticking along meeting deadlines, turning out high quality code and generally getting praise from the clients for these things.  Management decided that we had more work that we were going to take on and decided to transfer another of the already on-staff developers to our project to assist with the new work load.  Don’t start thinking the Mythical Man Month and adding resources to an already late project.  We weren’t late.  In fact we were ahead of project schedule at that time.  On top of that the work being assigned to the new team member was isolated in it’s own branch with a thought of it being included in a future release, not the one we were currently working to finish.

Knowing that this developer would be working in isolation I decided that the impact to the team was minimal and shed any worries I had at the time.  Things moved ahead for a few weeks before they came to a crashing halt.  I won’t get into details about what happened but the underlying problem was that the developer recently assigned to our team didn’t have the same beliefs or culture as the rest of the team did.  The result was a series of very animated and heated conversations that led to a requirement for serious and significant policing of the development actions of this person.  In the end the original team had to declare to management (above the project management level) that having this individual working on the project was adding significant risk to the current release and had already jeopardized the following release.  The result was that the offending developer was removed from the project and a 100% re-write of his code (four months effort) was required to bring it to the project’s quality standard.

The lesson that I wanted to convey from this incident was that you have to be diligent in the screening of any person joining your team, regardless of if they are an external or internal hire. Blindly accepting a new resource since they are already within the organization doesn’t preclude them from introducing risk and conflict to the project.  If you are a team/technical lead, architect or manager for a team, you have a responsibility to protect your team from distractions, morale killers and risks.  In this case flags should have been raised months before this individual joined the team, but trained with it.  The statement “It doesn’t matter what the client wants, I’ll give them what I think they need” was boldly stated and I failed to remember that when the speaker was pushed onto our team.  I failed my team by not filtering based on this past interaction.  Don’t let internal recruitment cause you to fail yours.