On Reqs and Specs: The Roles and Behaviors for Effective Product Definition
Do you write Requirements or Specifications? Or do you combine them into ReqSpecs? Each has a place but combining them just causes confusion. By Steve Johnson and John Milburn
[PDF]
The Problem
Can you believe the angst between product managers and developers? Many product managers think their developers are incompetent. The feeling is mutual: developers don't think product managers bring any value to the process. Yet we all want to get products to market but our understanding of roles keeps getting in the way. Who writes requirements? Who writes specifications? And what's the difference between a req and a spec? The requirement is the problem.
Product managers write terrible requirements, littered with buzz words, ambivalent language, and non-specific performance parameters. They read like somewhat-technical marketing hype. And developers have to make sense of the requirements. They complain, "I cannot program to these requirements."
And they're right.
So product managers try to become more specific by writing what we call ReqSpecs. Part problem, part implementation--and impossible to use. Developers complain "don't tell me how to do my job" because the requirement now explains how the feature should be implemented. And they're right again.
The Role of Product Management
The primary role of the product manager is to be the "messenger of the market", and we must not take on additional tasks until that primary one is completed. Yet product managers frequently attend design meetings. Why? What value do they add? If product managers have time for design meetings, it had better be after they have completed their on-site visits with their market segment.
Besides, product management attending design meetings is not about getting better designed products; it's about sharing blame for poor design. "What do you mean you don't like it? You were there when we designed it!?!?!" If product managers are creating the design, what value is development providing? Coding? If that's all, perhaps we should just fire all the developers and outsource to India or Ireland or someplace where at least they will code to our design. That is, we'll get exactly what we asked for without the developer's editorial license.
Developers say they cannot program to product management's requirements. And they're right. What they need is a functional specification. ReqSpecs don't solve the problem. Let's clarify some terms.
- A requirement is short statement of the problem
- A specification is how to solve the problem
Requirements vs. Specifications
In Pragmatic Marketing's seminar Requirements That Work™, we teach product managers how to log market problems, distill them into the unique set of problems, and write requirements based on the market problems. A Market Requirements Document (MRD) is a master list of all problems and the number of customer and prospect sites reporting the problem. Developers value the class as much as the product managers because eliminating dysfunction by teaching product management to deliver what developers so desperately want to know: what are the problems in the market? The problem is the requirement.
By definition, a requirement is implementation-free; that is, absent design. When developers request more specific implementation details, they're asking for a specification instead of a requirement. In Extreme Programming (XP), a requirement fits on an index card and is delivered in the form of a story. The requirement is also an explicit "agreement to discuss" so that developers fully understand the problem.
Instead of being in the requirement, implementation details must be in the specification. A specification is the architect's intended implementation to solve the problem. It is not an architectural blueprint of the final product.
Joel Spolsky has already written much on specs (Joel on Software). We defy you to find an article that doesn't have at least one tip on creating better products.
"On any non-trivial project (more than about 1 week of coding or more than 1 programmer), if you don't have a spec, you will always spend more time and create lower quality code."
And also says:
"A functional specification describes how a product will work entirely from the user's perspective. It doesn't care how the thing is implemented. It talks about features. It specifies screens, menus, dialogs, and so on. A technical specification describes the internal implementation of the program. It talks about data structures, relational database models, choice of programming languages and tools, algorithms, etc."
So a requirement states the problem. A specification states the solution. Joel defines two kinds of specification: functional, which is the intended approach to solving the problem, and technical, which is a detailed internal implementation. In the end, we all have a critical role to play:
- The product manager finds and quantifies market problems, articulating them in the form of requirements
- The product architect (or designer) writes a functional specification describing the approach to solving the problem
- The product developer creates a technical specification that fully describes how the functional specification will be implemented
Think developers are incompetent? Maybe they're working in a dysfunctional environment and are frustrated themselves. Focus on market problems and you're halfway to a reasonable solution. Design a reasonable solution to the problem and you'll deliver a product that people want to buy.
Form of well-written Requirements
We’ve completely abandoned the traditional “the product shall” approach to writing requirements. Instead, we encourage product management to focus on the problems and let development focus on how to solve the problems. Many of the requirements that we read are in fact thinly- veiled feature descriptions.
Do you write requirements in the form of "the product shall?" If so, then you are probably limiting the creativity of your development team and writing specifications. However, depending on the requirements writing legacy that you inherited (probably from a extremely project- or program-oriented waterfall environment), you will need to transition your teams to understand that the product management role does not include writing specs, but rather that the value they add is through customer interaction and understanding market problems.
Do you write "as a 'role,' I want to 'perform and activity,' so that I can 'achieve a goal'?" If so, then you are probably an agile shop, using a variation of Scrum or XP development techniques. We have found this method seems to work the best in software companies, with co-located teams, that have a fairly high degree of domain expertise. However, there are numerous examples of multi-national projects building hardware or electrical components that have also been successful with this approach – it just requires different skills and techniques to be successful.
Our preference is the Requirements That Work format: [Persona] has [problem] with [frequency]. It forces product managers to explore the problem, not the solution, and helps the design team understand the context of the problem.
The benchmark for well-written requirements is:
- Is there a clear definition of the user(s)?
- Do I understand their problem / what they are trying to achieve?
- Do I have supporting documentation that provides the context about the persona and their problems so that I clearly understand how to design a solution to their problem?
Designer, Architect, or Product Owner?
If your company is considering introducing a new artifact, our guess is that you really need to introduce a new role! You’re probably missing a designer. Product managers have a full time job indentifying and quantifying the market problems. Your developers probably have their hands full delivering solutions. But who is designing those solutions?
No hardware company would build products without a designer, why do software companies? A designer analyzes the problem and designs a solution. Their output is a specification that the developers will use to develop to.
Alan Cooper argues that most projects fail because they do not have a spec at all. This is because most companies do not have product designers or architects. Product managers create desired feature lists. Developers write code. But no one is designing anything. Would you hire a carpenter to build the house? Of course not. You would hire an architect! Yet programmers write complex software products without a design. So Cooper suggests that we add a role that is new to most development organizations: the product architect. The architect analyzes the problems that are described in the requirements and then creates a specification, at a functional level, how the problem can be solved with the product. The architect delivers a recommended approach to solving the problem, serving as the bridge between product management and development.
Pragmatic Marketing's 2008 Annual Product Management and Product Marketing Survey found that for each product manager, there is an average of 1 product architects/designers, 0.72 development leads, and 5.5 developers. However, when these same product managers were asked how they spend their time, almost 50% are still writing detailed specifications! So, what are the architects and developers doing?
Regardless of the title or organizational structure, it is imperative that there is a clear delineation of the "what" from the "how" – development does the how, and product management does the what. Who's at fault? We have found that it is usually one of three fundamental reasons this is not being done:
- Product managers, especially those who came from a development role, write specifications rather than requirements because they are most familiar with them; don't know any better way to write them; and see this as a "comfort zone." Getting out and understanding the market takes time and is a lot harder than writing technical or functional specifications.
- Regardless of the official title of the architect/designer role, it is critical that this individual(s) has the respect and understanding of the development team; has a close relationship with the product manager; and understands the customer domain as well as the technical domain. Lacking any one of these three can create gaps.
- Some organizations do not fund the architect/designer role, and product managers act in this role by default. We see this especially in smaller companies who don't have the size or finances to fund the role.
Developers complain that product management requirements are not detailed enough. Requirements should in fact be absent design. Instead of providing more content, product managers should provide context so that the development team can fully address the problem.
Steve Johnson is a recognized thought-leader on the strategic role of product management. Broadly published and a popular keynote speaker, Steve has been a Pragmatic Marketing instructor for more than 12 years and has personally trained thousands of product managers and hundreds of senior executive teams on strategies for creating products that people want to buy. He writes the ProductMarketing.com blog. Follow Steve on Twitter or contact him at sjohnson@pragmaticmarketing.com.
John Milburn has “walked the walk” in technology product management. Throughout his 20+ year career, he has managed or delivered over 40 hardware and software products and implemented the Pragmatic Marketing Framework at many companies. John serves on the planning team for Austin ProductCamp and helps groups around the U.S. create and run their own ProductCamp. Contact John at jmilburn@pragmaticmarketing.com.
Syntax of Requirement
Vague requirements = crapshoot solution
"As a door-to-door frozen steak salesman, 30% of my inventory spoils on hot days (20 per year)" is not a testable requirement. How would one test whether the requirement was satisfied?
Let's say we assume the requirement is satisfied only if problem is eliminated - I give you a solution "fire the door-to-door salesman". Requirement met (no more wastage by salesman). If you say "but that's not what I had in mind", I say "you didn't say that in your requirement". Now apply this to a big software project (and out comes Windows Vista ;-) ).
Let's instead assume reducing the the problem is considered meeting the requirement. If the problem is with the percentage of spoiled food, trivial solution is to give the salesman more frozen steaks, some to keep at some freezer at home. If it's the total amount of spoilage you are trying to reduce, giving the salesman less steaks will meet the requirement but again, probably not what you had in mind.
If you specified that you needed a product which will allow the salesman to preserve X amount of frozen stakes for Y duration and it needed to fit in Z space (e.g. specific size car trunk) and be powered from a car 12V plug with Q available power and cost less than W, then you have a requirement set you can test against and anything which meets this requirement is more likely to satisfy your need.
If you wanted to give more creative license to the solution team, you could create a more general requirement for a system which will allow the salesman to sell a minimum X amount of frozen steaks per Y period at Q price with less than Z spoilage. Range of solutions increases significantly but the goal is still clear. Specifying just a problem completely misses what you're trying to achieve.
Design role
Partnering product managers with UI design specialists is often imperative, with equivalent roles often required but forgotten for programmatic interface design (e.g., Web Services APIs).
Just to be clear
Need a book? Try The Design of Everyday Things by Donal Norman. It's a classic!!!
Some thoughts...
Second is on the role of the "product owner", in the traditional Scrum/Agile sense. Mike Cotmeyer recently wrote that he thinks Scrum has put four traditional roles into the PO role: product manager, project manager, business analyst, and user experience designer. I map the "business analyst" and "user experience designer" into the missing product architect or designer role you mention (some other places might call these systems engineering...more terms to further confuse the conversation). In the end, I believe this overloading of the "product owner" term, at least in Agile projects, is making this problem worse by overloading the product manager with all the other product owner responsibilities.
Great article.
PO = everything else!
Design is a skill. product managers have a knack--a flair--and maybe their less bad at it than some developers but really, design isn't product management. Read Alan Cooper's lament about design in The Inmates are Running the Asylum.
Thanks for reading.
Don't forget, more on the product owner role in our Living in an Agile World ebook and seminar. Go to www.productmarketing.com to get the ebook--and see you soon in the seminar. :-)
Design Books
Also - completely agree about having designers design. Reality is that sometimes, people are multi-disciplinary, and part of small teams where they are asked to do less of more. Like player-coaches, actor-directors, singer-songwriters. Certainly not the ideal end-state - too dilutive, but worth acknowledging. I think it's great that you're providing some good references!
Great
Ambiguities...
There is a general ambiguity on the word "requirement", in particular "market req" vs "product req" (or specifically "s/w req"). One way to resolve this ambiguity is to reserve "requirement" for market reqs, and use "feature" for product reqs.
Every time the discussion of "why" vs "what" vs "how" comes up - the descriptions are always ambiguous, oversimplified, overlapped, confused, etc. One example alternative partitioning is as follows:
- "Why" is why the market needs something done, the problems (MRD, entirely market vocab, by Product Manager, Product Marketer).
- "What" is what is going to be done via product about the "whys" (Functional Spec, PRD, SRS, in personas & roles & use cases & interfaces, by Program Manager, Designer, Architect, User Experience, Quality Assurance).
- "How" is how the product will be implemented to accomplish its assigned "whats" (Technical Spec, Detailed Design, in modules & GUIs & platforms, by Designer, Architect).
I am not saying I like this particular break-down over any other. The complexity changes with the size of the org that owns it. Conway's Law says that products often resemble the communication pathways of the organization that produces them. This is often true of the documentation artefacts as well, with various overlaps or combinations or simplifications.
Often the roles overlap onto single individuals, e.g., Product Marketer combined w/ Product Manager, or Product Manager combined w/ Program Manager. These overlaps can be tough since you effectively have to debate/negotiate with yourself - like playing chess against yourself. But as re-orgs and growth happen, the roles (and associated deliverables) tend to get teased apart and refined.
Many granularities are available for breaking down the chain of refinement & traceability from concept to execution. And the level of granularity you have may very well be dictated by the org structure in place (smaller, and simpler ones tend to be more flexible). So roll/role with it! (I could not resist.)
Thanx for the great community!
-johnny
P.S. I am now a Project Manager, and I wish you Product Managers would sort this stuff out!
req vs feature
Thanks for your participation in our community.
Interesting article
Often times development will have excellent functional ideas that must be listened to. However between the Development and Product Management departments, it should be the PM dept that has a better handle and what customers need and how it should be from a functional level.
With that said PM's should look to other groups for expertise as needed (Creative, Usability, etc).
product managers and designers
Works one at a time but misses need to create winning products
What this premise needs to be implementable in many organizations is a method for relating these terse requirement statements into an indivisible goal (package) that product management, design, architects and development agree to deliver by a specific point in time. That will then drive the behaviors that ensure success and the necessary collaboration when the responsibilities are split.
teams and creativity
So the question to discuss with your team is who is best at design. And if not someone on the team, who can you find that can do it?
Extending your definition
from: [Persona] has [problem] with [frequency]
to: [Persona] has [problem/task to do] so that they can(achieve/contribute to this goal[justification]) with [frequency]
20 years ago we used to classify task using the DIF framework - which was also very useful to give the whole team a perspective - especially on more complex systems.
D - Difficulty
I - Importance
F- Frequency
For example: A frequent, easy and non-important task would be prioritised and designed in a different way to an infrequent, difficult and very important task
regards
alan
Product Architact role
We had engineers who was not involved at all in the How part of the equation. We motivated and coverted his role to a product archetact and was able to get the specification right.
Our comany is going to agile and the role of PM with PArch will be critical to successful product development.
Product Architect in Financial industry
Architect = development
I'm also surprised to hear you say "Agile" and also "market requirements and product functional specifications." I think these two phrases are mutually exclusive. Ideally, product managers should be writing requirements in the form of "The [persona] has a [market problem.]" Requirements should be about the problem; specs are the features that solve the problem and ideally should be written by the team that will develop it.
We cover this topic in our popular Requirements That Work seminar. Details at http://www.pragmaticmarketing.com/seminars/requirements-that-work
In the end, a designer or architect is always a good idea. Our annual survey data reveals that there is typically one per project. Whether it's in product management or development isn't really a big deal. But if it's NOT in development, what are those people doing? And how will they keep their jobs in the next round of outsourcing.
Design cannot be outsourced. Programming can and will be--and quite easily.



Love it, but...
Love the article, thanks for writing it! My only "but..." is that you didn't touch on completeness. Ultimately, every story provides value - either directly to a user, or in combination with other stories to entice a buyer, or as a supporting component of a go-to-market strategy. That's important to the product manager (putting half a solution into a release is not ideal), and also important to dev teams - making the prioritization process more transparent, and providing clearer context to them, and something to rally around (we're doing XYZ so that...)
Comparing a product owner's view with a product managers (as you describe above):
As a [persona] I want to [do something] [with some frequency] so that [I get value].
As a [persona] I have [a problem] with [some frequency].
The more I think about it, the more I like it - [a problem] is a great 'one level up' for why a persona [does something]. I worry that the [I get value] part will get lost. Or is that implicit in the problem statement, like:
As a door-to-door frozen steak salesman, 30% of my inventory spoils on hot days (20 per year).
Versus
As a door-to-door frozen steak salesman, I want to prevent my inventory from spoiling on hot days (20 per year) so that I can avoid the added inventory costs.
I think either can work, but maybe your syntax helps prevent people from writing:
As a door-to-door frozen steak salesman, I want to refrigerate my inventory so that I can avoid added inventory costs due to spoilage.
The last one embeds design (spec) of 'refrigerate' in the requirement (req) of avoid spoilage (arguably better than 'avoid cost').