Personal tools
Document Actions
Home / Publications / Annual Survey / 2008 / Analysis of Gender Bias in 2008 Salary Survey
Document Actions

Analysis of Gender Bias in 2008 Salary Survey

By Scott Sehlhorst

[Originally posted at Tyner Blain blog]

A related analysis showed the distribution of total compensation. This article takes a more detailed look at gender differences in compensation.

Graph


Salary Distribution by Product Manager Sex

When splitting the data into compensation for women and men, we see the following:

Graph

The graph shows two things - more men responded than women, and the men that responded to the survey reported higher total compensation than the women. We should not (yet) jump to the conclusion that men statistically tend to earn more than women in product management roles. It may be true, but we have to acknowledge that other factors might influence the data.


Product Manager Compensation and Age

One trend that “feels true” is that older people earn more than younger people. As long as people enter the workforce at roughly the same time, and as long as raises are larger than increases in starting salary, this will hold true. The following chart shows the reported ages of the product managers that responded to the survey:

Graph

This distribution shows that there is a wide range of ages among the population of product managers that reported total compensation data for 2008. Perhaps a higher percentage of the older respondents are male (and with higher salaries that correlate to their ages), explaining the disparity from the first graph.

The next diagram shows product manager compensation versus age. The diagram also shows the sex of each respondent - red “O” symbols for women, and blue “X” symbols for men. We’ve also applied linear regressions to the data - showing the overall trends in compensation versus age. The blue trend lines are for male respondents, the red trend lines are for female respondents.

Graph

The trend lines that are drawn show the linear regression as well as the +/- 95% lines. You can see validation that total compensation does tend to climb with the age of the product managers. The trend lines show that compensation for female product managers is lower than that of male product managers, as a function of the product manager’s age.

Since the trends are so visibly different, we can conclude that even if more older males responded to the survey, it does not really matter - the trend lines show a disparity across the reported age range.


Product Manager Compensation and Experience

While a trend of “the older you are, the more you make” feels accurate (and the data also suggests it), a trend of “the more experience you have, the more you make” also seems logical. When all other things are equal, a more experienced product manager is likely to be more effective than a less experienced product manager. What does the data show?

An older product manager is also likely to have more experience. The following diagram shows age versus experience as reported by product managers in Pragmatic Marketing’s 2008 survey.

Graph

The blue X symbols represent male responses, and the red O symbols depict female responses. There appear to be more responses from experienced product managers than inexperienced product managers - both for men and women. The following diagram shows the frequency of responses by reported experience.

Graph

There are definitely more responses from more experienced product managers. And there are disproportionately more male responses among the more experienced product managers. If compensation correlates strongly to experience, that could explain the distribution variance within the overall population.


Product Manager Compensation Versus Experience

The previous two graphs give us insight into the ages and experience levels of both male and female responses. The following diagram shows the reported total product manager compensation by years of experience.

Graph

There is a visible trend that shows average compensation increasing with years of experience. The grey “+” symbols represent each response (total compensation) at each experience level. There are also green, red, and blue lines showing connecting the average total compensation at each experience level (for everyone, women, and men, respectively).

The disparity seems to be the most pronounced in the 11-15 years of experience range. Zooming in on that data, we see the following:

Graph

There is a clear difference in the compensation levels for male and female product managers having 11-15 years of experience. At other experience levels, the disparity is reduced or reversed. There is also a significant disparity for respondents that reported zero years of experience, albeit with far fewer respondents.


Conclusion

I don’t believe that we can extrapolate from this data to reach crisp conclusions, but we can definitely acknowledge a disparity in the compensation levels reported by respondents to the 2008 survey. Generalization is dangerous, when looking at sampled data - especially when the respondents self-select for participation. Sometimes, that’s the best information we have, however - and it seems reasonable to form suspicions from the data. I suspect that the data does indicate inequality in the compensation of men and women in the product management role. The data does also indicate that product manager compensation increases correlate both with product manager age and experience.


Scott Sehlhorst has been helping companies achieve Software Product Success for more than a decade. Scott consults as a business architect, business analyst, and product manager. He has also worked as a technical consultant, developer, project manager, and program manager. Scott has managed teams from 5 to 50 persons, and has delivered millions of dollars in value to his customers. Contact Scott at scott@tynerblain.com, or join in on the Tyner Blain blog.

Figures

Posted by The Cranky Product Manager at 2009-02-03 12:37 PM
Well, yet another reason for the Cranky Product Manager to be cranky!

*Shaking fist at sky* Pay me MORE you sexist jerks!

age bias article

Posted by Allen Koronkowski at 2009-02-03 12:37 PM
My take on this is there are too many gaps to draw a conclusion (as the author admits). I would be interested to see the average of PMs broken out by age separated by male and female. The other important factors are size of company, type of industry. I have to admit, it's interesting to look at it at a high level like this and it certainly throws a red flag. Is there any historic data to compare to for trends?

Oh, and regardless of the gaps, I will use this to show my boss I'm underpaid :-)

breakout by age

Posted by Scott Sehlhorst at 2009-02-03 01:22 PM
Allen - completely agree.

Take a look at the "Product Manager Compensation by Reported Age" graph. The thick red and blue lines give you the 'average by age for female and male." Those are linear regressions, which removes the noise that you would get by looking at each reported age individually.

I did a similar analysis with 2007 data (but the data was noticeably different). You can get to it by clicking through to the original article on the Tyner Blain blog, then following the links back to previous analyses. I'm not sure if it is kosher for me to include the direct link here.

Gender Bias In Earlier Survey

Posted by Graham Joyce at 2009-02-03 02:58 PM
The earlier survey analysis Scott refers to above is available at www.pragmaticmarketing.com/publications/survey/2006/product-management-glass-ceiling-cracked.

Skillset / College Degrees

Posted by "Marketing" Product Manager at 2009-02-12 01:50 PM
Many product manager positions are _requiring_ that applicants have a Computer Science degree. After speaking with several past colleagues, this is not a hard requirement. However, the trend now is that employers want the product managers to essentially be engineers-in-marketing. This analysis needs to take this into account and would be more interesting with this data. How many times do we need to highlight the gender gap? Been there, read that. Let's move on. It is now about the education gap (IMO).

Level of technical acumen - good enough?

Posted by Scott Sehlhorst at 2009-02-12 02:51 PM
Thanks "M" PM. The survey data includes self-reported level of technical acumen (very, somewhat, not at all), but not "do you have a CS degree." Would that provide sufficient information to gain some insight? Or is that too nebulous to be worth crunching the numbers?

Degrees

Posted by A New product manager at 2009-02-12 06:40 PM
Perhaps collecting more information on college degrees would be helpful. I am a new product manager (<1 year exp), older (rather not say how much), but with a higher salary because of an advanced degree, (and female). So, there's not a CS degree, but there is an advanced degree that is relevant to the industry in which I work and which absolutely effects the amount which the company pays.

Statistical Significance

Posted by Scott Sehlhorst at 2009-02-19 05:08 PM
I think these are great points. Each year, more people respond to Pragmatic Marketing's survey, allowing analysis in finer grained detail without sacrificing statistical significance. This year, for example, I was able to ignore executive/director compensation and focus just on product managers. The data is still pretty sparse when looking by state, for example.

As the data size continues to grow, more of these dimensional analyses can be performed.

Compensation components

Posted by Don at 2009-02-12 06:41 PM
Hi,

I'd like to see in this or future studies the breakout of compensation to areas such as:
- Base salary
- Bonus
- Profit sharing
- Stock options and option types
- Bonus tied to product / product-line profit and revenues
- Other compensation components (beyond the little perks or benefits)


Thanks,


DAO

Other Slices

Posted by Scott Sehlhorst at 2009-02-19 05:08 PM
Thanks, Don. Pragmatic Marketing's survey actually does break out base salary versus bonus information (and I believe equity compensation). I personally felt that evaluating the bottom line (total compensation) provided more insight by "leveling the playing field" than it obscured by introducing additional variables.

How would you compare $100K salary plus $10K bonus with $90K salary plus $20K bonus with $110K total compensation? Which is better and why? If you could help me understand the benefit of having the additional information, it would help me provide more valuable analyses in the future.

Thanks!

Recessionary Advantage

Posted by ARTinHMB at 2009-02-19 04:46 PM
As a more "seasoned" worker with 10 years experience as a PM, I understand that there is still a glass ceiling, and a definite bias towards MBA's. HOWEVER, in these recessionary times, it may be useful to understand that a well qualified PM can be had for possibly less drain on the corporate coffers if the PM is female. Not fair, and not something that can be stated in the open, but it is "out there".
Food for thought...

Intentional Discrimination

Posted by Scott Sehlhorst at 2009-02-19 05:08 PM
Thanks Art, and while that may be true, if I ever found out that someone I worked with or for behaved in that way, I would leave. I'd be less tolerant of someone who worked for me and took advantage of (or perpetuated) this sort of inequity.