Engineering Science - Graduate School

PhD retraining program

2009-08-20T15:40:00Z

Did your graduate program not provide you with useful skills beyond what you needed to write your dissertation? MIT can help! A piece in today's NY Times describes MIT's Career Re-engineering program for scientists and engineers.

There's definitely a need for this kind of training - people's careers and interests often evolve far from their educational background. It will be interesting to see if any other universities follow suit. One benefit: a lot of the ideas could be incorporated into graduate and postdoc programs from the get go.

NRC rankings are getting closer...

2009-07-10T16:52:00Z

The methodology report for the forthcoming NRC rankings is out. It's an interesting approach to ranking programs, but it's complicated. For those without a statistics background, I'm sure it's conceptually pretty weird.

In the short term, the NRC rankings have two weaknesses: first, they're quite late, and second, the algorithm takes a fair amount of work to wrap your head around (and I say this as a math PhD with a reasonable stats background). Most of the reactions I've seen to date harp on precisely those two things.

With a longer view, however, things may be different. In the best case scenario, people will eventually figure out the mechanism - maybe it will even serve to educate people about the many benefits of resampling. If that happens, US News-style rankings may come out looking like gross oversimplifications. Also, a lot of the reason for the delays is that this type of approach has never been used before. In a repeat of the process, the NRC won't have to go through the exercise of generating importance weights, which surely was much of the work involved. We shall see.

In the meantime, this quote from the Chronicle stood out:

In an interview this afternoon, Jeremiah P. Ostriker, a professor of astrophysical sciences at Princeton University and the chair of the committee that oversees the doctoral-assessment project, said that he does not expect the report to be released during the next several weeks, but that he would be surprised if it is not released by the end of 2009.

Ouch!

Rankings Ruckus at Clemson

2009-06-05T01:30:00Z

A former Clemson institutional researcher has just given an eye-opening presentation that described how the US News college rankings drove the agenda of Clemson's administration. The measures taken ranged from promising (decreases in class sizes and increases in admissions standards) to unethical (allegations that employees lowballed other institutions in US News's reputational surveys).

Take a look

Regardless of the steps taken, it's crazy that a magazine has such sway over a university. Judging from the comments, Clemson is by no means alone - they're just more up front about what they are doing.

Preventing this kind of gaming is one of the reasons we set up the phds.org rankings the way we did. Allowing people to set their own weights for different criteria and using outcome measures rather than focusing primarily on input measures makes it much harder to game the system.

Lab Safety?

2009-05-25T20:34:00Z

There's an interesting piece in Slate this week about lab safety (or the lack thereof) in academic settings relative to their corporate counterparts. The author may be familiar to some - Beryl Lieff Benderly writes for Science's Next Wave.

The article describes an awful chem lab accident at UCLA and then goes on to point out that non-employees (i.e. grad students and postdocs) don't fall under the workplace safety laws that cover corporate labs. The article claims that the safety standards in academic labs are quite poor, and many in the discussion forum concur.

Lab safety sounds like yet another good reason to classify postdocs as employees rather than leaving them in their current murky state.

"End the University as We Know It"

2009-04-28T02:46:00Z

There's an op-ed in yesterday's Times with a great opening paragraph:

Graduate education is the Detroit of higher learning. Most graduate programs in American universities produce a product for which there is no market (candidates for teaching positions that do not exist) and develop skills for which there is diminishing demand (research in subfields within subfields and publication in journals read by no one other than a few like-minded colleagues), all at a rapidly rising cost (sometimes well over $100,000 in student loans).

Unfortunately, it's long on suggestions for good places to be and short on ideas about how to get there. For example, item 6: "Impose mandatory retirement and abolish tenure." Who's supposed to do the abolishing? Tenured faculty? That seems unlikely. And I'm not sure that mandatory retirement is legal given anti-age discrimination laws.

"A Bad Reputation: Why are more and more graduate students turning away from careers at research universities?"

2009-01-27T16:31:00Z

Mary Ann Mason and Marc Goulden have conducted a recent study of University of California graduate students. Mason's assessment in The Chronicle: "We may be losing some of the most talented potential academics before they even arrive for a job interview. In the eyes of many doctoral students, the research university has a bad reputation — one of unrelenting work hours that allow little room for a satisfying family life."

The big problem is the hours and difficulty balancing work and family responsibilities:

The number of young women who want to pursue careers in academic research declines by 30 percent over the course of their doctoral study, and the number of men by 20 percent. In explaining their decision, men are more likely to report that they do not like unrelenting work hours. One male student in the survey complained that he was "fed up with the narrow-mindedness of supposedly intelligent people who are largely workaholic and expect others to be so as well." But most women give up on academic-research careers for family concerns. As one woman in the survey said, "I could not have come to graduate school more motivated to be a research-oriented professor. Now I feel that can only be a career possibility if I am willing to sacrifice having children."

While Mason expresses a great deal of concern about the findings, I'm not so sure it's a bad thing. There are strong cultural biases in academia that push graduate students to consider academic careers at research universities to the exclusion of all other options. The result is that few people prepare effectively for anything else, and poor preparation for the outside world combined with high ratios of aspirants to positions results in career train wrecks for a lot of people. Academic careers are no panacea - the hours are long, the pay mediocre, and in most cases one has little control over where one lives and works.

While the outcome that Mason advocates - having universities become more accommodating of families - would certainly be a good thing, an even better thing would be more students moving to productive and satisfying careers in other sectors.

So graduate school is good for what, exactly?

2008-07-16T16:37:00Z

A new TIAA-CREF survey of junior faculty at Master's granting colleges shows that alarmingly low numbers feel prepared for their jobs at the time of hiring.

The interesting bit is Table 7, "Level of preparation for career responsibilities"

After graduate school, % "very effectively" prepared:

Conduct research: 33%

Teach undergraduates: 31%

Obtain grants: 7%

After about 5 years on the job, higher percentages report that they are working "very effectively":

Conduct research: 46%

Teach undergraduates: 76%

Obtain grants: 14%

So what exactly are graduate programs training people to do?

The comments from faculty members on the Chronicle's story show why the problem exists - basically the attitude seems to be, "Preparing students is not our responsibility," and "Back when I was in graduate school, they didn't prepare *me*"

Poor attitudes aside, there is the further difficulty that many faculty members are likely not able to train students effectively to teach, write grants, etc, because they themselves don't do a particularly good job at such tasks, having not received much in the way of training / mentoring.

These survey results really underscore the importance of programs like Preparing Future Faculty that allow institutions and enterprising students to bypass recalcitrant professors.

Privacy paranoia at NSF?

2008-05-03T16:48:00Z

Inside Higher Ed has an article with Orwellian-sounding overtones: Data on Minority Doctorates Suppressed. The gist of it is that NSF has tightened up its privacy rules and will no longer be reporting information on the ethnicity of doctorates when the cell size is 5 or smaller.

The trouble is that basic reporting on the demographics of small fields runs up against the new rules, particularly for groups such as Native Americans:

So while we know that in 2005, six black people earned doctorates in earth, atmospheric and marine sciences, the NSF won’t reveal how many earned the degrees in 2006 (covered by the most recent report). Information about the number of Latinos earning degrees in some engineering fields is gone, as are data about a number of categories for black Ph.D.’s. For Native Americans, where the base is smaller, the impact of the new policy is especially dramatic. The report was stripped of information on how many doctorates were awarded to all but 6 of the 35 subfields for which data were collected.

Commenters on the story are aghast, and some rail about Bush administration-style information suppression going on in the NSF. I don't think the motives are quite so sinister. But I am wondering if I might be partly responsible for the changes.

In late 2006 I requested a big batch of Survey of Earned Doctorates data from NSF for the Graduate School Guide. It was expensive and a pain to get, largely because the existing privacy rules blocked access to lots of interesting things, but eventually I managed to get the numbers. The one thing I had no trouble getting was information on PhD demographics. Sex, ethnicity, and citizenship were considered public information, and no cell size restrictions applied. (It's not clear from the article whether the tightening applies only to ethnicity or to sex and citizenship as well, but I'd assume everything.)

Apparently nobody had ever requested institution and discipline-level data before. Although my request was approved, I heard through the grapevine afterwards that the data set caused great consternation within NSF and provoked lots of meetings and arguments. I asked for some additional data later on, but never got an answer.

I suspect that at least part of what happened was that NSF decided after the fact that they were uncomfortable with some of the information they gave me, but that they had no rules in place at the time to prevent the request. I'm speculating that the tightening (at least in part) is to address the perceived problem. If so, I'd be curious to hear what else has been changed.

NSF has an important responsibility to protect the privacy of the people who participate in the Survey of Earned Doctorates. They are asking for data from individuals, and they want to make sure that those participating never have reason to be concerned about their information being released inappropriately. The NSF does a very good job of protecting the privacy of those participating - the rules for data access are quite draconian.

The trouble is that the NSF protects their information so zealously that, at least in my opinion, they compromise the larger mission of their organization. Suppressing things like the number of Native American geophysics PhDs granted is just silly. In what possible way does that reveal anything interesting about any individual? (The only thing I can think of is that you might be able to learn whether a particular individual participated. But you could learn the same thing for cell sizes larger than 5 when there is full participation by the subgroup.)

Computer security professionals have a maxim that the only truly secure computer is one that is off. Some of the new privacy changes sound like a step in the direction of pulling the plug to prevent software viruses.

A more productive approach would be to modify the terms of the survey's privacy policy to favor greater data access, not less. Sure, they might lose a handful of responses from the truly paranoid, but my guess is that people who are that concerned about their privacy aren't going to fill out the survey anyway. Greater access could allow some NSF to do some truly useful things with their data.

There is some good news for any of you who are interested in PhD demographics: there is a better place to get the data. The IPEDS data set contains complete information on the demographics of doctorates, with no data suppression. What's more, IPEDS also has data on master's students and on undergraduates, their data are not limited to science and engineering, they have a much more detailed taxonomy of disciplines than NSF, and they make their data available at the institution rather than the national level. IPEDS data are much more timely than NSF's. And, best of all, you can get the full data set without having to pay NORC lots of money. The NSF may have just done you a big favor.

PE for grad students, part 2

2008-04-24T02:46:00Z

This month's Wired has more on the exercise/cognitive function connection : aerobic exercise helps, weight lifting doesn't.

They also have a rundown on drugs that allegedly enhance cognitive functioning, handy for any who are thinking about emulating the 20% of scientists admitting to using brain-boosting drugs in a recent, informal survey in Nature.

The drugs have questionable efficacy, are expensive, and have nasty side effects (which Wired details - my favorite, for methamphetamines: "Prison"). Exercise, in contrast, works well, is free, and is beneficial pretty much all around. Forget the drugs - put on some sneakers and go run.

PE for grad students?

2008-04-22T14:17:00Z

Do the following strike you as things that graduate students or postdocs excel at?

make plans

keep track of time

keep track of more than one thing at once

meaningfully include past knowledge in discussions

engage in group dynamics

evaluate ideas

reflect on our work

change our minds and make mid-course and corrections while thinking, reading and writing

finish work on time

ask for help

wait to speak until we're called on

seek more information when we need it.

For many of these items, particularly the ones relating to planning and time management, my experience has been that these are things at which grad students and postdocs are particularly bad. And they're all important to career success. These kinds of activities are aspects of a broad measure of cognitive capability called "executive function" (the list was taken from here ).

I just saw a fascinating talk at Google by John Medina on his book, Brain Rules. The book is a summary of findings from neuroscience that are relevant to everyday life. In the first half of the talk Medina examines the relationship between exercise and cognitive function. Short summary: modest amounts of aerobic exercise (~20 minutes 3-4 times per week) have a big, quantifiable effect on executive function. It also helps prevent and treat depression, a condition to which grad students are especially prone.

One interesting implication is that exercise is an important component of education. Perhaps graduate programs should incorporate a mandatory PE requirement? At the very least, smart institutions should be making sure their grad students and postdocs have access to the gym, and they should encourage physical activity through things like intramural sports leagues for grads/postdocs. Students and their advisors shouldn't view exercise as time away from the bench, but rather as an investment in higher quality output.

Check out the talk.

Graduate Education at Stanford

2008-04-16T02:41:00Z

Mark Horowitz, Associate Vice Provost for Graduate Education at Stanford, gave a talk at Google a few weeks ago about some of the things Stanford is working on to enhance the quality of its graduate programs. After many years (a decade or more?) of having no senior leadership with responsibility for graduate education at the university level, Stanford has finally created an office of graduate education. Mark's talk was an overview of the initiatives coming out of the new office.

Stanford's new activity in graduate education is based on an internal report. The basic thrusts are

more interdisciplinary education,
greater diversity, and
leadership training.

These are all fairly standard ideas, but a few things struck me about Stanford's approach.

Stanford has a ridiculous amount of financial resources. It appears that the university is backing this initiative wholeheartedly. This is not just a few seminars cobbled together by an underfunded graduate or postdoc office - it looks like the real deal.
Stanford has amazing courses throughout the institution, but usually access to courses in one department is limited to students in that department. The new Office is doing the smart thing of trying to better leverage existing resources. To give a sense of how serious the university is about this, they are talking about things like moving the Law School from a semester to a quarter system (maybe the other way around? this is from memory) so that students outside the Law School can more easily take graduate courses and vice versa.
One problem people have with taking classes outside their department is that it's hard to find appropriate classes in other fields because there are so many classes out there. The catalog is paper based (!) and there is not much descriptive material on courses. Stanford has set up a web site called CourseRank, which is an exercise in using collaborative filtering to help students find relevant courses outside their departments. I suspect that CourseRank may be an exercise in trying to set up a social networking site for the sake of cool points, but the idea seems sound. One lower tech and much cheaper way to accomplish some of the same goals would be to do some basic mining of data from the registrar. Looking at past cross-disciplinary enrollments would be a simple way to provide students with suggestions for possible good courses to take outside their departments.
Stanford is setting up career development as formal classes during the summer and before fall quarter (the Stanford Graduate Summer Institute ). Students have to apply, and in some cases pay a fee. Having an application process is smart - it makes the course into a desirable thing that you have to compete for rather than a freebie extra thing that people have to be dragged to. The fee accomplishes the same purpose, plus provides resources to sustain the effort.
Career development workshops are being pitched as "leadership training". It's the same thing, but "leadership" is much sexier and probably easier to sell. I suspect that because of the word's additional usage as "leader in a field", "leadership" has positive connotations even for the most unreconstructed students-must-always-be-at-the-bench faculty.
Stanford is trying to set up mentors for students outside of the regular faculty advisors. The vision appears to be pairing students with area professionals, e.g. people at dot-coms, biotechs, etc. Definitely a good way to provide some guidance that many faculty are ill-equipped to do.

All in all a good effort. It's especially promising because places like Stanford tend to inspire places that want to be like Stanford. I'm looking forward to seeing the results and to seeing other universities try to follow in their footsteps.

Graduate School Guidance

2008-02-06T02:09:00Z

One key data set I used in building the Graduate School Guide was IPEDS, which is put out by the Department of Education's National Center for Education Statistics. IPEDS is incredibly useful for this kind of thing: the data set contains a near-complete list of all colleges and universities in the country together with detailed information about student enrollments and degrees granted. The data are well-documented, easy to access (you can download everything in CSV files or grab custom subsets of the data from an online tool), and relatively recent (2006).

NCES delivers tremendous value with IPEDS in several ways:

1) They provide a lot of summary statistics from the data to give an overview the current state of post-secondary education.

2) They make it easy for others to get ahold of the data, and they provide thorough documentation so that once you have the data, it's easy to work with. As a result, third parties such as The Chronicle of Higher Education delve more deeply into the data and deliver additional interesting insights.

3) They help participating institutions use the data set to compare themselves to peer institutions. In so doing, they implicitly give guidance on good questions for institutions to ask about themselves (e.g. how much financial aid do we give relative to our peers? how well do we retain students?)

4) They provide data to third parties who help students choose colleges. It's virtually certain that US News, Peterson's, Fiske, etc, all draw upon IPEDS data.

5) They run College Opportunities OnLine, a site that provides useful information directly to prospective college students.

6) They combine multiple data sets in ways that increase the value of all the components. For example, on the COOL web site they combine their core data on universities and graduations with data on libraries and on campus crime.

The NSF has similarly interesting sets of data in their Survey of Earned Doctorates, Survey of Doctorate Recipients, and the Survey of Graduate Students and Postdoctorates in Science and Engineering, but they have not been anywhere near as effective at extracting value from them.

Here's how NSF stacks up to NCES:

1) The NSF provides data reports in the form of very basic, annual (or bi-annual) summary statistics and in Science and Engineering Indicators.

2) NSF has a decent tool for extracting additional summary statistics in WebCaspar. Unfortunately, the data are aggregated at such a high level (nationally for most things), that you can't get at the most interesting information. Basically you can't get anything beyond a count of individuals at the level of a single institution.

It is possible to get ahold of more detailed data than what's in WebCaspar, but the process is difficult, expensive, and time-consuming. The data we used on our site cost $7,000 and took months for NORC to generate. There is a do-it-yourself alternative if you have a facility that satisfies NSF's security criteria (stringent), can handle NSF's audits, and have a license for SAS (expensive).

NSF has a responsibility to protect the privacy of survey participants, and to their credit, they take that responsibility very seriously. However, I think they tend to err so far on the side of caution that they detract from their own mission.

3) As far as I know, NSF doesn't make any effort to help universities use the data they generate in useful ways. I think this is an area in which NSF could take a real leadership role. For example, people have been expressing dismay for years about the length of time it takes to earn a PhD. The NSF has detailed data on exactly how long it has taken to earn pretty much every single PhD in the country. Providing institutions with stats on their own times to degree relative to their peers could be a powerful catalyst for inspiring improvements. They could provide similar motivation on placement rates, funding levels, and so on.

The value the NSF could provide here is not just in providing the data - it's in getting institutions to ask the right questions of themselves. I have talked to several deans who participated in the recent CGS study of attrition. One common thread I have heard is that they were able to make progress on reducing their attrition rates - the big problem they had was that nobody had ever looked at the issue before.

4) People love to hate US News's rankings. The chief complaint is the exclusive reliance on reputation. There has been sporadic talk over the years about institutions proposing alternatives, but the talk has never amounted to anything. As we have demonstrated here at phds.org, NSF's data can form part of a more balanced approach. Surely a set of US News rankings that incorporated outcome measures as well as reputational measures would be more helpful to students and less objectionable to faculty members than their current approach.

5) As far as I know, NSF does not use their data to provide any services targeted at prospective graduate students. I think that's a reasonable call on their part, since I don't think it's a great fit for the skill set that the organization possesses. However, if they were to make department level data sets available (aggregated over sufficient numbers of years to protect privacy) on a regular basis to third parties such as US News, Peterson's, phds.org, etc, they could ensure that would-be students would benefit from the NSF's hard work.

6) As graduate-school.phds.org demonstrates, the NSF data sets are much more interesting when combined. One frustration I had in working with the NSF's data sets is that they are not designed to work well with each other or with outside data such as IPEDS, so combining them took months of work.

Each of NSF's data sets uses a different, incompatible taxonomy of disciplines, all of which are different from the one used by IPEDS. The NSF uses an outdated list of institutions (FICE codes) that results in information for entire state university systems being lumped together and makes it difficult to combine with information from IPEDS, which uses an up-to-date list. Rethinking the NSF's field codes and updating their institution lists would make their data more valuable to end users and would simplify the lives of the people at the institutions who have to answer both NSF and NCES surveys.

So here's what I think NSF could do to remedy things:

Take a leadership role in defining metrics of interest, and provide institutions with summary statistics about their own performance relative to their peers.
Rework their various classification schemes so that their data is easy to combine and compatible with outside data.
Provide better quality control over department-supplied self-classifications and consider ways to handle multidisciplinary departments (e.g. a department of Mathematics and Statistics)
Build a list of departments and strive to provide department-level data when practical.
Release regular department-level data sets (aggregated over multiple years and suppressed as needed to protect participant privacy) for use by third parties.

I think the result would be universities receiving information they can use to make valuable improvements to their programs and prospective students getting better guidance on choosing suitable programs. That's a pretty big impact.

Meanwhile in the Senate...

2007-05-10T16:24:00Z

I've just taken a look at the Senate's hefty bill to reauthorize the NSF, S 761. Like the House equivalent, there are some good and interesting things in the bill.

There is a lot of new money for graduate fellowships:

IGERT - Increased funding to the IGERT program, like in the House bill. This would fund provide funding for more graduate students, but IGERT programs appear to be much better suited to providing people with more of a range of career options than traditional PhD programs. The stipends, which are semi-portable traineeships rather research assistantships, are pretty hefty, too. $30K/year is more than some postdocs are paid - perhaps it will stimulate some upward growth in S&E graduate stipends overall.

The Senate's numbers are a lot lower than the House numbers - $22M/year in 2008 to $55M/year in 2011 (as opposed to ~$75M-$150M/year for the House). Since there was pushback from the administration on the way the House was proposing to fund IGERT (as a fixed percentage of the NSF's budget), I imagine something more like the Senate's version will go through.

Graduate fellowships - The Senate bill also allocates a good chunk of money for new old-style fellowships, ranging from $24M/year in 2008 to $60M/year in 2011. The House bill doesn't provide any new money for fellowships apart from the overall budget doubling.

DOE graduate fellowships - $9M/year-$35M/year in fellowships for "students pursuing a doctoral degree in a mission area of the Department [of Energy" - energy and nukes, presumably.

So altogether the Senate is proposing increased funding for graduate fellowships in the amount of $140M by 2011, which translates to about 2,800 new doctoral students per year.

A little digging in WebCASPAR shows that NSF funds about 20,000 full-time graduate students (about 5% of all full-time graduate students). If we make the assumption that the NSF funds primarily doctoral students and that NSF funding is spread over 5 years, we find that NSF funds on the order of 4,000 doctoral students/year.

So the combination of a budget doubling plus the new fellowships, if allocations are held constant, would increase NSF-funded doctoral students by about 4,000+2,800 = 6,800. This estimate is probably on the high side, since IGERT stipends are pretty high, some NSF funding probably goes to master's students, and the new money for fellowships may result in reallocations of other funds away from graduate fellowships; let's say there will be 5,000 new NSF-funded doctoral students per year. In 2005 there were 29,000 S&E PhDs granted, 13,000 of which were in the physical sciences and engineering. NSF's funding is concentrated in the physical sciences and engineering - NSF's existing 4,000 or so fellowships combined with 5,000 new ones would mean that NSF could end up funding most doctorate recipients in those fields.

Will this increase the number of doctorates granted per year? Maybe - Richard Freeman has some interesting work that suggests so - but perhaps not by 5,000. Once a department has its teaching needs covered, the incentive to enroll graduate students is reduced. New money from NSF frees up existing departmental funds that pay TAs for other purposes. Labs will be staffing up once new NSF grants start flowing, and I'd bet that they'll want to hire postdocs, not graduate students. I predict an increase in the total number of postdocs in many math and physical sciences fields. In fields, like CS and engineering, in which most people go to industry after graduating, postdocs will probably be harder to come by, so they'll end up with more grad students.

There is a modest amount of money to fund Professional Science Master's degree programs.

Professional Science Master's programs were created by grants from the Sloan Foundation back in 1997. I have met several people who have been through PSM programs, and they sound great - they're essentially hybrid-MBA/science degrees. If the country needs more scientists to spur economic growth, this is a great way to get them. The programs graduate people who know enough science to do useful things in theory, but who also know enough about navigating companies to actually accomplish things in practice.

I'm very encouraged to see the possibility of the NSF picking up PSM funding. Once institutions get into the business of bringing real, professional skills into science curricula, it's only a matter of time before the ideas diffuse into more mainstream science programs. There's nothing in the House bill about PSM programs, so I think this is iffy, but since the amount of money is modest ($9M/year in 2008 to $20M in 2011), I'm hoping it will pass.

There is a ton of additional material in both the Senate and the House bills about teacher training. More on that in a future post.

More Graduate Students - Brought to You by IGERT

2007-04-26T20:31:00Z

The increase in graduate students discussed earlier in the week just came a step closer to reality: the House and Senate just passed a set of bills that will steer a big chunk of funding toward new graduate fellowships, among other things. I assume there will be some negotiation in conference over the final form, but the boost to graduate numbers is a lot closer to reality.

One caveat: the bills just authorize increased spending, but they don't actually provide it. So there is room for things to be cut by failing to be funded in appropriations bills.

I have started looking through a few of the bills, and as best I can tell, there is some interesting and good stuff in them. There are also some things that are disappointingly omitted. As with HR 1453, the bills smack of AAAS Fellow influence - hats off to any of you who are reading this.

The House passed 3 bills:

HR 1867, the National Science Foundation Authorization Act of 2007, which doubles the NSF budget,
HR 363, the Sowing the Seeds Through Science and Engineering Research Act, which funds a bunch of undergraduate and graduate fellowships, and
HR 362, the 10,000 Teachers, 10 Million Minds Science and Math Scholarship Act, which funds S&E teacher training.

The Senate passed a single, 200+ page bill, S 761, the America Competes Act (more formally, the America Creating Opportunities to Meaningfully Promote Excellence in Technology, Education, and Science Act).

I've just started looking into these, and I imagine they'll take a few posts to digest.

HR 363 is the House bill most relevant to grad students. It passed 397 to 20, so at least some portion of it seems pretty likely to happen. Doubling the NSF budget will likely increase spending on grad students as well, but probably not in ways qualitatively different from current expenditures.

I notice in GovTrack that authorization for funds has been stripped out of the bill. So I'd guess that it will be funded at a lower level than the bill calls for.

Section 4 of the bill is the interesting bit:

SEC. 4. INTEGRATIVE GRADUATE EDUCATION AND RESEARCH TRAINEESHIP PROGRAM.

(a) Funding- For each of the fiscal years 2008 through 2012, the Director of the National Science Foundation shall allocate at least 1.5 percent of funds appropriated for Research and Related Activities to the Integrative Graduate Education and Research Traineeship program.

(b) Coordination- The Director shall coordinate with Federal departments and agencies, as appropriate, to expand the interdisciplinary nature of the Integrative Graduate Education and Research Traineeship program.

(c) Authority to Accept Funds From Other Agencies- The Director is authorized to accept funds from other Federal departments and agencies to carry out the Integrative Graduate Education and Research Traineeship program.

I'm disappointed that there are no provisions for measuring efficacy or for linking expenditures to the state of the labor market, so it ends up being a command-and-control type of program (like most of the rest of science, alas). That being said, funding IGERT rather than more traditional NSF fellowships seems like a promising way to go.

The good thing about IGERT (from the IGERT FAQ):

"A major objective of NSF's IGERT program is to train students in areas where industry, government and academic institutions are experiencing a shortfall. IGERT graduates may work in industries ranging from pharmaceutics to petrochemicals, government laboratories devoted to health, commerce or energy, small teaching colleges and major research universities. An important benefit of the IGERT programs is that most students have opportunities to sample these locations during their training. This makes it easier to decide which career environment is right for you."

So IGERT is not about creating a bunch of new professors.

Another good thing about IGERT he IGERT money goes to traineeships rather than research assistantships. The funding is not as portable as what Romer was calling for, but funding tied to the department is a lot more portable than funding tied to a researcher. I think it's a reasonable compromise between full portability and the increasingly common no portability.

(An aside: There have been a number of National Academy reports that have called for more portable funding, but they always seem to get shot down. I've spoken to some National Science Board members about the issue, and the story I have gotten from them is that they are terrified that given full portability, students will all end up at some program other than their own. This discussion gives a sense of the "debate." It's total BS - people say they don't want more portability because it might screw up the wonderful system we have now. But there is no analogous concern raised when funding shifts away from portability as it has steadily for the last couple of decades. Moreover, they complain about the lack of data documenting benefits of portability, but they never actually try running any experiments to gather any. It's not rocket science. In fact, there is actually a lot of data available in the SED and the SDR that would let one compare career outcomes for people funded by portable vs. non-portable funding, but nobody has bothered to run the stats. As best I can tell, nobody wants to know.)

The less good thing is that IGERT seems to emphasize interdisciplinarity for its own sake. Googling "IGERT" turns up some goofy sounding programs - "Interactive Digital Multimedia" at UC Santa Barbara (you can get a PhD in that?), "Biological Invasions"(!) at UC Davis, and so on. But plenty of sensible things, too.

IGERT seems to be about creating new programs, too, but maybe I'm just not understanding correctly. I'd be happier if there were provisions for existing programs getting their acts together in terms of providing professional development for their students, but maybe IGERT would lead to some diffusion.

It's interesting that the bill steers a fixed fraction of the NSF's budget toward IGERT rather than a specific amount. I'm guessing that's so that IGERT would benefit proportionally if the NSF budget is doubled and so that there isn't some convenient dollar amount to target once appropriations committees take their knives to the bill? 1.5% of a $5 billion dollar budget is $75 million. IGERT currently gets about $12 million / year, so that's a hefty boost. And $150 million if the NSF's budget doubles.

IGERT students get $30K stipends (more than NSF gave their postdocs back in my day, stingy things), plus tuition (call it $20K) plus maybe some overhead for health insurance, etc (say $10K). Probably there is some faculty and institutional money in IGERT (after all, creating new programs isn't cheap). So let's say half the money goes to students at $60K apiece. $75 million buys you a grand total of ... 625 students. And 100 of those were already funded. Even doubled, we're talking a not very large number of people. Romer's proposal is for an extra 17,000 new PhDs per year, so this is a tiny fraction of what he's talking about.

The administration has indicated that they don't like the idea of having a fixed fraction of the NSF's budget allocated to a particular program (because the other 98.5% just isn't enough). I assume this is because of pushback from senior people who don't like the idea of either portable funding or their pot of grant money being diminished - similar complaints were heard during the NIH doubling.

More Graduate Students?

2007-04-24T16:52:00Z

There have been a few bills working their way through Congress that seek to significantly increase the number of graduate students. Why now, at a time when people are asking, "Are we training too many PhDs?"

Much of the current impetus comes from the National Academies report, Rising Above the Gathering Storm -- the bills in question also address other Gathering Storm recommendations -- so the question becomes, where did the Gathering Storm report get the idea? Because the report was put together in very short order (10 weeks), the idea almost certainly came from elsewhere.

I recently dug up a 2000 working paper by Stanford economist Paul Romer that I think may contain the seeds of the current push to increase the ranks of graduate students. Here is a good piece on Romer's efforts to get Congress to implement some of his ideas. Romer is a smart guy, and while I'm not convinced by everything he says in the paper, it's a very interesting piece of work.

S&E research has been linked to overall economic growth. The question Romer addresses in the paper is that of, "What is the best way to increase the amount of science and engineering research done in the US?"

Several federal programs try to stimulate research activity by bolstering demand. Romer argues that there are 2 problems with a demand-side approach. First, demand subsidies don't necessarily increase the overall amount of research done. Unless the supply of researchers increases in response to demand, demand subsidies will just push wages up. Second, structural features of universities cause the supply of researchers to fail to respond to demand. This second point is the crux of the paper: because demand doesn't trigger increased supply, Romer argues that the government needs to subsidize supply instead of demand by creating large numbers of new graduate fellowships.

Romer discusses 2 reasons for the decoupling of S&E supply from demand:

First, S&E graduate programs provide no information on outcomes or salaries for their graduates, which prevents prospective students from being able to respond to demand signals in their enrollment choices:

"The lack of information that is available to students who are making decisions about careers in science and technology suggests that our existing educational institutions may not lead to the kind of equilibration that we take for granted in many other contexts. If students do not have information about what wages will be, it will be much harder for them to adjust their career decisions in response to wage changes."

Romer did an experiment in which he had an graduate assistant start the application process at the top 10 programs in business, law, and 6 different S&E fields. The assistant requested information on recent graduates' salaries from all programs, and got information from 80% of the business schools, 70% of the law schools and 0% of the 60 S&E programs. This problem seems straightforward to remedy - the Graduate School Guide provides some program level outcome information (but no salary information yet). The NSF is currently experimenting with a salary question on the Survey of Earned Doctorates, and should the test prove successful, it should be straightforward to assemble program-level post-graduation salary information.

Second, the response of competitive undergraduate institutions to increases in demand for S&E's is interesting. Elite liberal arts colleges gain prestige by being very selective. Suppose undergraduates respond to increases in demand for S&E's by enrolling in more classes that will prepare them for S&E careers. One response might be to hire more S&E faculty and to accept more S&E undergraduates. That's expensive and risky (if demand decreases, universities are stuck with excess faculty and facilities) and reduces selectivity. A simpler, alternative response:

"A liberal arts university that has a fixed investment in faculty who teach in areas outside of the sciences and that faces internal pressure to maintain the relative sizes of different departments may respond to this pressure by making it more difficult for students to complete a degree in science. Faculty in the departments that teach the basic science courses will be happy to 'keep professional standards high' and thereby keep teaching loads down. Faculty in other departments will be happy to make study in their departments more attractive, for example by inflating the average grade given in their courses. There is clear evidence that this kind of response currently operates on campuses in the United States."

So part of the reason that relatively few Americans pursue S&E careers may be the incentives under which universities operate.

Romer argues that immigration has provided a way around this undergraduate bottleneck and that S&E immigration levels have been much more responsive to changes in demand than domestic supply.

As an alternative to increasing reliance on foreign-born S&Es, Romer proposes creating large subsidies for both undergraduates and graduate students pursuing S&E degrees. These appear to be what we are seeing in current bills to increase the number of S&Es.

The details of his proposed subsidies are interesting, and it's worth looking into whether the current bills capture some of Romer's key points. More later in the week.