You and Your Research - PowerPoint Presentation

Slide1

You and Your Research

Slides Made Based on Richard W. Hamming’s Talk Transcription @http://www.cs.virginia.edu/~robins/YouAndYourResearch.html

Tao Xie

University of Illinois at Urbana-Champaign

taoxie@illinois.edu

http://www.cs.illinois.edu/homes/taoxie/Slide2

Luck

Characteristic of great scientists: “usually when they were young they had independent thoughts and had the courage to pursue them””Luck favors the prepared mind.” - Pasteur “If others would think as hard as I did, then they would get similar results

.” - Newton “Is it luck that [Einstein] finally created special relativity? Early on, he had laid down some of the pieces by thinking of the fragments. Now that's the necessary but not sufficient condition. All of these items I will talk about are both luck and not luck.”Slide3

Courage

Characteristic of great scientists: “having courage”“Once you get your courage up and believe that you can do important problems, then you can. If you think you can't, almost surely you are not going to.”“They will go forward under incredible circumstances; they think and continue to think

.”Slide4

Age

“They always are saying that you have got to do it when you are young or you will never do it. ”“ In the first place if you do some good work you will find yourself on all kinds of committees and unable to do any more work.”

“When you are famous it is hard to work on small problems.”Slide5

Working Conditions

“What most people think are the best working conditions, are not. Very clearly they are not because people are often most productive when working conditions are bad.”“I finally said to myself, ``Hamming, you think the machines can do practically everything. Why can't you make them write programs?'' What appeared at first to me as a defect forced me into automatic programming very early. What appears to be a fault, often, by a change of viewpoint, turns out to be one of the greatest assets you can have. But you are not likely to think that when you first look the thing and say, ``Gee, I'm never going to get enough programmers, so how can I ever do any great programming

?'‘”Slide6

Working Conditions – cont.

“ I think that if you look carefully you will see that often the great scientists, by turning the problem around a bit, changed a defect to an asset. For example, many scientists when they found they couldn't do a problem finally began to study why not. They then turned it around the other way and said, ``But of course, this is what it is'' and got an important result. So ideal working conditions are very strange. The ones you want aren't always the best ones for you

.”Slide7

Drive

Characteristic of great scientists: “having tremendous drive”“Well I went storming into Bode's

office and said, ``How can anybody my age know as much as John Tukey does?'' He leaned back in his chair, put his hands behind his head, grinned slightly, and said, ``You would be surprised Hamming, how much you would know if you worked as hard as he did that many years.'' I simply slunk out of the office!”``Knowledge and productivity are like compound interest.'' - Bode“Given

two people of approximately the same ability and one person who works

10% more

than the other, the latter will more than twice

outproduce

the former. The more you know, the more you learn; the more you learn, the more you can do; the more you can do, the more the opportunity - it is very much like compound interest

.”Slide8

Drive + “Intelligently Applied”

 ”Genius is 99% perspiration and 1% inspiration.” – Edison“The steady application of effort with a little bit more work, 

intelligently applied is what does it. That's the trouble; drive, misapplied, doesn't get you anywhere.”“The misapplication of effort is a very serious matter. Just hard work is not enough - it must be applied sensibly.”Slide9

Ambiguity

“Most people like to believe something is or is not true. Great scientists tolerate ambiguity very well. They believe the theory enough to go ahead; they doubt it enough to notice the errors and faults so they can step forward and create the new replacement theory. If you believe too much you'll never notice the flaws; if you doubt too much you won't get started. It requires a lovely balance. But most great scientists are well aware of why their theories are true and they are also well aware of some slight misfits which don't quite fit and they don't forget it

.”Slide10

Ambiguity – cont.

“Darwin writes in his autobiography that he found it necessary to write down every piece of evidence which appeared to contradict his beliefs because otherwise they would disappear from his mind. When you find apparent flaws you've got to be sensitive and keep track of those things, and keep an eye out for how they can be explained or how the theory can be changed to fit them. Those are often the great contributions. Great contributions are rarely done by adding another decimal place. It comes down to an emotional commitment. Most great scientists are completely committed to their problem. Those who don't become committed seldom produce outstanding, first-class work

.”Slide11

Emotional Commitment

 Subconscious“Everybody who has studied creativity is driven finally to saying, ``creativity comes out of your subconscious.'' Somehow, suddenly, there it is. It just appears. 

”“If you are deeply immersed and committed to a topic, day after day after day, your subconscious has nothing to do but work on your problem. And so you wake up one morning, or on some afternoon, and there's the answer. ”“ So the way to manage yourself is that when you have a real important problem you don't let anything else get the center of your attention - you keep your thoughts on the problem. Keep your subconscious starved so it has to work

on

your

 problem, so you can sleep peacefully and get the answer in the morning, free

.”Slide12

Work on

Important Problem“What important problems are you working on?”“What are the important problems in [your] field?”

“If what you are doing is not important, and if you don't think it is going to lead to something important, why are you at Bell Labs working on it?”Slide13

Work on Important Problem – cont.

“We didn't work on (1) time travel, (2) teleportation, and (3) antigravity. They are not important problems because we do not have an attack. It's not the consequence that makes a problem important, it is that you have a reasonable attack. That is what makes a problem important. ”“

The average scientist, so far as I can make out, spends almost all his time working on problems which he believes will not be important and he also doesn't believe that they will lead to important problems.”Slide14

Work on Important Problem – cont.

“even if you believe that great science is a matter of luck, you can stand on a mountain top where lightning strikes; you don't have to hide in the valley where you're safe. But the average scientist does routine safe work almost all the time and so he (or she) doesn't produce much. It's that simple. If you want to do great work, you clearly must work on important problems, and you should have an idea.”Slide15

Great Thoughts Time

“When I went to lunch Friday noon, I would only discuss great thoughts after that. By great thoughts I mean ones like: ``What will be the role of computers in all of AT&T?'', ``How will computers change science?'‘”“I saw that computers were transforming science because I spent a lot of time asking ``What will be the impact of computers on science and how can I change it?'' I asked myself, ``How is it going to change Bell Labs

?'‘”“I thought hard about where was my field going, where were the opportunities, and what were the important things to do. Let me go there so there is a chance I can do important things.”Slide16

Ideas for Solving Problems

“Most great scientists know many important problems. They have something between 10 and 20 important problems for which they are looking for an attack. And when they see a new idea come up, one hears them say ``Well that bears on this problem.'' They drop all the other things and get after it.”“

The great scientists, when an opportunity opens up, get after it and they pursue it. They drop all other things. They get rid of other things and they get after an idea because they had already thought the thing through. Their minds are prepared; they see the opportunity and they go after it. Now of course lots of times it doesn't work out, but you don't have to hit many of them to do some great science. It's kind of easy. One of the chief tricks is to live a long time!”Slide17

Open vs. Closed Door

“if you have the door to your office closed, you get more work done today and tomorrow, and you are more productive than most. But 10 years later somehow you don't know quite know what problems are worth working on; all the hard work you do is sort of tangential in importance.”“

He who works with the door open gets all kinds of interruptions, but he also occasionally gets clues as to what the world is and what might be important.”“there is a pretty good correlation between those who work with the doors open and those who ultimately do important things, although people who work with doors closed often work harder. Somehow they seem to work on slightly the wrong thing - not much, but enough that they miss fame.”Slide18

Way of Doing Research

“It ain't what you do, it's the way that you do it.”“And I realized that in truth the problem was not just to get the answer; it was to demonstrate for the first time, and beyond question, that I could beat the analog computer on its own ground with a digital machine. I reworked the method of solution, created a theory which was nice and elegant, and changed the way we computed the answer; the results were no different

.”“ By changing the problem slightly, I did important work rather than trivial work.”[Annotation: Digging out general ideas/fundamentals of the concrete work]Slide19

Way of Doing Research – cont.

“``No, I should be in the mass production of a variable product. I should be concerned with all of next year's problems, not just the one in front of my face.'‘”

“By changing the question I still got the same kind of results or better, but I changed things and did important work. I attacked the major problem How do I conquer machines and do all of next year's problems when I don't know what they are going to be? How do I prepare for it?

How

do I do this one so I'll be on top of it?

…”Slide20

Way of Doing Research – cont.

“You should do your job in such a fashion that others can build on top of it, so they will indeed say, ``Yes, I've stood on so and so's shoulders and I saw further.'' [Annotation: inspiring others]

“The essence of science is cumulative. By changing a problem slightly you can often do great work rather than merely good work. Instead of attacking isolated problems, I made the resolution that I would never again solve an isolated problem except as characteristic of a class.”Slide21

Generalization and Abstraction

“Now if you are much of a mathematician you know that the effort to generalize often means that the solution is simple. Often by stopping and saying, ``This is the problem he wants but this is characteristic of so and so. Yes, I can attack the whole class with a far superior method than the particular one because I was earlier embedded in needless detail.'' The business of abstraction frequently makes things simple. Furthermore, I filed away the methods and prepared for the future problems

.”Slide22

Generalization and Abstraction – cont.

“``It is a poor workman who blames his tools - the good man gets on with the job, given what he's got, and gets the best answer he can.'' “And I suggest that by altering the problem, by looking at the thing differently, you can make a great deal of difference in your final productivity because you can either do it in such a fashion that people can indeed build on what you've done, or you can do it in such a fashion that the next person has to essentially duplicate again what you've done.

It isn't just a matter of the job, it's the way you write the report, the way you write the paper, the whole attitude. It's just as easy to do

a broad, general job

as one very special case. And it's much more satisfying and rewarding

!”Slide23

Selling – Why?

“it is not sufficient to do a job, you have to sell it”“But the fact is everyone is busy with their own work. You must present it so well that they will set aside what they are doing, look at what you've done, read it, and come back and say, ``Yes, that was good.'' 

”“You had better write your report so when it is published in the Physical Review, or wherever else you want it, as the readers are turning the pages they won't just turn your pages but they will stop and read yours. If they don't stop and read it, you won't get credit.”[Annotation: That is why publishing in highly visible venues helps]Slide24

Selling – How?

“You have to learn to write clearly and well so that people will read it”“you must learn to give reasonably formal talks”“you

also must learn to give informal talks” Bad: `back room scientists‘:“In a conference, they would keep quiet. Three weeks later after a decision was made they filed a report saying why you should do so and so. Well, it was too late.”

They should have “[stood]

up right in the middle of a hot conference, in the middle of activity, and say, ``We should do this for these reasons

.''”Slide25

Selling – How to Give Technical Talks

“The technical person wants to give a highly limited technical talk. Most of the time the audience wants a broad general talk and wants much more survey and background than the speaker is willing to give.”Bad: “The

speaker names a topic and suddenly plunges into the details he's solved. Few people in the audience may follow.” ”The tendency is to give a highly restricted, safe talk; this is usually ineffective. Furthermore, many talks are filled with far too much information.” Good: “You should paint a general picture to say why it's important, and then slowly give a sketch of what was done. Then a larger number of people will say, ``Yes, Joe has done that,'' or ``Mary has done that; I really see where it is; yes, Mary really gave a good talk; I understand what Mary has done

.''Slide26

Educating Your Boss

“Now you might tell me you haven't got control over what you have to work on. Well, when you first begin, you may not. But once you're moderately successful, there are more people asking for results than you can deliver and you have some power of choice, but not completely.”

Direct way: “One lesson was sufficient to educate my boss as to why I didn't want to do big jobs that displaced exploratory research and why I was justified in not doing crash jobs which absorb all the research computing facilities.”Indirect way: “Every time I had to tell some scientist in some other area, ``No I can't; I haven't the machine capacity,'' he complained. I said ``Go tell 

your

 Vice President that Hamming needs more computing capacity.'' After a while I could see what was happening up there at the top; many people said to my Vice President, ``Your man needs more computing capacity.'' I got it

!”

Accumulate evidence

: “I

waited a couple of years. I then went through a year of BSTJ articles and counted what fraction thanked some programmer. I took it into the boss and said, ``That's the central role computing is playing in Bell Labs; if the BSTJ is important, that's how important computing is.'' He had to give in

.”Slide27

Worth Being a Great Scientist?

“``Yes, doing really first-class work, and knowing it, is as good as wine, women/men and song put together,'‘”“

And if you look at the bosses, they tend to come back or ask for reports, trying to participate in those moments of discovery. They're always in the way.”“I have never dared to go out and ask those who didn't do great work how they felt about the matter. It's a biased sample, but I still think it is worth the struggle.”“the value is in the struggle

more than it is in the result. The struggle to make something of yourself seems to be worthwhile in itself. The success and fame are sort of

dividends

”Slide28

Failure Analysis: Lack of Drive/Commitment

“The people who do great work with less ability but who are committed to it, get more done that those who have great skill and dabble in it, who work during the day and go home and do other things and come back and work the next day. They don't have the deep commitment that is apparently necessary for really first-class work. They turn out lots of good work, but we were talking, remember, about first-class work

.”“Good people, very talented people, almost always turn out good work. We're talking about the outstanding work, the type of work that gets the Nobel Prize and gets recognition.”Slide29

Failure Analysis: Personality Defects

Fail to Work with the System“The secretary said, ``Of course I can't help him; I don't get his mail. He won't give me the stuff to log in; I don't know where he puts it on the floor. Of course I can't help him.'' So I went to him and said, ``Look, if you adopt the present method and do what you can do single-handedly, you can go just that far and no farther than you can do single-handedly. If you will learn to work with the system, you can go as far as the system will support you

.'‘”“He had his personality defect of wanting total control and was not willing to recognize that you need the support of the system.”Slide30

Failure Analysis: Personality Defects

Fail to Work with the System – cont.“good scientists will fight the system rather than learn to work with the system and take advantage of all the system has to offer.”“

It takes patience, but you can learn how to use the system pretty well, and you can learn how to get around it. ”“After all, if you want a decision `No', you just go to your boss and get a `No' easy. If you want to do something, don't ask, do it. Present him with an accomplished fact. Don't give him a chance to tell you `No'. But if you want a `No', it's easy to get a `No'.”[Annotation: Similar situations when students work with the advisor]Slide31

Failure Analysis: Personality Defects

Ego Assertion“I wasn't dressing the way they felt somebody in that situation should. It came down to just that - I wasn't dressing properly. I had to make the decision - was I going to assert my ego and dress the way I wanted to and have it steadily drain my effort from my professional life, or was I going to appear to conform better? I decided I would make an effort to appear to conform properly

. The moment I did, I got much better service. ”“An enormous number of scientists feel they must assert their ego and do their thing their way. ”“

``The 

appearance of conforming

 gets you a long way

.'‘”

“

If you chose to assert your ego in any number of ways, ``I am going to do it my way,'' you pay a small steady price throughout the whole of your professional career

.”

“By

realizing you have to use the system and studying how to get the system to do your work, you learn how to adapt the system to your desires. Or you can fight it steadily, as a small undeclared war, for the whole of your life

.”Slide32

Reform vs. Adapt to the System

“I am not saying you shouldn't make gestures of reform. I am saying that my study of able people is that they don't get themselves committed to that kind of warfare. They play it a little bit and drop it and get on with their work

.”“Many a second-rate fellow gets caught up in some little twitting of the system, and carries it through to warfare. He expends his energy in a foolish project. Now you are going to tell me that somebody has to change the system. I agree; somebody's has to. Which do you want to be? The person who changes the system or the person who does first-class science? Which person is it that you want to be?”“Very few of you have the ability to both reform the system 

and

 become a first-class scientist

.”

“

On the other hand, we can't always give in. There are times when a certain amount of rebellion is sensible. I have observed almost all scientists enjoy a certain amount of twitting the system for the sheer love of it. 

”

“

I'm not against all ego assertion; I'm against some

.”Slide33

Failure Analysis: Personality Defects

Anger“Often a scientist becomes angry, and this is no way to handle things. Amusement, yes, anger, no. Anger is misdirected. You should follow and cooperate rather than struggle against the system all the time

.”Slide34

Failure Analysis: Personality Defects

Look at Negative Sides of Things“given the situation, by changing the way I looked at it, I converted what was apparently a defect to an asset.”

“I am an egotistical person”“I used my ego to make myself behave the way I wanted to. I bragged about something so I'd have to perform.”“I have found that it paid to say, ``Oh yes, I'll get the answer for you Tuesday,'' not having any idea how to do it. By Sunday night I was really hard thinking on how I was going to deliver by Tuesday

.”

“

I often put my pride on the line and sometimes I failed, but as I said, like a cornered rat I'm surprised how often I did a good job

.”

“I

think you need to learn to use yourself. I think you need to know how to convert a situation from one view to another which would increase the chance of success

.”

[Annotation: My advisor’s experience in student advising]Slide35

Failure Analysis: Personality Defects

Many Alibis/Lack of Honest to Yourself“Now self-delusion in humans is very, very common. There are enumerable ways of you changing a thing and kidding yourself and making it look some other way

.”“When you ask, ``Why didn't you do such and such,'' the person has a thousand alibis.”“usually these days there are 10 people right there ready, and we pay off for the person who is there first. The other nine fellows say, ``Well, I had the idea but I didn't do it and so on and so on.'' There are so many alibis. Why weren't you first? Why didn't you do it right? Don't try an alibi. Don't try and kid yourself. You can tell other people all the alibis you want. I don't mind. But to yourself try to be honest

.”Slide36

Failure Analysis: Personality Defects

Many Alibis/Lack of Honest to Yourself“If you really want to be a first-class scientist you need to know yourself, your weaknesses, your strengths, and your bad faults, like my egotism. How can you convert a fault to an asset? How can you convert a situation where you haven't got enough manpower to move into a direction when that's exactly what you need to do

?”“the successful scientist changed the viewpoint and what was a defect became an asset.”Slide37

Summary

“why so many people who have greatness within their grasp don't succeedthey don't work on important problems, they

don't become emotionally involved, they don't try and change what is difficult to some other situation which is easily done but is still important, and they keep giving themselves alibis why they don't. They keep saying that it is a matter of luck.”“

I've told you how easy it is; furthermore I've told you how to reform. Therefore, go forth and become great scientists

!”