Protovis

Just started playing around on Protovis, WordPress doesn’t allow Javascript, so will just post some .png of graphs I’ve made. It’s a shame, b/c some of them are interactive. Owell!

Dear CCF Freshmen

–NOTE: I wrote this spring semester of senior year, almost exactly a year ago. I wanted to share it in case it might find meaning to other people today. –

Dear CCF Freshmen,

In a few short weeks, I will be graduating. It’s so hard to imagine that just a few years ago; I was in your shoes – relieved that I’ve survived my first year of college, anxious and waiting for summer to start. (I was super-nerd and took MCAT this summer. CRAZY right? But Aron, my summer roommate, has some pretty hilarious stories). As I sit here in my room today, I am also looking ahead at what is before me. Although I don’t feel much different than when I first entered Rice, I am certain that I have changed and have been greatly blessed by the people, the opportunities, and the fellowship here at Rice. To that end, I am extremely grateful to have met each and every one of you.

You have been an inspiration to me – you are passionate about God, hard-working in your academics, and kind to everyone. I know some of you better than others of you, and I wish I had more time to get to know each and every one of you, but I am confident that you are the ones to make CCF great in the future. In just a few short years, I am sure you will become great seniors too.

Before I leave, I wanted to share with you some of my favorite essays. Although they aren’t necessarily written with a Christian perspective, I think these authors hit upon some universal truths on how to live life and how to choose your life’s work. When I was a freshman, I wasn’t sure on major or career path, and although I am not sure whether any of you are wrestling with that question right now, I think these essays really bring life into perspective. When I need some motivation or encouragement, I turn to them (I’ve read essay one a ridiculous number of times.) Some of these aren’t exactly light reading, and it’d be crazy to try to read them all at once, but these are, in my opinion, the best articles that I have stumbled across on the internet. Ever.

When I was a freshman, I had no clue what I wanted to do with my life. In terms of career and interests, I was a blank slate. This was a little disconcerting, because I was falling under the trap described in essay 5 – that is working towards a goal simply because it’s a challenge, it’s prestigious, and it’s what everyone else was doing. Through a combination of factors – looking for a challenge and knowing I can do it if I set my heart to it, having a certain amount of pride in that I am trying something hard, and being stuck with high expectations for myself – I decided to become premed. In some the default choice for “smart” Asian-Americans, in retrospect, my choice was naïve and not thoroughly thought out.

I didn’t think too much of it then, and I hoped that if I just worked hard, God will deliver. But I believe having faith in God does not mean living life passively – and this was the worst kind of passiveness. Too often in the past, I had the mentality of “head down and plow through this” instead of stopping to smell the roses. In high school, I was “Aite, let’s get through SATs and all this junk. If I sacrifice now, I can chill out in college.” Then, in an abrupt about-face, in college, I was “OK. I’ll just dominate MCAT and hurdles, I’ll find more time to relax in med school.” How short-sighted am I? What’s next, hardcore through med school, so I can “chill” in residency? Life is a journey, and it’s quite a beautiful and exciting one at that.

But this is one of the most difficult choices one can, has to, make. It’s much harder to actively think and take time to decide what you want to do, than to go through the motions of take some tests, working hard, and doing extracurricular activities. I am absolutely convinced that each and every one of you will excel at what you do – you have been intelligent and hard-working to get to where you are today – and I think the more important question is deciding what you want to do and determining your reasons to do so. I hope these essays will drive you to think more about these last two questions.

So in summary, I wanted to encourage you to continue the good work you have been doing this past year and to let you know that y’all have been an encouragement to me. Walk with Christ. Pursue your passions. Grow strong relationships. And consider this letter as an open invitation to free boba if you want to chill out or talk. I might be busy next year (med school and all, right? ), but I want to encourage you to email me with questions or need some advice – I will always make time.

With love,
David

Some Essays
1. My favorite essay – Paul Graham’s very inspirational high school graduation speech on how to live your life and choosing a career – http://www.paulgraham.com/hs.html

2. Steve Job’s Commencement Speech (here’s a transcript and a youtube video).

http://news-service.stanford.edu/news/2005/june15/jobs-061505.html

A part that really stuck with me was: “When I was 17, I read a quote that went something like: “If you live each day as if it was your last, someday you’ll most certainly be right.” It made an impression on me, and since then, for the past 33 years, I have looked in the mirror every morning and asked myself: “If today were the last day of my life, would I want to do what I am about to do today?” And whenever the answer has been “No” for too many days in a row, I know I need to change something.”

3. The disadvantages of an Elite Education – I consider this article and the next article to be good reminders whenever I feel too prideful or too content with where I am. http://www.theamericanscholar.org/the-disadvantages-of-an-elite-education/

4. How to be a genius – A description how raw intelligence is trivial compared to effort. http://www.newscientist.com/article/mg19125691.300-how-to-be-a-genius.html?full=true

5. The Competence Trap – the danger of living life on autopilot, and unfortunately how many people live their lives. http://calnewport.com/blog/2010/04/09/corrupted-callings-the-subtle-difference-between-finding-your-lifes-work-and-loving-your-life

6. There is no speed limit – Why I am trying to graduate early. http://sivers.org/kimo

7. Randy Pausch’s last lecture – Really famous talk from a dying computer scientist, describing the importance of obstacles and brick walls in achieving our goals. (here’s a transcript and a youtube video). Unfortunately it’s really long – listen to it in the background while you do some work! http://www.youtube.com/watch?v=ji5_MqicxSo

http://download.srv.cs.cmu.edu/~pausch/Randy/pauschlastlecturetranscript.pdf

8. Outliers by Malcolm Gladwell

Liver Transplant Donor Run

Sunday night, I had the rare opportunity to go on a donor run. We flew into Fresno and I got to scrub in to help in a liver and kidney procurement. It was an amazing experience – awe-inspiring to realize what was happening and overwhelming in knowing what a rare and unique opportunity this was. Out of the tragedy of one person’s loss, multiple individuals are helped – in this particular case, the heart, liver, and kidneys were collected. It is truly an amazing system, where the anonymous generosity of one individual can galvanize an entire support network and bring together physicians from all over the country to most efficiently help people in need.

On the scientific and medical level, transplant is just as amazing.The very idea of transplant, the practice of moving and implant another individual’s organ to help prolong another individual’s life, underscores a deep fundamental understanding of physiology, cell biology, and biochemistry. Physicians build upon a tremendous body of knowledge of physiology – an understanding of how each organ functions and what purpose each tissue serves. For a successful transplant, physicians need to identify the signs of what organ is failing, surgeons need to perfect the technique of resecting an organ while minimizing ischemia and preventing blood clots, and a large body of knowledge must be available to understand how to perfuse the organ and minimize the immune response of a foreign organ.

The play-by-play:
At around 8:30PM, I got a call from Alexandra. I did not have the pager and she had just gone to a procurement earlier that day, so she asked if I wanted to go. I had just gotten home from preceptorship and was making dinner. Having been in the ED the entire day, I was rather tired, but really excited for this opportunity – particularly when I heard that it would be in Fresno.9:45PM, I got into an unmarked van in front of Moffitt Circle. I met up with Alex, the transplant coordinator, Stephen, R3 from Fresno on transplant rotation here at UCSF, and Ingo, the transplant fellow. We drove to SFO and got on a private jet to Fresno. An anesthesiologist from the transplant network met us at the airport and we headed off.

11:45PM We got to Community Medical Center, changed into their scrubs, and began preparing for the surgery.  There was a little bit of downtime, where we got some coffee (bad idea, I was trembling a little when closing) and the fellow went through all the paperwork.

12:15AM. The surgery began. The nurses were super helpful – I don’t have too much experience scrubbing in, but they were really nice in helping me pick out gloves and put on the gown and gloves.

It was an amazing process, with the cardiac team working in parallel with the abdominal team. I won’t go into too many details, but it always astounds me the amount of finesse involved in surgery. Great delicacy is used to maintain the blood supply of the organs, and I could tell the

3:00AM The surgery began to wind down. The R3 and I got to close up the donor, while the fellow focused on the actual organs. I helped tear down the surgical field and package the organs.

4:00AM Back to the Fresno airport, which was then only a skip, hop, and a leap back to SF. I couldn’t sleep the rest of the night, and stayed away the rest of the time until I got back home.

This was truly an amazing experience, and really highlighted the joys of surgery. Through finesse and technique, there is an unparalleled opportunity to make a great impact and impact someone’s life. The task before you is directly tangible and the responsibility is directly on your shoulders. It is truly a different experience, and I really felt the rush of adrenaline in helping out and knowing what I was doing would make a difference.

Goodness, life is so bittersweet.

 

It’s amazing how quickly this past year and semester has passed by. I always thought medical school will take forever, but in less than a blink of an eye, it seems like first year is almost over.

This past year, in some ways have been a struggle for me. The first year of any change has always been both a good and bad experience for me. During my first year at Rice, I was really excited to be in college, but past the initial rush of “wow, I’m in college now”, I was kind of floundering. I didn’t really know if I had found a group of people I fit in with and I was not sure what my place was on campus. During the end of senior year, I was really ready to leave – to move on, grow, and explore new places, but towards the end of freshman fall, I was really beginning to miss my high school friends. High school was so much fun – and even though I worked hard, I really enjoyed all those random nights playing video games, playing bughouse, randomly going to gym, doing nothing and wondering where the time went. I didn’t indulge in that as much as I could have, but I really enjoyed the experience and the friends I made there.

During the first part of Rice, I wasn’t sure if I would find the same kind of community and friendship there. College wasn’t that new of an experience – I went to a boarding high school – so I was used to staying up late and having lots of free time. In some ways, I was caught up in my academic ambitions, so I was too focused and didn’t have that many classes in common with most of my peers and didn’t really felt I fit in. But as a result of these factors, I began to doubt my college choice. Was I really where I was meant to be? Was I where I needed to be and where I would be happiest? I could have gone where I knew a ton of people and could still hang out with the same group of people. I could have gone somewhere completely new, completely far from Texas and start over anew. But in the end, I chose to stay in Houston and be close to home. After going to boarding school, I really recognized and relished the opportunity to be close to my parents and my sister. Looking back, it was a really good decision for me – I was able to stay close to my parents and watch my little sister grow up, but at the end of freshman year at Rice, I wasn’t so sure. I didn’t really feel like I knew people too well, wasn’t sure who to hang out, and often went home on weekends during the first semester.

In some ways, this path parallels this year at UCSF. I am unfortunately the kind of person who wonders and thinks that the grass is greener on the other side. Don’t get me wrong, UCSF is an amazing place. I’ve met some very amazing people, got to learn and experience so many wonderful experiences, and have a great group of friends, but I sometimes wonder what it would be like if I stayed in Houston and just stuck with what I’m used to. This feeling was perhaps amplified by the fact that this past week, I went back to Houston for spring break. It was awesome to see all the CCF and other people that are still at Rice. I really enjoyed playing basketball, grabbing food with people, and just randomly hanging out. I remember thinking, Houston is actually not that bad – I could think about coming back here for residency.

But even as I thought that, I wondered. Would I come back for residency? Being gone for a year, I already see that people have gotten closer and changed – I’ve already missed out on a ton of inside jokes; wouldn’t the changes be even more poignant after a few years? Would there even be a group of friends in Houston in a couple of years? It just happens to be that a lot of my friends are still at Rice and graduating this year – will it be even the same in a few years? 4 years down to line, it just happens that a large group of my high school friends are here in the Bay Area, whether that’s due to luck, chance, or something greater, that’s up to your interpretation. Would it mean the same to me in a few years?

Anyways, I am confident that I made a good choice for medical school, and I will find a niche here. I am sure I will grow to love this place as well, and if I ever leave this place, will miss it. I am just slower at adjusting. Back to studying!

 

 

Cargo Cult Science, Medicine, and Science Fatigue

Part One: Cargo Cult Science

During the Second World War, American and Japanese forces fought over a large swath of territory across the Pacific Ocean. This area including many previously unexplored islands and archipelagoes and many indigenous cultures inhabited these distant lands. Isolated by large jumps of distance and previously unknown, these indigenous cultures were exposed to modern technology for the first time during the war. Imagine their amazement as, for the first time, they saw the metallic glare of fighter jets and battleships and heard the deafening roar of jet engines.

Food rained from the skies and the new arrivals literally changed the landscape, as both American and Japanese soldiers used airdrops and created landing strips and airports. To these indigenous cultures, the new arrivals must have seemed to be Gods or, at the very least, demons. Introducing the indigenous cultures to canned foods, medicine, clothing, and other manufactured goods, this outside intervention must have seemed incomprehensive –completely changing their world view and turning their lives upside down as they stood in the middle of a battle between two technological powers.

But then, after the conclusion of the Second World War, the soldiers left as quickly as they had come. Without a war to fight, there was no longer the same incentive to stay at these remote islands. For the indigenous cultures, it must have been quite confusing. Where did all the nice clothing, tools, and medicine go? How come food no longer dropped from the skies? Not fully understanding the reason why the soldiers came to their land or the mechanism behind the new supply of food and supplies, some indigenous cultures became cargo cults. They wanted access to the benefits and tangibles of technology without truly understanding how it worked. Mimicking the soldier’s actions and creating the outward signs of complexity, cargo cults sought to recreate the conditions required for attracting the cargo. Creating life-size replicas of airplanes, building control towers made of wood and thatch, and even clearing land to recreate runways, cargo cults mirrored the conditions of a technological society without fully understanding the reasoning and mechanism of their actions.

Richard Feynman famously used the term cargo cult science to describe research that is done without a full understanding of the underlying mechanism and using “reason” to justify the results post-mortem. Although these imitations can be quite accurate – Feynman mentions that the straw antennas of these make-shift airplanes were strikingly close to the length of actual antennas – without having any kind of result. Although mimicking the routine of developing hypotheses, using controls, and performing experiments, cargo cult science describes work that seeks to create results while lacking the fundamental understanding of what is actually happening. Cargo cult science is the justification of empirical observations without a true understanding of underlying processes.

 

Part Two: Medicine as a Cargo Cult

By this definition, medicine is a cargo cult science. This says nothing of medicine’s efficacy or its ability to help people, but 21^st century medicine is ultimately an empiric science. As much as we understand cell biology and systems physiology, the human body is still an incredible mystery, full of individuality, complexity, and beauty. With the level of current understanding and knowledge, biology (especially human biology) is a black box. As a first year medical student, this is the fundamental challenge in learning medicine – the knowledge gap between physiology and pharmacology.

As much as we understand human organs (the heart is a pump, the kidneys are a set of filters, and etc), with the current level of understanding, it is still fundamentally impossible to deduce the efficacy and the side effects of pharmaceutical agents. We can conceptually think about what happens when we increase or decrease blood flow, but it is still very difficult to determine a drug’s effect given its molecular structure or even what protein it targets. As an example, different approaches are needed to learn physiology and pharmacology in medical school. We want to understand how to body and various organs works in physiology, but we are forced to memorize the characteristics, half-lives, toxicities, and efficacies of drugs in pharmacology.

Yet despite its status as a cargo cult science, I find partial assurance because medicine is an empiric science. We choose what pharmacological therapies to give because it worked for the last hundred thousand people with your illness, and while we might not understand completely the mechanism of its effect, we can be reasonably confident in its efficacy for you. In fact, if you think of it this way, the FDA is the simply the clearinghouse of cargo cult science. The FDA does not simply ask pharmaceutical companies what the mechanism of their drug is (actually it does, but if you follow my logic of medicine as a cargo cult science I’d say that’s misguided.), but actively seeks to test and validate its efficacy.

But more than an effect on clinical outcomes, medicine as a cargo cult has great implications on the speed of medical progress and how medicine will progress in the future. Despite the rapid pace of basic scientific discovery, the difference in attitude and perspective between medicine and science will only widen the gap between scientific knowledge and clinical treatment. The next part will try to explain what I hypothesize will happen and why that is.

 

Part Three: Science Fatigue in Medicine

Unfortunately, it is far too easy for smart people to think of explanations and justifications of what they observe –regardless of whether or not it is true. Anecdotally, I can remember quite a few instances where I was asked to explain a concept, and while I wasn’t completely sure, was able to describe a reasonably sound explanation. Then, in retrospect, the explanation turns out to be completely wrong. Prior to Galileo’s claim that the Earth revolved around the Sun, humans lived normally and comfortably for hundreds, if not thousands of years. Prior to Galileo, there were many scientists, astronomers, and great thinkers – yet were they not troubled with what we now recognize as errors and fallacies of critical thought? Intelligent people, if set in a particular framework of thought, are especially difficult to persuade.

A prime example in medicine would be the recognition that Helio pylori, bacteria in the stomach, can cause ulcers. The scientists were initially ridiculed and scorned – “How can bacteria grow in the acidic environment of the stomach?” – before overwhelming evidence was obtained. It took the efforts of a brave scientist to ingest the bacteria and give himself ulcers before the scientific community could access the truth of his statements. With such a discovery, the entire framework of treating stomach ulcers was changed and Barry Marshall and Robin Warren won the Nobel Prize – but before this discovery, when haven’t other physicians and scientists recognized this link? Hindsight is 20/20, but the question of stomach ulcers is a large part of gastroenterology.

I can think of two main reasons, why medical advancement lags behind scientific understanding. There are undoubtedly more, but I think there are two main causes in relation to perspective and the framework of research. First, medicine works. This gets back to the initial idea that medicine is an empiric science – despite all its shortcomings and gaps in understanding, medicine is highly efficacious and we are at a point in history were previously fatal diseases and symptoms are routinely treated and cured. Just as Galileo was focused on something that seemly had no direct bearing on day-to-day life, many of the problems of medicine are not focused on the day-to-day treatment of patients. If someone has a heart attack, there is a standardized protocol and all in all, it works well. There is a standard of care for most diseases that guide how physicians treat patients. When things work, there is much less of an incentive to figure out why it works and how it works. This is a simplification, but I feel like this especially true when people are overworked, fatigued, and worrying about hundreds of other concerns (such as patients health, regulation, and even healthcare reform).

For the second reason, I would like to suggest a new phrase: Science fatigue. The idea of compassion fatigue is a concept that argues that the media has caused cynicism and lack of initiative in society by saturating newspapers and news shows with decontextualized images and stories of suffering. This inundation of similar images has been cited to cause the public to become cynical, or become resistant to helping people who are suffering – I would argue that this is same case with science. The general public, and physicians in particular, are flooded with so much news of scientific breakthroughs and innovations that seem to never materialize in concrete advances or meaningful change in care. We are always hearing about the latest device and the newest therapy, but the standard of care has changed so slowly that it is difficult to not become cynical about the marketing and showmanship now pervasive in medical science.

 

Part IV: Conclusions

The combination of relative efficacy and inundation of information is especially noticeable in medical education. In medical school, one is expected to learn and understand a large and ever-growing body of knowledge related to basic science and treatment. We are flooded with a huge volume of information – more than enough to occupy us for 24/7 for the next four years – and thus we need to prioritize what is important and what we choose to be curious about. The standard of care is undoubtedly important (medicine first and foremost has to work), so treatment is often emphasized. Science and the basic mechanisms often seem more nebulous and intangible. There are still many aspects of medicine that we do not understand, and the mechanisms we understand are sometimes barely better than the educated guesses of intelligent people. To reiterate, it is far too easy for smart people to think of explanations and justifications of what they observe – and without true understanding of the underlying mechanism, is medicine much better than a cargo cult? With the pressing urgency of patient care and the great body of knowledge expected of every physician, is it possible to function above the level of a cargo cult scientist?

A great clinician once told me that the most important skill to learn in medical school is the ability to deal with uncertainty. When we treat patients, we can never truly be completely certain that our diagnosis is correct or our therapy is the most efficacious. Physicians need to be comfortable with the uncertain variability in disease presentation, drug response, and even human physiology. This uncertainty begins even at the level of molecular mechanisms. Even as basic science pushes our understanding of biology, science cannot be the only force that drives the practice of medicine. Patient needs, cultural barriers, and pragmatic considerations all divide the worlds of medicine and science.

Since coming to UCSF, I have realized that many of the greatest challenges of medicine come not from the science, but from quality of care and from access to care. The most intractable problems of global health and health within our own community come from deciding how and where to deliver care that is currently already available. Healthcare reform seeks to answer the questions of how we can improve our quality of care without bankrupting the economy. Learning to deal with people is an incredibly important issue -  even though we have incredibly efficacious drugs for treating hypertension, asking people to take pills (with noticeable side effects) for a disease that is subtle, often symptomless, is tremenendously difficult. There are many questions that cannot be answered from the benchside and while I still greatly admire and respect science’s ability to alleviate suffering and cure disease, much good can be done in improving the potential we already have in front of us now. For better or worse, medical is truly different from science.

 

 

 

 

West Vs. East: How Stanford Will Beat Harvard in 50 Years

To a first approximation, the quality of a university trends with economic power of the surrounding region. I think this is makes sense as the quality of a university is a product of the quality of students and faculty it can attract. Universities naturally tackle problems that are of interest to the community near them. Businesses actively recruit graduates from universities that are close and familiar to them. If these questions and these businesses are inherently important, prestigious, or high-impact, the university’s importance, prestige, and impact would go along with it. Silicon Valley is definitely a boon to Stanford, and being in the heart of colonial America was definitely beneficial to Harvard – but this says nothing about the lasting power of such quality.

One example could the relative respect and ranking of European universities and American universities. Going back to the 19th century, Europe, particularly England, was the center of the world – there is no doubt that Oxford and Cambridge were the undisputed centers of education and learning. Harvard would seem like a backward backwater professional school. As we progress to the 20th and 21st century, America’s relative standing in the world improved, and I think this coincided with a rise in names such at Harvard, Stanford, and MIT. This might be due to my America-centric background, but I think these schools can hold their own against most others throughout the world.

Much more than educational models and philosophies of teaching, the relative importance of the region that a university encompasses is the leading indicator of future success. That is not to say the educational mission is unimportant, but I think other factors pale in comparison to the irresistible attraction of proximity. Choosing a college a few years back, I had no idea what is really important. Apart from an ambiguous idea for “prestige” and the spectrum of unique but equally impressive architecture, I remained ultimately ignorant of the different characteristics of each institution – and I get the impression that I was not alone. With all else equal, I would imagine being close to family and friends would a significant pull to the empty vessels we call students. The law of large numbers would suggest regions that can attract intelligent adults will inevitably attract intelligent students.

The real question is: Where is this going? What implications does this have for the future? I think it is particularly telling that one of the major movies of the past year chronicles the journey of bright young student moving from the more traditional prestigious halls of education and power to a new area of excitement and potential. The Social Network, in part, described Mark Zuckerberg’s move from Boston, Massachusetts to Palo Alto, California, and foreshadows the gradual shift of America’s center of gravity towards the West.

It is difficult to predict the fall of hegemony – and Harvard is undoubtedly an educational hegemon. But just as we are transitioning into a multi-polar world and Facebook is challenging the internet dominance of Google, such shifts seem natural, almost inevitable, in hindsight. And that is my guess for the improvement of Stanford over Harvard in the near future. As the United States moves ever more towards an information-based economy and the traditional powers of finance and trading is seen as a non-productive Ponzi scheme, the center of gravity shifts towards the West. The importance of Silicon Valley will only increase and in turn, the significance of Stanford, UCSF, Caltech, Berkeley, and other schools in the west will continue to grow.

Professionals at Work

As the internet becomes a larger and larger proportion of our everyday lives, our habits in front of our computer become increasingly important. Just fifty years ago, who would have thought there would be entire cottage industries would be devoted to ergonomics and our comfort in an increasingly sedentary lifestyle? As Hulu comes bridge the divide between computer and television into one entertainment platform and the internet becomes more and more vibrant and engaging place, we will undoubtedly reexamine the evolution of the internet and browser platform. Just as important physical comfort, even slight gains in efficiency in broswer/internet use will be compounded greater and greater amounts of time in front of the desktop. I attempt to examine the relationship between self-reported proficiency, amount of time spent in front of the computer, and extension use in Firefox.

Mozilla Labs and the Metrics Team, together with the growing Mozilla Research initiative, are hosting a Open Data Visualization Competition based on Test Pilot data. This is my second attempt after sorting through demographic, use, and survey data. First, the distribution of the self-reported computer proficiency is not normally distributed. There was a much greater number of individuals selecting a high proficiency on the internet than those selecting a low number. Although I believe this is definitely a biased population (the individuals opted in, implying they understand how to opt in and care for the development of Firefox), I also think there is truth in the saying “90% of college graduates believe they graduated in the top half of their class”. There are negligible differences in responses to the amount of time spent using Firefox and age distribution. When faceted both by age of the respondent and self-reported number of hours in front of the computer, the distribution remains roughly the same.  However, there are substantive differences in terms of use of extensions and the types of activities performed – perhaps enthusiasm is more important than raw amount of time.

 

First, individuals self identifying as being more proficient are also more likely to use a greater number of Firefox extensions. This is to be expected as Firefox prides itself on having a vibrant sandbox of developers and a large array of functional and entertaining extensions. I would guess that more proficient users would take the time to create a more customized and optimized experience with the internet and this begins at browser extensions. I would also venture to guess that at least a portion of the sample includes web developers and individuals intimately involved in the development of Firefox (Who needs 100+ extensions?!?) and they would self-identify as professional users.

 

The internet is not a one-way mirror. As we use the internet, the internet changes and influences our behaviors. There is also a strong positive between the self reported proficiency and the number of activities one performs on the internet. In the survey, one of the questions on the survey asks how individuals use the internet, binned into large categories of activities ranging from social networks to online shopping. As users become more proficient, perhaps they discover a greater variety of functions that can be performed online.

 

Finally, more frequent users use the internet for a great number of reasons. This is intuitive as to use the internet for more functions, more time would be spent in front of the computer. As entrepreneurs continue to discover and create new ways for the internet, inevitability more and more of our life will be tied to our online personas and internet use. As such, the browser experience is vitally important. (Carry on Mozilla!)

Further Exploration of Private Browsing

Mozilla Labs and the Metrics Team, together with the growing Mozilla Research initiative, are hosting a Open Data Visualization Competition based on Test Pilot data. I really enjoy reading their blog posts, and now that they’ve opened up their dataset, I wanted to have a go at it. On the Mozilla website, there is an option to enroll in a data-collection study on how individuals use their browsers. In addition to usage statistics such as how many tabs are open and how frequently they use their browser, there is a survey of demographics and self-described interests.

There was a really blog post on how people use Private Browsing Mode based on usage data. I wanted to see if I could go one step further, by testing their conclusions and cross-referencing individual usage data with their survey responses. I was able to confirm some of their conclusions, such as the fact that most people spend about 10 minutes in Private Browsing mode, but because location data was stripped from the dataset, was not able to verify the spikes according to time of day. From PDT it looks like there is large peak throughout the afternoon, but this probably skewed by different numbers of users in each time zone.

A Greater Proportion of Male Users than Female Users use Private Browsing Mode

The dataset is skewed towards having more males represented in the sample population (94% male), but in terms of most metrics, there is gender equity. Males and females use roughly the same number of extensions, have similar age distributions, and have very similar self-reported number of hours in front of the computer. Females do seem more modest in self-reporting of proficiency with a computer. The most striking difference was the difference in use of Private Browsing Mode, with almost four-fold increase in the proportion of males. Further statistical analysis based on gender, either of the duration or frequency of the use of Private Browsing Mode seems suspect due to the small sample size.

Younger People Tend to spend more time in Private Browsing Mode

In addition to gender, there appears to a slight, admittedly weak, relationship between the age of the individual and the average time spent in Private Browsing Mode. The data is colored based on gender, with blue for males and red for females. There appears to be a slight bump in the 18 to 25 age category, although this could be due to differences in sample size across different ages. Note: This plot is of individuals which use Private Browsing Mode – if examining the population at large, there would be a ton of data points with a duration of 0.

Self-Identification Affects Private Mode Usage

Question 12 of the survey posed the question “What are your most frequently visited websites?”. The survey allowed for a variety of responses ranging from “Search engines” and “Social networking sites” to “Adult pages” and “Gambling and online betting”. I was curious whether this self-characterization would be a good metric to identify individuals who use Private mode more often. I was able to separate out the survey responders based on whether they chose each website different categories. For example, I subsetted the entire survey into individuals who chose ”Social networking sites” vs. individuals who did not choose ”Social networking sites”. A priori, if this self identification did not matter, there should be little to no difference between the average time in Private Browsing Mode between the two populations.

For each category, here is the absolute difference in the two populations.

[1] 5.594305
[1] 3.84167
[1] 0.2490019
[1] 0.7180658
[1] 3.601866
[1] 0.3737534
[1] 1.408243
[1] 1.525824
[1] 3.27257
[1] 6.79226
[1] 4.651107
[1] 5.669116
[1] 1.027911

There was the smallest difference in individuals who claim and do not claim to use the internet for “News sites”, “Social networking sites”, and “Shopping”, while there appears to be a bigger difference in individuals who claim to use the internet for “Forums”, “Adult pages”, and “Gambling and on-line betting”. There appears to be a noticeable difference in usage between individuals selected any of the “riskiest” 3 categories and individuals who did not.

Alexander Hamilton

US Half Marathon Statistics

Yesterday, I ran the US Half Marathon. It was my first half marathon, and I woke up at 4:30 AM to abysmal dark and pouring rain. Getting there around 5:30AM, I waited outside (the nearby Starbucks didn’t open till 6AM), and wondered whether I should really be attempting this. By 6:30AM, I met a few other runners waiting at Starbucks and their energetic reassurances convinced me to go for it. All in all, it was a really good experience, and I was happy that I ran. I finished in 2:17:26, but by mile 11, the region around my right lateral epicondyle started hurting (the bony structure lower and to the outside of your knee). Try as I may, I couldn’t run anymore, and walked the final two miles. I will write more about my experience, but I wanted to share my statistical analysis of the results of the race.

Relationship between Bib Number and the Runner's Finish Time

Later that day, I went to check out the posted results online. The results page had an easy to scrape PHP/javascript database, so I downloaded the information and did a brief statistical analysis on results. I graphed the relationships between gender, age, bib number, and finishing time using R and ggplot2. Some results are below:

• I registered for the half marathon using Groupon, and all in all, 1298 people used Groupon for this event. This was approximately three weeks before the half marathon. I wondered if you could tell the Groupon participants from the regular, hypothetically more hardcore, racers.  I assumed that the bib (the paper you pin to yourself) numbers were assigned based on registration, ie. earlier registrants received lower numbers. Either that is not true or my assumption is wrong, as it does not look like later participants are slower than participants with low bib numbers. Rather people with higher bib numbers seem to be slightly faster than people with lower bib numbers.

• I also heard that they reserved a range of bib numbers for professionals, relatively famous marathoners, or people who are extra dedicated. This does not seem to be the case as I could not determine any clusters of bib numbers in the fast runners. The winner seems to have a bib number in the middle of the range.

Boxplot of the Relationship between Runner's Age and Finish Time (in Seconds)

• There appears to be a positive correlation with finishing time (in seconds) and age. The older you are, the more likely you are slower. Makes sense.

Distribution of Runner's Home Towns Across US

• The vast majority of participants are from California. Note that the dots are in log(scale), of around 2.7k participants, maybe 2.5k were from California.

Different Divisions of Runners Represented

Gender Ratio of US Half Marathon Runners

• I examined the distribution of gender and age of the participants. There were more females than males running the race, and people were divided into divisions according to both age and gender. For example, M2029 would be males from 20 to 29 y/o.

Distribution of Times By Gender

• Men are faster than women at this 13.1 mile race. The first 20 or so finishers were all men. Not sure if statistically significant.

In summary, this was an interesting experience and it was nice to see that results were easily accessible online. I did not find any very striking relationships or hidden patterns based on the results, but it is interested to examine the relationships between the different demographics and running times.