I've been trying for years to write a novel presenting mathematical ways of thinking about chance. I think most non-mathematicians' minds go numb if even one little equation appears on the page, so it's better to use graphics. There's an open-source statistical package, R, that has good graphics (there's a link to the R Gallery in the sidebar).
Since R is open-source, it is HIDEOUSLY time-consuming to learn independently. Having installed the software one then downloads various PDFs offering Introductions to R, works doggedly through the PDFs, blunders cluelessly through the maze of FAQs and Help, buys and works doggedly through books such as Data Analysis and Graphics Using R (Maindonald and Braun) and R Graphics (Paul Murrell), occasionally sending apologetic pleas for enlightenment by e-mail to those in the know. Statisticians tend to feel that both statistics and statisticians are strangely underrepresented in fiction, so very distinguished statisticians are startlingly helpful, but still one is blundering about -- all this while trying to deal with people in the movie biz, the book biz, any other biz. So the project kept getting disrupted, and each time it got disrupted it was necessary to go back to the beginning and start from scratch. In September 2005 I applied for a Guggenheim Fellowship for the project, in March 2006 I was told I'd got it, but same old same old same old, many wonderful people thought I had better things to do with my time and so it goes.
Here are a few graphics from R from one of my many PDFs:
What I mean is, although I did pitch the project to the Guggenheim as a way of permitting fiction to show us the structures of power in the world -- the world of finance, which permeates all lives, has been transformed in the last 20 years by the development of financial instruments such as options, futures and derivatives, which could (but don't) transform our understanding of chance, of risk, in daily life -- I really just wanted an excuse to write a book using the sort of graphics I had come across in Jim Pitman's probability, which I found utterly delectable. The R Gallery offers many more examples of delectability. My response to these graphics is like an illustration of Ayer's yah-boo emotivist theory of value, it's like the average Stern-reader's response to dear little Knut (and dear unjustly neglected little Ernst): Awwwwwwww. Awwwwwwwww. Awwwwwwwww.
What can I say? I LIKE a page of tiny histograms. I LIKE Tuftean sparklines (not that you can do them in R, but this is another problem.) I LIKE -- no, to be perfectly honest, I ADORE a panel of tiny boxplots. Awwwwwwwwwwww.
Well. Poor old head. Poor old head.
Two and a half years ago I had a lot of problems with an agent and a film director. The film director was "passionate" about making a film of The Last Samurai but had been thwarted in his efforts to proceed because, um, it is impossible to locate a writer on the planet if the writer has not taken the precaution of setting up a website. Instead of doing what Kurosawa would have done (find the author and camp out on her doorstep) he had chosen to talk passionately about the book to his agent at William Morris and to other agents at William Morris. An agent at WM to whom he had talked passionately got in touch with me after I got in touch with them, offered to represent me, started wheeling and dealing, turned out to know nothing about the publication history of The Last Samurai because, um, the writer had not taken the precaution of setting up a website.
Bad news, bad news, bad news, I thought I had better set up a website. A friend had a friend. The friend's friend set up a website, yes, but she liked Flash so she set it up in Flash. She thought text was boring, converting Word documents to HTML was unfun, so she put all the reviews and text on the site as downloads, all surfers' pet hate.
Things went wrong with the agent and the director, another story. The website has been there for two and a half years, and because it was too hi-tech for its owner it has been dead. This blog, of course, is very lo-tech. The blog has been going for just under 4 months, and it has had over 150 posts, and it has a shockingly cluttered sidebar that will only get worse -- in fact, it has all kinds of material that would really work much better on a website, but it all goes on the blog because the blog is lo-tech and requires no social interaction, no negotiation, no give-and-take as a prerequisite to posting.
Getting a Guggenheim Fellowship -- getting any fellowship, for that matter -- is quite time-consuming. My application took a month to write. One has to write up the project, write up a CV, persuade three or four distinguished people to take time away from their own work to write in support of the project. It's tiring, it's time-consuming, but it's straightforward: you are trying to convince your peers that you will write a work of genius.
Getting a book published is quite a different matter. If the book is doing something new, especially if it is doing something which falls foul of cultural prejudice (most novel readers DO NOT like mathematics), a lot of stage-setting needs to be done to persuade agents and publishers that it should be shown to the public. Something needs to be done to -- well, this is actually quite tricky. It would be good to do something to persuade the time-pressed sceptic that thousands of readers could see a page of tiny histograms and say AWWWWWWW. But it would also be good to give this time-pressed sceptic some way of seeing how the book is radically new, important... Point is, this is a much more challenging rhetorical exercise than persuading distinguished writers and critics that you will write a work of genius. THAT took a month. THIS is something you might need to refine for six months, a year, maybe as long as it takes to write the actual book. So you need a very lo-tech website that you can keep going back to. (If you are ALSO trying to persuade both publishers and the reading public that they would like to learn Arabic... let's just say that this too needs a lot of groundwork.)
[HOW long this is.]
If someone has put a lot of work into a project, as my last web designer did into the website, it is socially awkward to take him or her off the project. If this can be done quite simply and cleanly -- if all the images and files are on the server -- it may be possible to do it without a lot of friction. If it is necessary to ask that person to provide a CD with all the files, or to upload files to the server, it will take an enormous amount of social savoir faire, an enormous amount of emotional energy. BUT dealing with agents and publishers takes up such a staggering amount of social labour, there is really nothing left for this kind of task. If the files are not on the server available for use, practically speaking everything will have to be done from scratch, all the images and files will have to be rounded up again. BUT this is a lot of work, something that is really not compatible with getting to grips with R AND writing a book. If that is what's required, moving the website will have to wait -- UNLESS, of course, one can pay someone to do the drudgery of rounding up all the material.
If you have a simple, well-defined little task, the number of people who have the relevant skills AND can do the task without a lot of oversight is very large. But if you have a task that involves doing everything from scratch, the number of people who have both the skills AND the patience to slog through, bringing the necessary attention to detail to bear, is very small. So you are not really divesting yourself of drudgery, you are taking on both a recruitment problem and a management problem. Both of these take up so much mental energy you are almost certainly better off doing the job yourself.
So, anyway. I hoped that what I had was a clean, simple little job: taking the files on the server and converting the hi-tech dead website into a lo-tech website that would see as much action as this lo-tech blog. But I didn't. My former web designer had embedded all the files in a Flash movie, so everything would have to be done from scratch. The friend who had offered to haul the website into Dreamweaver had roughly the tedium threshold of the original designer. So this was bad. The hi-tech Flash site was converted into a hi-tech Dreamweaver site, a site using CSS. But I don't want to clutter up my mind with CSS because I HAVE to get up to speed on R; the opportunity cost of wading through my Dreamweaver manual, sussing out CSS, is, of course, the amount of progress I could have made in the time with Lemon's Kickstarting R, Murrell's R Graphics usw. Poor old head. Poor old head.
I then get some e-mails from extremely fabulous Mr Ilya, the not-very-noticeably-abject Other of the Bauhaus functionalism embodied by R. I get an envelope in the post from EFMI which is one solid mass of duct tape apart from two small apertures in the duct tape where two addresses, mine and his, appear amidst the riot of adhesive. I don't really like to OPEN this thing of joy, but when I take a knife to it out come: 1. a DVD of of TELEVISION VIRTUAL FIREPLACE. Create the sensation of instant warmth! [what precisely the force of 'sensation' is in this context, of which we are told, LOOKS AND SOUNDS JUST LIKE THE REAL THING -- but Awwwwwwwwwww] Amaze your friends! Impress your loved ones! TURN YOUR TV INTO A REALISTIC FIREPLACE! and 2. several photocopies of drawings by Goya. Back in the days when EFMI was here we used to go to Sarotti, which has faux flames on an LCD behind the bar, so Awwwwwwwwwwww. And I get another e-mail about chlamydia sweeping through the koala population. And ANOTHER e-mail about EFMI hassling John Howard about numerous scandals, spreading annoyance and gene--
The friend who hauled the website into Dreamweaver has been quite unbelievably helpful and kind. I think she literally saved my life a few months ago ('literally' as in if not for this friend people would have been reading my obituary), and she has fought with the telecommunications bureaucracy on my behalf, and she is very funny and smart, and when I thought I had a simple, clean little job to do I thought I should give it to her. But when a job is not simple and clean, when a job requires the equivalent of a Guggenheim application to explain, it is very dangerous to hand it over to someone, because it will be impossible to get on with any other work -- and when the dust has settled there will be a lot of work left to be done. And as Mies said, Die Seele ist in den Details. Poor head, poor head, poor head, poor crazy head.
I think Kickstarting R is new. It says: Kickstarting R was initially compiled to help new users by requesting accounts of "... things that drove you crazy the first time you used R". Awwwwwwwwwww.