My path to Muse

Starting in the middle

My work involves doing research in atmospheric science. At one end, as input, I consider satellite and ground measurements, model outputs, weather indicators. On the other end, I’m supposed to produce scientific articles that use well-chosen visual representations of some particular subsets of the input data to propose insights into how the world works. What happens in between… is hazy.

It involves iterating a lot on data processing, exploration, and interpretation. It involves following hunches that make you obsess over a sub-sub-sub-sub-part of your input dataset that you absolutely have to understand, changing your analysis approach mid-flight, or confront parts of the data that at the start had little to do with each other. It involves showing your results to other scientists and then try to figure out answers to their questions. Most importantly, it involves plotting a lot of data, and looking in the plots for insights that keep you going, without letting you be overwhelmed by the deluge of evidence. 

This middle part of the work is tricky to navigate. At each step you have to decide what you should do next, with little solid ground to stand on, and really no clear idea of where you want to go until quite late. I’ve always had trouble knowing how to proceed. In a very practical way, what do you do? In the past, you could print out all the figures you’ve plotted, spread them all out on a biiiiiiig table, and try to make sense of it all. Nowadays, there are many times more figures, you can’t spend your days printing them all out and spreading them out everywhere.  

I had been looking for quite some time now for a software solution that would let me handle the part of the work when nothing is clearly settled, where you’re not even sure what is going on. To handle that, as I see it, an app would need to let me 1) handle mixed media – not only text, not only images, but both, at the same structure level, 2) restructure things quickly without bothering me with high levels of detail or administrative work (like dialogs or menus), and 3) organize things non-linearly. This is a big one, that needs to be unpacked.

Non-linear organization

When I’m amassing evidence for something, often it’s not clear what should be near what, what should be part of which group, what should go before what or after what. Creating these connections in a given context is thinking. Any app that forces me to decide where something should go right away, before I had time to consider which elements are present, and digest them, before I could get comfortable enough with the reasoning to formalize it, any app that does that will make me impose on myself a line of thinking that might not be the most appropriate. It also generates in me a sense of hurry, as if the software is pushing me to take decisions when I’m not ready yet. 

For instance, most writing or note-taking apps want you to order things linearly — if you put an image in a word file, this image will go before a paragraph and after another one. Same in Evernote or Apple Notes or Ulysses or what have you. If a new item relates to two or more areas, there’s not easy way to have the item close to several other things at the same time, in order to consider what is the most promising course of action. Some apps might offer the possibility of linking things together, but when you inject a new item you still need to decide (first) where it needs to go conceptually, as in, in what box should you put it. So you must decide in which group the new thing must go, and it becomes part of a group. You’ve labelled it. Too late.

The only way I’ve found to relate some things without connecting them logically or conceptually is to lay them out spatially. This way the relation is one of proximity, not of meaning. Powerpoint-like apps let you do that, but constrain you through the boundaries of the slide, and strongly encourage you to play with visual flourishes that get in the way of understanding. Powerpoint, and other apps like it, are designed to help you produce a presentation, an end product that you will hopefully present in front of an audience, and every time you use the software all its affordances remind you of that end product, of your audience, creating (again) a sense of urgency: Hurry, find what you want to say! Reordering slides (linearly), you can’t help but wonder if the audience will get your point better. But what if you don’t know yet what your point is? Then you’re just enforcing some random order, creating a fake reasoning from thin air just because that’s how the app wants you to structure your information. All “creative” apps that are geared toward an end product share this trait — they want to help you create original work but at the same time provide tools to finalize a product. This tension creates stress that, at least in me, hinders thinking. In those apps, it is very difficult, at the end of a work session, to make clear that you think this item and that item are somewhat related, and that other one too, that you’d like to investigate further this relation later, but you’re not yet sure what is going on exactly. You have to clarify the logic somehow if you want future you to understand anything when you come back to the app a few days later. So you invent some classification, some logical relationship, in urgency, that is more formalized that is warranted. Future you then uses it as basis for some new work. This reasoning, made up in urgency, orients the direction of future work.

Lately, new apps have been emerging that let you place items side-by-side on virtual whiteboards, like Scrintal, Heptabase, the canvas plugins in Obsidian or Logseq, etc. In those apps you can organize items spatially. My feeling however is that those apps focus on a totally different problem that what I’m outlining here. They encourage you to add tags and categories to items, and link everything together as if your brain were a big database. They want you to add details. This approach, which is clearly great if your goal is to organize information, classify it, and retrieve it later, requires non-insignificant administrative overhead, meaning any new item you put in the base should earn its stay there (as in the famous “evergreen notes”). I don’t feel this approach is well-suited to on-the-fly, just-in-time throwing-together of items to enable understanding.

A slow realization

So, for a long time I had been looking for an app that would help me in the middle part of the process, in situations of confusion where it is not clear what should be done and where to go. I had tried a lot of apps that allow for text/image organization, but most constrained me to a linear organization of elements, or brought too much focus on reaching some other goal (presentation, communication, organization and retrieval of information…). Muse had appeared on the scene several years ago, and was apparently aimed just at my problem, but it took me a really long time to realize that this was the app that could help me. I had to fully commit to using it for at least several months before things clicked.

What Muse does, is provide a calm space where non-rushed thinking can happen. Say I’m working on a given study, and I’m wondering what is going on in a small fraction of the input data that behaves in surprising ways. In Muse, a board can contain the current study, and within it I can always create a clean, empty sub-board that suddenly fills the entire screen1, in which I can throw every piece of evidence I have that is relevant to that sub-study. I have as much space as I need to add elements and quickly rearrange them spatially. Those are often images or tables I produced myself, or that I extracted from a scientific article in PDF, but can also be small pieces of text that can be placed wherever. I can organize them in groups and connect them with inking, making logical articulations, observations, conclusions. In very little time, I know what I can infer from the evidence I have, and I know what to do next. I can move this sub-board where it makes sense on the parent board, and annotate on top of it, making this tiny part of the study well-integrated within the larger context of the complete study, a reference I can always get back to later. If I want to work on the sub-study again tomorrow, I can create a linked card of its board, essentially a second instance of the same board, that I can place elsewhere, for instance inside my home board for quick access. On the home board, I can draw on top of this second instance, adding actionable information that is specific to that second context. When work on that sub-study is done, I delete the instance from the home board, like removing a document held by a magnet on a whiteboard, and erase the ink, like, well… erasing a whiteboard.

A new Muse board on my Mac. It’s even better full-screen (or on the iPad).

Muse checks all the boxes I’ve outlined above for the app that can handle the middle, messy part of the work. So, why did it take so long for me to realize it was what I was looking for, even while I was using it?

Amongst the many apps that exist today, Muse looks decidedly low-tech. Its number of features is quite limited and, because of that, most of what you do with it looks very rough. You can create boards that look good (the sample boards that can be glimpsed in some Muse ad videos are sometimes very beautiful), but to do so will require you to invest significant effort, more effort than in other apps you could use to get to the same board as an end result. But that’s the mistake I made. In Muse, as I now understand it, the end result is not a good-looking board, like you see in the videos. In Muse, the end result is insight. Once you get to that result, in the best of cases, you can actually throw the board away2. You might want to make some boards look nice, for instance because it’s a board you think you’ll be seeing for a while, but even if you manage to create a pretty board, then what? Your job description is not to make boards. With most apps, you can be shown examples of great creations that were done with them, and this might motivate you to use the app so you can get the same great results. I think that’s what makes it harder than it should to realize Muse’s potential. With Muse, the real output is not the board you’ve made inside the app. You can’t be shown the real output. You have to use it to see that it helps reaching insight.

Part of one of my Muse boards. A huge mess. It helps me reach clarity.

In many ways, Muse is like a paper notebook. In a notebook, you take rough notes. They don’t always look pretty. You might have some affection for them, because they are proof of your dedication, but you won’t be showing them around. It’s ok, because the value of the notes is not in the notes as a product, it is in what you’ll be using the notes for, in the insights they will reveal, the decisions they will lead to, the path of action they will enable. Muse is like that. It’s “just” a notebook — you won’t conceptually get out of it much more than what you’d get from a paper notebook — but it’s an enhanced notebook. It’s a notebook in which you can write and draw, but also paste images straight from your computer, as many as you want, and move them around, in pages that can expand a hundred times, a notebook in which a page can contain other pages, in which a page can appear at different places. A Muse board, when you look at it, as a fixed, frozen artifact, is not very different from a large piece of paper with images and text glued on. It doesn’t look professional. It’s not going to blow anyone’s socks off. But that’s not the point. Like a notebook, a Muse board is extra real estate for your mind. It’s optimized to be “just” that. It houses living, ongoing thoughts. Thoughts are not always pretty. Thoughts should lead to insights and action, and disappear. Muse provides infinite space for your thinking to happen, better than any other app I’ve found.

This post was entirely written in a Muse Board. Among other things, this allowed me to work on at least three parts of the text at once. Try to do that in Word. Now that the post is published, I’m going to trash the board.

  1. In Muse, everything is in focus mode by default. There is no other mode. ↩︎
  2. I say “in the best of cases”, because most of the time the insight you’ve hit is not the final one, so you’d better hang on to the board for later. ↩︎
Posted in Mac, Software, Technology | Tagged | Comments Off on My path to Muse

Evernote? NOW?

Back story

For longer than I can remember I have adopted the position that 1) notes should be in ASCII: universal, future-proof, small files and 2) markdown syntax should provide more than enough formatting for notes. I managed my ASCII, markdown notes through a variable set of multi-platform apps (notational velocity, simplenotes, drafts, textmate, vesper, etc.), sometimes tied through Dropbox. Most of these notes, once taken, were never modified again. Or even looked at.

In more recent years, I have felt the increasing need to intermingle words with pictures (research figures mostly). I’ve found I need this for work and thinking, iterating on projects, meeting notes, research notes, travel notes, etc. The point was to get something like a Lab Notebook. For this I have tried dropbox Paper (opaque organization), google docs (a big mess), MindMeister, Apple Notes (not so bad), Curio, Omnioutliner (etc.), and dedicated “Lab Notebook” apps like Findings. None really stuck.

structure propals au 15 mars.png

Sure, I could do this in Markdown. But I could also do it in Google sheets, insert a screenshot in a word file, and use the two hours I’ve just saved to do something else.

Onenote sideline

The app that stuck most was Onenote. The free-form aspect promised by Onenote was so conceptually seducing that I agreed to put up with its worse aspects:

  1. Onenote’s UX is very laggy (Mac/iOS). Every interaction has a huge transaction cost. Writing notes. Moving stuff around on the canvas. Moving around on the canvas. Switching notes.
  2. Sync is so slow that it discourages device-switching on the fly. Forget starting a note on the iPhone and picking it up on the Mac. At some point I had to re-authenticate every time I opened the app. Slow sync made things even worse, especially given that…
  3. Onenote’s Notebooks have to be opened and closed, like files. Because of this, there is no ‘master list’ of notes. Because of the lag, notebook switching is by itself a whole operation with several steps that I need to think through. Sometimes notebooks auto-close behind my back, and I have to hunt for them in Onedrive (which is confusing by itself).
  4. I’ve never liked Onenote’s note structure and organisation. Newest notes go down, which I find confusing. For this reason every time I create a note I feel like I need to review and revise the whole notebook organization – meaning I immerse myself in lots of information that might not be relevant to what I’m trying to do at that point. There’s very little context to notes: no easy way to find creation/update dates for notes, or sort them by dates. Everything feels very heavy and immutable.
  5. Free form is a great concept, but does not translate well to small phone screens. You end up zooming and panning around, trying to make sense of big blocks of text. Eventually you give up Onenote on iPhone, except when you have to use it reluctantly because the info you want is in there.
  6. Do you want to share something from Onenote? Well, it’s the whole notebook (sections and all) or nothing. This might be fine for sharing classroom material, not so much for meeting notes. Shared notes open in the web version of Onenote, which gets points for existing, but not for much else.
  7. It feels to me like Onenote has its own text rendering engine or something similar — text just looks different from any other app on iOS, which bothers me. I have tried lots of fonts to fix this.

Anyway, I have issues with Onenote, apparently, but I still used it because I just needed something to store text mixed with images and other stuff (PPT or docs).

Changing position

A few months ago, while thinking about this I realized what I could actually work with would be an app that let me edit word files (i.e. Formatted text+images+other) with a note app interface (master list view with, maybe, tags). But I needed to see formatted text so I could  think through it, not markdown syntax. Once I got over the shock (Word files? What have I become !?), I then found myself going back to apps I had been using years ago and since then discarded: Macjournal, Day OneDevonThink, Yojimbo, Together, etc. I had been a fervent adept of such ‘Everything buckets’ apps in the past, but only as containers of PDF, never for text I would write *myself*, because (remember) notes should be ASCII only… I was now coming back to them with fresh eyes from a revised position. Testing those apps proved the approach was what I needed. But most of these apps did not provide sync or iOS apps and were not really fun.

I ended up going all the way back to one of the first apps I’ve ever tried, i.e. Evernote. Apparently I created an Evernote account in December 2008 (6 months after it came out of private beta), but I never really used it. I had always put Evernote in the same “Everything buckets” group*, but I had always found the app weird and alien.

Screen Shot 2017-03-16 at 18.25.25.png

Most of the links still work

Evernote

After using it for a few days it quickly transpired that Evernote is just fucking great. I moved my Onenote archives to Evernote, slowly at first as I was trying to avoid going over the upload quota, then in bigger batches as I realized how great the thing was and it dawned on me I would end up getting a paid account. (My experiment happened just after the launch of the iOS v8 app, so I don’t really know how things were before that. V7 sure looked confusing though.)

I’ve found that in Evernote:

  • Note-taking is fast. Note-switching is fast (esp. with cmd-J). Note organization feels very fluid and light.
  • syncing is fast (so far) and happens without me noticing it,
  • moving notes around is fast, easy (lots of ways to do it) and low-cost,
  • search is fast and powerful, the search grammar is even better than I thought.
  • it scales well with screen size.
  • I can mix formatted text and images and whatever else.
  • Notes are OCR’ed, and very well, so your handwritten notes surprise you in search results.
  • I have a master list of all my notes front and center, and I can browse it up and down
  • without thinking about it.
  • I can add tags to notes and use the tags, which is not possible in Onenote Mac/iOS.
  • The web clipper, that until now I had considered below my contempt, impressed me: you can select areas of a webpage to save, and it shows results from your own notes when you search on Google.
  • The Evernote menu bar thingie lets you add several screenshots in the same note in succession, something I need very often. I can also right-click within a note, and select “Capture selection from screen”. Seriously, just that capability saves me tons of time.
  • You can share an individual note, a notebook or a stack of notebooks. All can get their own public web link.
  • The notes view does a good job at presenting each note as an individual object that can be acted upon, instead of a item in a list. On the Mac the card view is particularly effective. I clearly remember finding this view extremely weird in the past, things change.

Evernote has also been around for quite a while and 8-years-old notes of mine are still around. That counts for something, even if the tech world has clearly fallen out of love with Evernote.

2FC1E552-DED0-41FF-9562-6E689517DC2E.jpg

The contents of my oldest note. I wonder what’s on the other screens…

Last but not least: for some weird, mysterious reasons, I actually want to write in Evernote. I find this very strange — much better-looking apps for would-be writers never had this effect. I suspect it might be due to the text reflow, which somehow respects my expectation of how text should look and behave on every platform and screen size (not a small feat). Things in Evernote also feel very fluid to me, and I feel encouraged to move stuff around from note to note, playing with formatting to provide visual cues to myself (warning: long but good article), etc. But I don’t really know for sure why I really enjoy opening the app to write up stuff. Proof of the pudding: I have outlined, drafted, and organized this post in Evernote (with images, links and all). Maybe even more damning is the fact that I felt the impulse to write all this stuff and post it on my blog, ending a 6-years long silence.

Parting words

If you look at how the tech community reviews apps and services, it often feels like a zero-sum game in which there should be only one of each: the objective best (of course). Different approaches to reach the same goal apparently aren’t allowed to co-exist. This is not what I want to do here. Above I have focused on what I don’t like about Onenote and what I like about Evernote, but I don’t mean that Evernote is the best choice for everyone. There are a lot of strong negative opinions on Evernote on the web, often from long-time users who just might have finished a cycle when that app was appropriate for their needs and is not anymore**. Those users often mention switching to Onenote, which is the right fit for them today. The things I don’t like about Onenote might not be problems for you today, and Onenote surely has lots to recommend – multi-platform sync, elegant looks, colored tabs, paper selection, free form, 25Gb on Onedrive for free. It handles handwritten PDF annotations way better than Evernote (unfortunately), although neither can touch PDF Expert. The other apps I mentioned are good too (DevonThink nowadays has a very nice iOS companion). All have their idiosyncrasies and personality, none is perfect for everyone. Maybe one app is good for you today, and a few years down the road it’ll be another one. YMMV. It’s not a contest. We do not need to carve our choice in stone. Being able to switch between lots of apps is a good thing. Today, I use Evernote.

* Evernote is slightly different – while in most apps notes and other files (PDF, PPT, images, etc.) co-exist at the same level inside folders, in Evernote everything is a note. Other files live within notes. This is conceptually a little less clean, but has some advantages: you can use text and images to provide useful context around the files.
** lots of people also complain about syncing and slowness issues. I have not seen those so far, maybe things get worse with 1000’s of notes. We’ll see.
Posted in Technology | Comments Off on Evernote? NOW?

indefinite hiatus

As history suggests, this blog might never be updated again.

I’ll leave it open for archeological purposes, and because some posts seem to be actually useful for some people:

Take care.

Posted in Technology | Comments Off on indefinite hiatus

New in Snow Leopard: Minimize windows to App icon and Expose

dock preferences screenshot

dock preferences screenshot

Another thing I haven’t seen (yet) mentioned anywhere… In the last snow leopard build (10a394), the new “dock+expose” feature is enabled, and a new related option has appeared in the Dock preferences (see screenshot above). The checkbox label translates to “Minimize windows in the application icon”.

When you check this option, minimized windows don’t squeeze in the right side of the dock anymore; instead, they go “hide” behind the application icon. You actually don’t see the minimized windows anymore.

So how do you get to them do you ask? Well, if you have hidden ALL the opened windows for a specific application, just clicking on the app dock icon will un-minimize the last minimized window. If you already have at least one window opened for the application, this won’t work. Instead, you’ll have to use expose!

Expose with minimized windows

Expose with minimized windows

See, when the option above is activated, and you have minimized windows, Expose now divides the screen in two, with opened windows in the main top area, and minimized windows in a new bottom row. Pretty neat.

I haven’t yet found a way to minimized/unminimize windows directly from within expose (i.e. move windows between the top and bottom areas), which I could imagine would be useful. One weird thing though: if you hide an application, its minimized windows still show up in expose, the others don’t.

Posted in Technology | Tagged , , , | 6 Comments

finally

I haven’t seen this reported anywhere, and it’s not really surprising since it will affect only a minority of Mac users, but here goes:

In Snow Leopard, french locale, the “Movies” folder will be called Vidéos. Finally. At least that’s what it’s called in the 10a380 build, and I seriously hope it’s gonna stay this way from now on.

For non-french speakers, you should know that since forever (at least since 10.3) the Movies folder in the french locale was called “Séquences”. While technically correct, nobody uses this word to describe video files. Videos is much much better. This is one of the small details that always bothered me in the OS, and it’s finally gonna be fixed. Yay.

Posted in Technology | Tagged , , , , , | Comments Off on finally

My new favorite font

Anonymous. Looks good anti-aliased or not, at various sizes. Very readable, and a lot of personality – a nice change of air from Deja Vu/Inconsolata.

Posted in Technology | Tagged , | 2 Comments

Shapely

For those who just ditched Matlab for another scientific package and miss the inpolygon function, I suggest taking a look at the Shapely package. It’s full of good stuff having to do with polygons and seems interesting for any kind of GIS application. The API is very clean and its installation is totally painless if you already have the geos libs (and if you have basemap installed, you have them).

Posted in Computer, Python | Tagged | 1 Comment

NVChannel Fifo: Graphics Channel Exception… and Plex

For this first post in a long, long time, why not explain another weird problem I had with the iMac ? Yay, let’s.

During the past two weeks or so, the iMac began behaving strangely. The problems were mostly with the graphics, but after a while the system would slow down to a crawl and a reboot was needed. The problem manifested itself through the appearance of visual artefacts: mostly bits and pieces of the interface trailing behind actual windows or menus, but also horizontal lines in Safari or the Finder, or in the worst case entire parts of windows obscured by colored blocks. Once, I exited Firefox but its window stayed on-screen like nothing happened – I had to “erase” the window myself by using a Finder window as some kind of screen wiper. The easiest way to trigger this bug seemed to repeatedly open and close stacks in the Dock: sometimes the stack would appear only half-opened. Dock icons would also become corrupted after a while.

At first, I feared some kind of hardware failure, but I soon found out that after a reboot all these problems disappeared. Everything was working fine and dandy again, no video glitches. I thought it might come from overheating: nope, the temperature was below 50°C all this time, and problems sometimes occurred just as the computer was coming out of sleep (“waking up”, I guess).

A trip to the console enlightened me: the system.log for previous days was filled to the brim with entries more or less like

kernel[0]: NVChannel(GL): Graphics channel exception! status = 0xffff

kernel[0]: NVChannel(GL): Graphics channel timeout!

kernel[0]: NVChannel(GL): Graphics channel exception! status = 0xffff info32 = 0x3 = Fifo: Unknown Method Error

… and so on. I googled the problem, and eventually ended up on this seemingly neverending thread on the Apple Forums. In it, people alternatively blame Leopard 10.5.1, World of Warcraft, the Leopard Graphics Update, Aperture, Google Earth, any software that tries to use OpenGL, etc. I tried panning and zooming like crazy in Google Earth for a while, but no problem whatsoever — this was not it. But it led me in the good direction: video-intensive applications.

What video-intensive application do I use on a regular basis? I don’t play games, I run iPhoto once in a while… but every other day I end up watching a movie using Plex (not too hard to guess if you read the title of this post). So I kept Console opened in the background, launched Plex in windowed mode, opened a movie… and behold! Tons of graphics channel exceptions! Ha-ha!

Needless to say, I trashed Plex and its LaunchAgent right away. I’m pretty sure the issue only arised because I had tinkered with an option I shouldn’t have on my particular hardware; Plex is otherwise a pretty nice piece of software. The weird part is that I replaced Plex with XBMC (which is basically the same thing but less Mac-focused), and there was no Graphics channel exception to be seen. After switching to the MediaStream skin, it was as if nothing had ever happened. Without the graphical problems.

Maybe next time, I’ll write something more interesting, like how the Sarkozy government is slowly dismantling the research structures around here with the help of the AERES, creating inequalities between teaching positions to increase competition and handing  the control of universities to the private sector, all imposed from above, without concertation with the people who do the actual work, by a minister with strong ties to big corporations. Maybe.

Posted in Apple, Computer, Mac | 2 Comments

Enthought Python Distribution, now with basemap

A new beta 2 of the Enthought Python Distribution has been released. It includes updates to the latest versions of wxPython (2.8.7.1), VTK (5.2), IPython (0.9.1), matplotlib (0.98.3), ETS (3.0.2) and some other stuff. It looks like NumPy is still at 1.1.1 though – I guess NumPy 1.2 will appear in the final EPD release as it is almost ready to roll. Still no netcdf4-python, though.

Another nice unpublicized thing in this release, that is only mentioned in the release notes, is the addition of basemap (a nice mapping toolbox for matplotlib), which provides plotting functions I use a lot.

With previous EPD releases I always had to reinstall or upgrade one package or another, but now everything I need to work is there out-of-the-box, in the latest version for important packages. It’s a pretty impressive accomplishment, given how difficult it was to get a coherent “Scientific Python” stack as early as a year ago. The future is looking good for Python as a scientific toolbox.

Posted in Python, Technology | Tagged , , , | 1 Comment

Python in Science proceedings

The proceedings for Scipy2008 (ie the 7th Python in Science conference) are now online. It would be worth mentioning for the State of Scipy article alone, but there’s tons of nifty up-to-date information there, which is hard to get otherwise (or has to be inferred by delving into mailing archives).

Maybe even better: the slides are up too.

Posted in Python, Technology | Tagged , , | Comments Off on Python in Science proceedings