The Sound of Temporal Networks

I recently gave a talk at the Complexity, Aesthetics, and Sonification workshop in Bielefeld, Germany, organized by Thilo Gross, Maximilian Schich, and Cristián Huepe. A really great workshop with lots of different points of view from art to science!

For the talk, I did a bit of exploration in representing temporal networks with sounds. As those who have dabbled with temporal networks know, visualizing them is very difficult, as they live in time instead of space. But so do sounds. Let’s hear what temporal networks sound like, then!

So what was that? That was one month’s worth of data on students’ phone calls from the Copenhagen experiment, compressed into 13 seconds. I took 10 random students and assigned each their own random pitch so that a sound is played every time the student makes a call. I then turned the time series into MIDI which was fed into one of the synthesizers of Apple’s Logic Pro X.

For such a simple and straightforward exercise, there’s a surprising amount of information in the sonification. If you are into temporal networks, you can hear several familiar patterns: there is a daily cycle, weekdays are different from weekends, and there’s also burstiness.

Let’s continue listening to these data. The Copenhagen data set contains metadata on text messages as well, so let’s pick one of the students and listen to their egonets — everyone they call or text will get their own pitch, so that, e.g., one friend is always C (on some octave). Then we’ll feed the calls into a sampler with piano sounds and the texts into another with sampled upright bass.

Quite jazzy, isn’t it? And, again, one can pick up a lot of information here. The daily cycle and the burstiness are still there — and there are even some repeated patterns, parts of temporal motifs. There is also a finding that had escaped my attention earlier — at around the middle of the timeline, there is a cluster of notes being played on the piano, as the student makes a large number of calls in a short period of time. This pattern is, in fact, present in several other students’ timelines at the very same time.

Now let’s have a bit of fun with probing the network with random walkers. I use greedy walkers — a random walker is placed on a node (student), and when the student makes a phone call, the walker moves on to the student being called, and so on. Every newly visited student gets their own pitch that is one semitone higher; when the pitch goes down during the process, this means that the walker is visiting nodes that were already visited. Let’s hear one walk, starting from a random node:

The walker explores a larger subnetwork around the starting point, sometimes backtracking, before escaping off. Now let’s hear another walk:

Quite different, right? This walker has literally become stuck in a neighbourhood of a few students who only keep calling one another and the walker cannot escape. So the social neighbourhoods of these two students are quite different indeed!

Finally, for something entirely different — the sound of criticality. This is simulated (by my student Sara Laurila): what we have is the SIS (Susceptible-Infectious-Susceptible) model on a N=50000 node network, parametrized exactly at criticality — on the boundary between two phases where in one, all activity dies out and in the other, there is persistent activity. (In the model, nodes are S until they are in contact with an I, then they become I and make others I too, until they revert back to being S, to become I again at some point in the future. So this excitement (I) propagates through the network).

In the sonification below, I again use a random sample of sentinel nodes, each assigned their own random pitch. The nodes make a sound whenever they turn I, i.e., whenever the wave of excitation hits them. Here’s what criticality sounds like:

Here’s the same but with drum sounds instead. Sounds like Zappa, but without intention or direction, as a drummer friend of mine remarked.

And finally, criticality from the point of view of one single sentinel node:

Apply Now to Our Master’s Programme in Life Science Technologies!

Our popular Master’s programme in Life Science Technologies at Aalto University, Finland has a major in Complex Systems! The major includes a lot of network science taught by top scientists in the field — yours truly, Mikko Kivelä, and Petter Holme. You’ll also learn some Python programming, data science, machine learning, and nonlinear dynamics — or, if you wish, you can choose a more maths-heavy subset of courses, or combine your studies with, e.g., human neuroscience.

This major has very tight connections to research, and many students have continued toward their doctoral degrees after receiving their M.Sc. Another very popular and successful career path has been that of an industrial data scientist or consultant, e.g., in the health industry. There is a lot of demand for these in the Finnish job market, so a Master’s degree in Life Science Technologies is a great investment in your future.

The application period is open only until 2 Jan 2024, 3:00 PM GMT+2 so be quick & apply now!

Season’s Grant-Writing Tips, Part 2/2

A very, very AI-generated image where money falls down like snow.

In the first part of this grant-writing mini-series, we learned the fundamental secret of grant-writing (and, in fact, any writing): everything revolves around the reader. The only purpose of a grant proposal is to make it easy for the reviewer to recommend funding.

Let’s break that statement down. For the reviewer to recommend funding, she has to feel that what you aim to do is important, novel, and feasible, and that you are exactly the right person/team to do this. In more touchy-feely terms, the reviewer has to like the proposal. And you.

As we discussed in the previous post, this is much more likely to happen if the proposal doesn’t make the reviewer work too hard: it should be focused, clearly written, and provide clear answers to the questions the reviewer must address.

To help with the above, we’ll now address writing at the level of paragraphs and sentences, borrowing some tricks from professional copywriters who craft advertising text. These techniques not only involve gently manipulating the reader—all writing is about manipulating the reader!—but also aim to ensure that the text flows. An ad where the reader gets lost or bored is a failed ad.

Let’s begin at the beginning because it is the most important place. In any writing, the first sentence and the first few words have enormous power—”Call me Ishmael”—and you should tap into this power. This is because they prime the reader’s mind for what is to come. They also set the general mood. Begin your proposal with a few strong sentences that almost win the grant! These sentences should summarize your plan and its impact: why is it important to do the things you plan to do? Why are you in a unique position to do this? If your grant is funded, how will the world become a much better place?

This mini-summary serves a dual purpose in priming the reader. Firstly, on an emotional level, the reviewer should feel excited – “This sounds like a great proposal!” If you achieve this, the reviewer will have a positive bias from the very beginning. However, with a weak or muddled beginning, you’ll need to work hard to win them over. Secondly, it is much easier for the reviewer to follow the text when they know where it is going — easier in terms of both comprehension and how reading the text feels (these two are, in fact, the same).

There is another place of power: endings. The power of endings is different from that of beginnings: whereas beginnings prime the reader, the endings are what the reader remembers. This is because between paragraphs and between sections there is a break in reading, where the stream of input to the reader’s brain temporarily ceases. This leaves more space for whatever the last input was to echo around in the reader’s head.

Saving important bits to the end is a common copywriter trick—ever seen an ad with “click here to buy” in the middle?

However, this trick works best for short sections and well-written text. If you lose your readers along the way, they won’t reach the end. Remember the overworked, sleep-deprived reviewer from the last post? She might be tempted to just skim, you know. To mitigate this risk, write short paragraphs ensuring that the reader makes it through to their end—and write them well. For section endings, a strong recap sentence — perhaps as a separate paragraph—can do wonders. “In summary, my research can be expected to have an enormous impact, because…”

We’ve now covered beginnings and endings. What is left is how to get from the former to the latter. Here, a copywriter’s trick is to understand that while the sentences must deliver information — including enough details of your research plan to judge its feasibility, etc — their task is also to propel the reader forward. In ad copy, the primary task of every sentence is to make the reader read the next!

This means that the sentences should seamlessly flow into one another, which is a general sign of good writing regardless of the genre. This is particularly important for information-dense grant proposals: information is much, much easier to absorb through a narrative than when it is presented as disconnected bits and pieces. The narrative is what keeps the reader going: as humans, we’ve enjoyed stories since the dawn of man, singing around campfires.

For a grant, the narrative is particularly important for sections prone to being dense, taxing, and boring—imagine the sleep-deprived reviewer having to wade through 25 poorly written state-of-the-art sections! This is especially crucial if the section is at the proposal’s beginning, as state-of-the-art sections often are. So next time when writing one, consider the reviewer, and instead of just listing references, write a story of how your field of science has evolved to the point where you can both ask and answer your research question.

Finally, as I mentioned in the previous post, there is one spot in the proposal where you can be slightly difficult to understand on purpose, in particular, if the reviewer is not really in your (sub)field and your proposal involves theory/maths/data analysis/similar.

This is in the methods section, or whatever the section where you describe what you are going to do is called. Whereas the research question and its importance should be written with absolute clarity so that everyone can understand them, here you can show off a bit. The point is to give the impression that you really know your stuff. Even though your proposal should generally be as free of jargon as humanly possible, it doesn’t hurt to have one strategically placed sentence where you flex your claws, show that you can devour your field’s most complicated concepts for breakfast, and instill a bit of fear and awe in the reviewer. Then you can be all nice again, and wait for the gifts to arrive.

I wish you merry grant-writing!

Season’s Grant-Writing Tips, Part 1/2

Grant money falling like snow (a very, very AI-generated image, by craiyon.com)

It is grant-writing season here in snowy Finland, and to keep away from the actual work, I thought I’d write a couple of posts on grant-writing tips. Today we’ll be all nice, but in the next episode, we’ll get a bit naughty because that might in the end bring us more gifts. Ho ho ho.

Let’s start at the very beginning. When writing a grant, the most important thing for you to understand is what is going through the heads of your target audience—the reviewers. You are writing the grant to persuade them to recommend you to get funded. Your one and only task is to make this as easy as possible for them.

This simple rule — to make it as easy as possible for the reviewers to recommend funding the proposal — gives rise to many corollaries.

To arrive at those, consider the situation that the reviewers find themselves in. It is very rare to get a single proposal to review that is spot on in the reviewer’s own subfield. What is more common is that there is a large pile of proposals on the reviewer’s desk, they are almost but not entirely off-topic, the deadline was last week, the reviewer has barely slept because the kids are sick, and even the coffee has gotten cold.

In this situation, the reviewer will be very, very grateful if you make her task easier.

This means, among others, that a) the proposal must be easy to understand, even to a non-expert, b) the proposal’s value and level of ambition must be immediately visible, c) the proposal must contain direct answers to the questions that the reviewer has to answer, and d) the proposal must not contain any more stuff than is necessary to convince the reviewer.

The first corollary requires that you’ve actually given your research plan enough thought so that you can understand it yourself—in other words, you must know what you are doing. It helps a lot to have a clear focus: it is a common beginner’s mistake to try to squeeze all your ideas into one proposal, which then reads like a confusing superposition of several muddled research plans. Focus on a single topic and your best idea to avoid confusing the reviewers because otherwise, they won’t know which of your parallel plans they should be rating. Confused people are rarely happy people, and only happy people give top ratings!

Being easy to understand also means well-written: reading a good grant proposal shouldn’t feel taxing. Avoid jargon and complicated sentences; always err on the side of simplicity. Also, your proposal should not read like lecture notes because the proposal is not about teaching the reviewers. Nothing is as annoying as being lectured to if you only want to get your reviews done!

The proposal should contain enough information to convince the reviewers of how and why you plan to do what you plan to do, but no more than that. Again, think of the poor reviewer who has 20 proposals on her desk: do you think that she is happy to try to become an expert in 20 new topics by reading about a metric ton of intricate details under heavy time pressure, with cold coffee and cranky kids demanding attention? I don’t think so.

That being said, there is one spot in the proposal where you can be a bit difficult to understand on purpose, but let’s leave that for the next part of this series.

Being easy to understand also means no bulls*it: no fluff or fancy-sounding, big words that mean nothing. For god’s sake, no ChatGPT-produced text because it is full of the above, unless you really, really know how to use it. Write the text yourself. Write concisely, simply, and powerfully. Write like you mean it.

The second corollary demands that you make your case clear directly and very early on. Here, my suggestion is to start with a summary paragraph that is almost enough to win the grant for you. More about this later.

The third corollary — the proposal must contain direct answers to the questions that the reviewers have to answer — is hugely important as well. This requires you to do a bit of reconnaissance: the reviewer guidelines and/or review forms of many grant agencies are public. Get them. Study them. Learn them by heart. Find out what specific questions the reviewers are asked, and make sure that your text contains copy-pasteable answers to each, preferably well-highlighted (in italics, or so), so that in a hurry, the reviewers can recycle your text in their statement. Make sure that your answers are winners and that it is easy for the reviewer to give them full points.

Lastly, clarity and readability are often in direct conflict with the amount of stuff in a proposal. Again, a common beginner’s mistake is to cram in as much text as possible, fiddling with the margins or font sizes and using stamp-sized figures, etc. In contrast, the pros choose what elements to include and then focus on those, leaving enough white space and room to breathe. Don’t make the reviewers choke on the amount of stuff they have to ingest! Focus on what matters. Quality instead of quantity.

That’s all for today. In the next episode, we’ll put on our black hats and talk about some Jedi mind tricks, stolen from the evil folks who write ad copy that makes you buy stuff that you don’t need. Stay tuned!

Are you new around here?

Notebooks and a pencil

As there has recently been a surge of visitors coming from Moodles and other learning platforms, I thought I’d say hi — hello there!! — to everyone who is new to this blog, and provide some guidance in the form of a table of contents of sorts.

So, where have you landed at? This is a blog by me, where me = Jari Saramäki, an interdisciplinary physicist and a professor at Aalto University, Finland, dabbling in network science and other complexities, and a big fan of lucid writing. Also, a bass guitar player, because someone has to be.

The blog contains things that students have found useful (which may be why you are here), in particular, advice on how to write scientific papers and how to develop your scientific writing skills:

Welcome again, and I hope you’ll find something in this blog that is either useful or entertaining, or both!

The abstract as a tool for better thinking

Having recently spent considerable time writing abstracts for some papers-in-the-making, I thought I’d share another post on the topic, even though it has been heavily featured on this blog before.

As you may already know, I advocate for writing the abstract before the rest of the paper, contrary to what is advised by some writing guides, e.g., this one (thanks Riitta H for the tip). Why?

To me, writing the abstract is, first and foremost, an exercise in thinking, to the extent that the written abstract itself can feel almost like a byproduct.

This exercise is all about clearly understanding what the paper is about: what the research question being asked is, why it is being asked, what the outcome is, and why should someone be interested in it.

While most of these questions may have been answered when the research was designed – e.g., you don’t build an expensive experimental setup without knowing why and what for – this is not always the case. Sometimes the data lead to unexpected directions, rendering the initial question obsolete. More often than not, your perspective shifts along the way: the initial question becomes something larger or morphs into something else. But what exactly?

To figure this out, you’ll need to give the abstract a go before even considering the rest of the paper. So, how to write the abstract of a research paper? As those who have read my book or attended my writing lectures know, the abstract template that I recommend is the same as the one used by Nature. Not because it’s Nature, but because it does exactly what it should: it forces you to think clearly.

In plain language, the abstract template goes like this (sorry, Nature, for this abuse):

  1. There is an important phenomenon/topic/something.
  2. But within it, there are unknowns that need to be sorted out for achieving X.
  3. In particular, we don’t know Y, because of something that was missing until now.
  4. Here we solve the problem of Y using a clever method/experimental design/something.
  5. We discover Z, which is surprising for some reasons.
  6. Knowing Z advances our scientific field like this.
  7. More broadly, understanding Z makes the world a better place in this way.

This template helps you refine your story and the point of your paper and serves as an acid test: if you cannot write the abstract, you are not ready to write the paper. It also ruthlessly exposes any gaps in your thinking, which is excellent because it’s a template, not Reviewer #2 who gleefully rejects your paper from the journal and taunts you in the process.

Writing the abstract first using the above template helps you improve your paper on your own before it is even written (which is optimal, isn’t it).

In fact, I often try to formulate a mock abstract that follows the template during the very early stages of a research project, often well before the final results materialize. I find that this helps to understand where the project is going, and what might still be required. If I feel confused [narrator’s voice: which happens very frequently], the template sometimes shows the way.

Slides for my NetPLACE@NetSci2023 talk

It was a great pleasure to give a short keynote on writing in Vienna (in a hall with the above text on the wall)! My slides for the talk can be accessed here.

The whole NetSci conference was excellent and it was great to meet many friends and colleagues after so many years. A great many thanks to the organizers!

On scientific writing in the age of AI, part 2: A thought experiment

In the spirit of my post last week, let us continue figuring out the role of AI in scientific writing through a Gedankenexperiment. Where we left off was the use of AI as an assistant — a virtual editor if you’d like — to suggest improvements to one’s text, instead of churning out autogenerated content. Think Grammarly++, or similar. This is, at least to me, perfectly fine. However, I would appreciate it if the text still retains its voice and human touch, lest everything sound exactly the same.

Now, fast forward to the future. If people still write science 25 years from now, how will they use AI tools? What are those tools capable of?

Here is where I feel science — at least natural science — might diverge from more creative forms of writing, as the purpose of written science is ultimately to transmit information. It might even become desirable to have AI write up our results.

Consider the following: suppose that I have carried out an experiment and want to write a paper on its results. I feed my plots, maybe together with a few lines of text about background, impact, etc, to my virtual writing assistant, and off it goes, returning with a complete manuscript. As my virtual assistant has been taught to write in my voice, the manuscript actually sounds like me. I read the manuscript and find that it is factually correct, and submit it to a journal.

Now, if the information in this paper is factually correct and it is written in a way that is appreciated by human readers, how should we feel about this? Is this ethical or unethical? Is this a future we’d like to see or not?

For this to be ethical, it should be done openly and the use of AI acknowledged. Which is of course very easy to do. Maybe this will be common: maybe most papers will be written by AIs that have been fed with original research results.

Beyond ethics, is this good or bad? That, I guess, depends. If all papers sound the same, it is bad. But what if the papers are indistinguishable from human writing, considering that everyone trains their own AI to write in their voice? What might be lost here is the finesse of argumentation, nuances, deep thoughts, and all those things that make famous writers/academics famous. On the other hand, perhaps this loss would be compensated by far fewer crappy, incomprehensible papers… just maybe.

It may also be that written scientific papers will become obsolete, or at least obsolete as stand-alone products (this is already happening with all the Jupyter notebooks and SI data sets and so on). There are also already now paper formats in some fields (e.g., biomedicine) that leave very little room for creative writing—these are mostly just data containers.

Perhaps scientific papers will in the end not be structured for human readers, but for other AIs that can then better pick up their arguments to propose new theories, experiments, and so on — in other words, replace us, scientists. But I have my doubts on this, as I at least hope that science requires creativity that is beyond mere statistics of words. Let us hope that humans can still out-weird AIs in the years to come (is that even a word)!

To be still continued, I think…

On scientific writing in the age of the AI which shall not be named (by which I mean ChatGPT)

Disclaimer: this post will probably not age well. Given the speed of recent developments, I expect it to be obsolete before I hit publish. Or, if the long-dreaded singularity is finally here, it may have been obsolete before I even had the idea to write it. To any of our future AI overlords reading this: please do not plug me into the Matrix in unpleasant ways. No AIs were harmed in writing this text! I just did a few experiments, is all…

But I digress. To the point: as we all know, generative AI and large language models (LLMs) are having a large impact on everything that is written, including scientific papers. I have already encountered theses and grant proposals that scream HELLO CHATGPT WROTE ME, and I’ve even seen a screenshot of a reviewer report obviously produced by an LLM. So, are we doomed?

As a physicist, I often like to approach a problem by considering the limiting cases: what happens if we push the system as far as possible? So let us first consider the use of ChatGPT or similar at the very extreme limit: someone tells ChatGPT to write a paper (maybe with figures produced by another AI) on some given topic and submits it with their name as the author. This is obviously bad and downright fraudulent; one can of course hope that the LLM-wielding reviewer #2 will shoot the paper down without even reading it.

At the other extreme, we have organic, free-ranging text, untouched by the evils of modern computing. Or do we? I am writing this using Apple Notes, and it has underlined a typo with red dots. Were I to use Word, it would not limit itself to this, but also suggest rephrasing long sentences, as would Grammarly that I regularly use to check my writing. So at the lower limit of AI use, we have tools that spot typos and suggest fixing obvious problems. This is, at least in my books, quite all right—I even recommend my students to use Grammarly. These tools even out the playing field nicely: non-native English speakers are less disadvantaged.

Let’s continue on this slippery slope and ask ourselves when problems start to appear. Here, things get blurry rather quickly, as exemplified below:

>Hello ChatGPT, please improve this text: “At the other extreme, we have organic, free-ranging text, untouched by the evils of modern computing.”

>“Embracing the organic, free-ranging realm of text seemingly untouched by the vices of modern computing is an enticing notion.”

I am left somewhat speechless here. Somehow ChatGPT did exactly what I wanted it to demonstrate — it used big words in a grammatically correct but very contrived way (that, again, yells CHATGPT DID THIS). Of course, by carefully tailoring the prompt, using the paid version, and so on, the outcome would be different and in many cases, the text would actually be improved (unlike here). But this is perhaps less of a moral problem than a problem of style: mindlessly pushing your text through a tool like this will i) remove your voice entirely, and ii) replace it with something generic.

Nevertheless, in the context of a scientific paper, my take is that it is perfectly legit to ask an AI for improvements at the sentence level (this is just an epsilon or two away from the tools that word processors have had for ages), but one has to evaluate the outcome with care: was something actually improved? Was something lost in translation? Is the AI-generated version easier and more pleasant to read? Would it obviously stand out as not having been written by you? (Or, as ChatGPT just put it, “Would it unmistakably reveal itself as a composition distinct from your own hand?” I cannot stop laughing and/or crying.)

Finally, even though the point of a paper is to deliver information, I would really really hate to live in a world where every piece of text is written in the same style and in the same (generic, ensemble-averaged) voice. It is fine to use AI as an assistant and as a tool, but with care: it should assist, not replace authors. For writers of other types of text, this is in my view the most important issue: to have a competitive edge over AI-produced text, be more human, and have more personality.

To be continued…

Slides for my CCS warm-up presentation

The young researchers in Complex Systems Society (yrCSS) invited me to talk on scientific writing at Palma de Mallorca on October 15, 2022. It was really great to speak to an active & interested audience!

Here are the slides — I hope you find them helpful!

There is a video recording of the whole talk as well, available on YouTube. Go check it out.