A Patrick O'Brian Atlas

After I finished my atlas of all the Patrick O'Brian novels I thought it might be cool to see all the courses I plotted on a single world map. I am working on an Apple MacOS screensaver to animate the maps, but in the meantime, here is a rendering of all the voyages.

You can click on the image for a higher resolution view.

If you are wondering about the occasional breaks in the course lines? They are a result of sections of the story where I couldn't guess where Jack and Stephen ended up. In those cases I pick up their location again once I had a fair weather observation.

Permalink - Comments - Tags: Patrick O'Brian

Bundle.main.path forResource will return nil in a MacOS screen saver

I thought it might be worth writing a quick post on something that had me stuck building a screen saver for MacOS in Swift.

If you have a file you include in your build target (like a SQLite database of map tiles) and need to open that file you might try something like this:

Because I am debugging my application in a regular MacOS app (that just shows my ScreenSaverView) this code worked fine when I was debugging. As soon as I built and deployed the actual screen saver bundle everything broke.

So at that point you might spend quite a bit of time trying to debug entirely unrelated tile loading code before realising that bundle.main.path forResource was returning nil, but only in the screen saver application.

The reasons for this is that MacOS screen savers are bundles loaded by the system screen saver application, so the path you get will be something like:

So to get this to work (in both the test app and the screen saver app) you need to get the bundle via a class in that bundle:

I am just using the ScreenSaverView class which works fine.

This all took a little longer than it should have to find because, this being my first MacOS app, I wasn't sure where debug logging was ending up. Turns out it all appears in the Mac Console application ("Console" in Spotlight). I also struggled a bit because the Console app, or something in the MacOS logging framework was making decisions about the sensitivity of variables I was logging. So logging something like this:

Ends up in the logs like this "Location was ---> " which isn't very helpful. To tell the logging framework that you want to see those variables you can supply it to the format string:

Permalink - Comments - Tags: Development, Swift

All This Started Four Years Ago - By a Special Correspondent

This article by "A Special Correspondent" was in my grandfather's papers, along with other letters written at the time on what I believe is the same typewriter (something I'd love to be able to confirm). I haven't been able to find this text elsewhere so I am publishing it here.

Chilling given the recent resurgence of Nationalist rhetoric.

Permalink - Comments - Tags: World War Two,Misc

Aggregate deeply nested JSONField data in Django

I ran across this problem the other day and it seems there aren't useful answers on this particular issue.

A combination of Django and Postgres makes it very easy to persist JSON data in your models. I think generally when building an application data schema storing JSON data is usually a bad idea. In fact this post and its partial solution is an example of issues you can have expecting JSON fields to behave predictably (in ORM terms).

In this case I wanted to store responses from a third party API and didn't think I would need to query data in those responses (hence no formal schema for the values within). Of course a requirement eventuated that required querying and then aggregation on values in the JSON I was storing and that is where I hit the problem described below.

(N.B. As I write this, with some hindsight, I think the correct solution is actually to migrate the values out of the JSON and store them in dedicated fields in the model, but anyway).

So if you want to filter by deeply nested values in a JSONField that part is fine. It actually works nicely with query_set syntax that matches doing joins across reverse relationships or foreign keys.

class ThingResponse(TimeStampedModel):
user = models.ForeignKey(User, on_delete=models.PROTECT, related_name="thing_responses")
    data = JSONField(_('The actual response from thing'))

If an example data looks like:

{
  "house": {
    "name": "Lannister",
    "seat": "Casterly Rock",
    "scion": "Tywin",
    "heir": "Jaime",
    "chapter_introduced": 5
  },
  "name" : "Tyrion Lannister",
  "age" : 24
}

and you want to find all the Lannisters, you could write a queryset like this:

ThingResponse.objects.filter(data__house__name="Lannister")

Things get tricky when you want to aggregate data in the JSONField. Aggregating on a value at the top level is fine (as described in this SO answer):

from django.db.models.functions import Cast
from django.db.models import Min, IntegerField
from django.contrib.postgres.fields.jsonb import KeyTextTransform

ThingResponse.objects.annotate(age_value=Cast(KeyTextTransform('age', 'data'), IntegerField())).aggregate(Min('age_value'))

You can annotate the queryset with nested values by nesting the KeyTextTransform like this:

ThingResponse.objects.annotate(chapter=Cast(KeyTextTransform('chapter_introduced', KeyTextTransform('house', 'data')), IntegerField()))

So this works fine and will annotate your result with a 'chapter' property with the nested value in it. Problem happens when you try and aggregate on that nested value:

ThingResponse.objects.annotate(chapter=Cast(KeyTextTransform('chapter_introduced', KeyTextTransform('house', 'data')), IntegerField())).aggregate(Min('chapter_introduced'))

You'll get an error like this:

File "[env path]/lib/python3.6/site-packages/django/db/models/sql/compiler.py", line 128, in get_group_by if (sql, tuple(params)) not in seen: TypeError: unhashable type: 'list'

I think what is happening here is the KeyTextTransform hasn't been resolved by this time so instead of a value it is getting a list of arguments.

So this is as far as I got with this and ended up implementing the aggregation in memory. If you do have a similar issue and find a solution to the issue with aggregating on nested JSON values I would love to hear from you.

Permalink - Comments - Tags: Development

Writing Great Fiction - Lecture Three Exercise

The writing for this lecture was to take the styles in the following three novels and apply them to a passage from the others:

• - The Great Gatsby - First person account.
• - Mrs Dalloway - Third person stream of consciousness.
• - The Maltese Falcon - Third person, literal observation.

“Now, don’t think my opinion on these matters is final,” he seemed to say, “just because I’m stronger and more of a man than you are.” We were in the same senior society, and while we were never intimate I always had the impression that he approved of me and wanted me to like him with some harsh, defiant wistfulness of his own.

We talked for a few minutes on the sunny porch.

“I’ve got a nice place here,” he said, his eyes flashing about restlessly.

Turning me around by one arm, he moved a broad flat hand along the front vista, including in its sweep a sunken Italian garden, a half acre of deep, pungent roses, and a snub-nosed motor-boat that bumped the tide offshore.

“It belonged to Demaine, the oil man.” He turned me around again, politely and abruptly. “We’ll go inside.”

“I’ve got a nice place here,” Tom said as his eyes enumerated each feature of garden, lawn and shore, pleased how the magnificent view was presented in the afternoon glow. He liked to impress his guests, but wondered at his eagerness for the admiration of this particular man. Nick was unimpressive in almost every way, at least in Tom's estimation, and yet he found he valued his company, perhaps even his friendship?

Nick watched the restless display with some comprehension and allowed himself to be guided, not impolitely, though certainly forcefully, through a conversation on the virtues of Tom's domain.

Tom, satisfied he had established his preemminance, abruptly turned and guided the two of them inside.

"It belonged to Demaine, the oil man." Tom said before passing into the high ceilinged hallway. Nick assumed he should know who that was and nodded.

My second attempt was taking the third person stream of consciousness of Mrs Dalloway and attempting the impersonal third person literal style from the Maltese Falcon:

She would have been, in the first place, dark like Lady Bexborough, with a skin of crumpled leather and beautiful eyes. She would have been, like Lady Bexborough, slow and stately; rather large; interested in politics like a man; with a country house; very dignified, very sincere. Instead of which she had a narrow pea-stick figure; a ridiculous little face, beaked like a bird's. That she held herself well was true; and had nice hands and feet; and dressed well, considering that she spent little. But often now this body she wore (she stopped to look at a Dutch picture), this body, with all its capacities, seemed nothing--nothing at all. She had the oddest sense of being herself invisible; unseen; unknown; there being no more marrying, no more having of children now, but only this astonishing and rather solemn progress with the rest of them, up Bond Street, this being Mrs. Dalloway; not even Clarissa any more; this being Mrs. Richard Dalloway.

Bond Street fascinated her; Bond Street early in the morning in the season; its flags flying; its shops; no splash; no glitter; one roll of tweed in the shop where her father had bought his suits for fifty years; a few pearls; salmon on an iceblock.

"That is all," she said, looking at the fishmonger's. "That is all," she repeated, pausing for a moment at the window of a glove shop where, before the War, you could buy almost perfect gloves. And her old Uncle William used to say a lady is known by her shoes and her gloves. He had turned on his bed one morning in the middle of the War. He had said, "I have had enough." Gloves and shoes; she had a passion for gloves; but her own daughter, her Elizabeth, cared not a straw for either of them.

Not a straw, she thought, going on up Bond Street to a shop where they kept flowers for her when she gave a party. Elizabeth really cared for her dog most of all.

A thin, dignified woman moved from shopfront to shopfront along Bond Street. The grandure of the flags that adorned each was not reflected in the shops themselves. The lady, for that is clearly what she was, upright and deliberate as she moved up the street, considered a roll of tailor's tweed as she passed. Despite her careful manner she was clearly enjoying herself, her pointed face moving quickly to take in each modest display.

Glancing from the fishmongers, with its forlone salmon presented on a block of ice, towards a glove shop. She paused and looked, slightly wistful, on the pitiful spread of gloves, much diminished after four years of war. Her composure seemed to slip and she muttered to herself 'That is all ... that is all', barely audible over the noise of the street.

Permalink - Comments - Tags: Stories

[First Page] [Prev] Showing page 2 of 40 pages [Next] [Last Page]