Entries in Oct, 2023

Filters: Type: entry × Year: 2023 × Month: Oct × Sorted by date

8 results

DALL-E 3, GPT4All, PMTiles, sqlite-migrate, datasette-edit-schema

I wrote a lot this week. I also did some fun research into new options for self-hosting vector maps and pushed out several new releases of plugins.

[... 1362 words]

11:59 pm / 30th October 2023 / mapping, projects, weeknotes, sqliteutils, llm

Now add a walrus: Prompt engineering in DALL‑E 3

Last year I wrote about my initial experiments with DALL-E 2, OpenAI’s image generation model. I’ve been having an absurd amount of fun playing with its sequel, DALL-E 3 recently. Here are some notes, including a peek under the hood and some notes on the leaked system prompt.

[... 3505 words]

9:11 pm / 26th October 2023 / ai, openai, dalle, promptengineering, promptinjection, generativeai, chatgpt, llms

Execute Jina embeddings with a CLI using llm-embed-jina

Berlin-based Jina AI just released a new family of embedding models, boasting that they are the “world’s first open-source 8K text embedding model” and that they rival OpenAI’s text-embedding-ada-002 in quality.

[... 1392 words]

3:47 am / 26th October 2023 / plugins, projects, ai, embeddings, llm

Embeddings: What they are and why they matter

Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon.

[... 5835 words]

1:36 pm / 23rd October 2023 / ai, generativeai, embeddings, llm, annotatedtalks, rag

Weeknotes: PyBay, AI Engineer Summit, Datasette metadata and JavaScript plugins

I’ve had a bit of a slow two weeks in terms of building things and writing code, thanks mainly to a couple of conference appearances. I did review and land a couple of major contributions to Datasette though.

[... 564 words]

9:32 pm / 22nd October 2023 / datasette, weeknotes

Open questions for AI engineering

Last week I gave the closing keynote at the AI Engineer Summit in San Francisco. I was asked by the organizers to both summarize the conference, summarize the last year of activity in the space and give the audience something to think about by posing some open questions for them to take home.

[... 6928 words]

2:18 pm / 17th October 2023 / talks, ai, generativeai, llms, llm, annotatedtalks

Multi-modal prompt injection image attacks against GPT-4V

GPT4-V is the new mode of GPT-4 that allows you to upload images as part of your conversations. It’s absolutely brilliant. It also provides a whole new set of vectors for prompt injection attacks.

[... 889 words]

2:24 am / 14th October 2023 / security, ai, openai, promptinjection, generativeai, gpt4