Jev 1.14: ask about images, then locate the answer

Transcript

The original narration, preserved as published. Relative dates refer to the episode’s coverage window.

Jev can now answer questions about pictures, and point to things inside them. TypeSafe released Jev one point fourteen yesterday, October fourteenth, alongside experimental image inputs, bounding boxes, and longer context. The interesting part is how those pieces fit together.

You can put an image into the shared state, the question, or even the answer criteria. Image input works on both one point thirteen and one point fourteen. It is an explicit opt in, rather than a new default for production.

The new Box question needs one point fourteen. It returns one rectangle around a target, with four edges expressed as fractions of the image size, plus confidence. That gives an app coordinates it can use for a crop or highlight.

Long context is another separate opt in, raising both request and question limits to two hundred sixty two thousand tokens. TypeSafe warns that longer inputs are slower and less accurate. More room does not make every answer more dependable.

Picture a parcel photo: ask whether a package is present, then locate it with a Box question. Those are separate, composable steps. TypeSafe calls these features experimental and not production ready. Treat that parcel workflow as a prototype idea, not a demonstrated result.