← LOYTI Newsletter

December 2024 · RETROSPECTIVE EDITION

December 2024: Choose the right model and workflow

Amazon Nova, Bedrock multi-agent previews, and OpenAI o1 made AI architecture a business decision.

December brought more choices for companies building AI into operations. Models could handle different kinds of input, reasoning systems gained useful interfaces, and cloud platforms previewed coordination between specialist agents. More choice also meant more decisions. The useful comparison was not which announcement sounded most advanced, but which approach could complete a defined task with acceptable cost, delay, accuracy, and oversight. These three releases offered different pieces of that decision.

1. Amazon Nova broadens the model menu

On December 3, AWS introduced Amazon Nova foundation models in Bedrock. The lineup included text-focused Micro, multimodal Lite and Pro, image generation through Canvas, and video generation through Reel. The announcement described models available that day, with availability varying by model and region. It was a product release, not proof that every model was suitable for every business workflow.

The business implication was specialization. A text classification task, a document containing diagrams, and a marketing video draft need different evaluations. Buying the largest model for every request can obscure whether the application has been designed efficiently. Conversely, selecting solely on advertised price can create expensive correction work. A useful comparison would run the same representative workload through candidate models, checking completion quality alongside total processing cost and review time. Creative output also needs a separate check for brand accuracy and rights to source material.

Business takeaway: Create a model selection scorecard for one workflow. Include successful completion, correction time, latency, and total cost per usable result rather than only a price per token.

Source: https://aws.amazon.com/about-aws/whats-new/2024/12/amazon-nova-foundation-models-bedrock/

2. Multi-agent collaboration enters preview

AWS also announced a preview of multi-agent collaboration for Bedrock on December 3. A supervisor agent could coordinate specialist agents, delegate parts of a task, and consolidate their work. For this historical edition, the relevant status is preview; later availability updates on the source page do not change what customers were being offered in December.

The architecture was interesting for a process that naturally combines different responsibilities, such as collecting inventory information, examining an order, and drafting a service response. However, dividing work among agents does not automatically improve the outcome. It adds handoffs that must preserve identifiers, assumptions, and exceptions. A company considering this pattern should first document the task boundaries that already exist in the business. It should also know which component can stop the workflow when a source is missing or the specialists disagree. More agents are not a business metric.

Business takeaway: Use multiple agents only when their responsibilities can be separated and tested. Compare the preview against a simpler single-workflow baseline, including handoff errors and operating cost.

Source: https://aws.amazon.com/blogs/aws/introducing-multi-agent-collaboration-capability-for-amazon-bedrock/

3. Reasoning becomes easier to integrate into software

OpenAI's December 17 developer release brought o1 to the API with function calling, Structured Outputs, developer messages, and vision. Access initially rolled out to developers on usage tier 5. These integration capabilities mattered beyond model benchmark results: they gave developers more structured ways to connect reasoning with an application's data and tools.

For example, a custom service application might ask a model to analyze an exception and return a proposed action in a defined format. The application could then validate that proposal before a person approves it. Structured output helps software consume a response, but a valid data shape is not the same as a correct business decision. The evaluation must still include wrong assumptions, missing evidence, and situations requiring escalation. Longer reasoning also carries a cost and latency tradeoff, so it should be reserved for tasks that benefit from it.

Business takeaway: Identify one difficult exception-handling task. Test whether reasoning improves the decision enough to justify its cost, and keep final authorization in explicit application rules.

Source: https://openai.com/index/o1-and-new-tools-for-developers/

A sound year-end AI budget could separate experimentation from production commitments. Fund small comparisons, preserve the results, and expand the approach that improves the actual workflow. The deliverable should be a working process with measurable outcomes and a clear owner, rather than a collection of impressive demonstrations.

Present-day invitation: Book a conversation with Brice Prather at https://loyti.com/book to explore AI consulting, custom software, and business automation for your organization. Bring one operational bottleneck, the tools involved, and the business outcome you want to improve.

Brice Prather President, CEO & Founder Life On Your Terms, Inc. (LOYTI) Turning AI and custom software into smarter operations and business growth.

Original sources

  1. Announcing Amazon Nova foundation models available today in Amazon Bedrock · 2024-12-03
  2. Introducing multi-agent collaboration capability for Amazon Bedrock (preview) · 2024-12-03
  3. OpenAI o1 and new tools for developers · 2024-12-17