← LOYTI Newsletter

January 2022 · RETROSPECTIVE EDITION

January 2022: Better instructions, better search, better ownership

Three developments clarify how a business can turn AI experiments into manageable services.

AI's business value often disappears between a convincing demonstration and a dependable daily process. January brought developments in instruction following, searching by meaning and operating AI on familiar enterprise infrastructure. Each addressed a different part of that gap. The opportunity for leaders was to choose a task with a measurable result, then make sure the information, review process and technical ownership were as deliberate as the model choice.

1. InstructGPT focuses on following the user's request

On January 27, OpenAI described InstructGPT models trained with human feedback and deployed as the default language models in its API. OpenAI reported improvements in following intentions and reducing some undesirable outputs relative to GPT-3. The announcement also acknowledged limitations. Better instruction following did not mean that generated statements were automatically true.

For a business, this suggested a more approachable way to test structured drafting tasks. A useful instruction could specify the audience, allowed facts, output format and circumstances requiring a human answer. That is considerably clearer than asking a model to write something good and judging the tone afterward.

Business takeaway: build a short evaluation set before introducing AI-generated customer content. Include missing information, conflicting instructions and ambiguous requests. Check whether the system admits uncertainty and preserves the facts you supplied. Count factual corrections, not just whether the writing sounds natural. A strong pilot makes review easier rather than hiding review work.

Source: https://openai.com/index/instruction-following/

2. Search moves beyond matching the same words

OpenAI introduced text and code embeddings through an API endpoint on January 25. Embeddings represent information numerically so software can compare semantic similarity. The announced applications included search, clustering and classification. These capabilities could help locate relevant material even when the question and document use different wording.

Imagine an employee searching for the approved process for a late shipment while the procedure is filed under delivery exceptions. Better retrieval could reduce searching time. But search quality still depends on whether the underlying document is accurate, current and appropriate for that employee to access.

Business takeaway: create a small internal search benchmark using real questions and known correct documents. Compare semantic retrieval with your existing keyword search. Keep permissions intact and show the source document clearly. Measure how often staff reach the right answer and how quickly they recognize outdated material. A search result is a pointer to evidence, not a substitute for evidence.

Source: https://openai.com/index/introducing-text-and-code-embeddings/

3. Enterprise AI gets a clearer operating home

NVIDIA announced general availability of AI Enterprise 1.1 on January 19, including production support for VMware vSphere with Tanzu. The release supported running AI workloads in containers and virtual machines within an enterprise environment. It was an infrastructure release, not a ready-made business application.

This distinction is valuable when reviewing a proposal. A platform can help an IT team run software, but somebody still has to define the workflow, approve data access, monitor performance and respond to failures. Buying a sophisticated platform before identifying those responsibilities can turn an experiment into an expensive maintenance obligation.

Business takeaway: ask who will operate the proposed system after the developer leaves. Document support ownership, access changes, backup requirements and recovery procedures. Compare managed services with existing infrastructure using the same workload assumptions. The right hosting decision is the one your organization can sustain, not necessarily the one with the longest feature list.

Source: https://blogs.nvidia.com/blog/ai-enterprise-release/

The project brief to write this month

A focused project brief can fit on one page. Begin with the employee or customer problem, then describe the information that already exists and the output that would make the next step easier. Define the current effort in minutes, the common sources of error and the cost of an incorrect answer. Choose a reviewer who understands the work.

Next, define success in business language. For internal search, that might mean finding an approved procedure without asking three colleagues. For drafting, it might mean reducing editing time while maintaining factual accuracy. For infrastructure, it might mean an agreed recovery time and a predictable monthly cost.

Finally, identify the simplest non-AI alternative. Improving document titles, standardizing templates or connecting two systems may deliver enough value on its own. AI should be a justified part of the design. Comparing alternatives makes it easier to spend on a real improvement rather than on the novelty of the technology.

Present-day invitation: Have an internal information or workflow problem worth solving? Book a consultation with Brice Prather at https://loyti.com/book. LOYTI can help you examine practical AI, custom software and automation options around a concrete business goal.

Original sources

  1. Aligning language models to follow instructions · 2022-01-27
  2. Introducing text and code embeddings · 2022-01-25
  3. New NVIDIA AI Enterprise Release Lights Up Data Centers · 2022-01-19